2023-12-16T01:07:13.980 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T01:07:13.980 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430 -- /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/orig.config.yaml 2023-12-16T01:07:14.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:07:14.101 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7493430' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5996 sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLT84M/AV4/HUmQiSlGYB/nrejtLpviyEn/4EtWnZz8KcMAU5KAdOrigkJ236Kj6RvLUrCQ7ad/npxeP8t5sPhU= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDoiuyy1K2+BNhSVOZJEcguRfEKbkT4j6v44LDb2O/Dc/gQv5MX3eYQww3y/nyYUkzBDgBHlMN6IPUlnTKInKo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_00:09:48 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-16T01:07:14.101 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa; will attempt to use it 2023-12-16T01:07:14.102 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks 2023-12-16T01:07:14.102 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T01:07:14.103 INFO:teuthology.task.internal:Checking packages... 2023-12-16T01:07:14.126 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6d933094a156ec7587742e5aa25fba5ba27ec678' 2023-12-16T01:07:14.126 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T01:07:14.127 INFO:teuthology.packaging:ref: None 2023-12-16T01:07:14.127 INFO:teuthology.packaging:tag: None 2023-12-16T01:07:14.127 INFO:teuthology.packaging:branch: main 2023-12-16T01:07:14.127 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:07:14.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-12-16T01:07:14.400 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-196.g85fe3c65 2023-12-16T01:07:14.401 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T01:07:14.406 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T01:07:14.407 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T01:07:14.434 INFO:teuthology.task.internal:Saving configuration 2023-12-16T01:07:14.453 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T01:07:14.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T01:07:14.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 01:01:32.727269', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLT84M/AV4/HUmQiSlGYB/nrejtLpviyEn/4EtWnZz8KcMAU5KAdOrigkJ236Kj6RvLUrCQ7ad/npxeP8t5sPhU='} 2023-12-16T01:07:14.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 01:01:32.725399', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDoiuyy1K2+BNhSVOZJEcguRfEKbkT4j6v44LDb2O/Dc/gQv5MX3eYQww3y/nyYUkzBDgBHlMN6IPUlnTKInKo='} 2023-12-16T01:07:14.509 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T01:07:14.516 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-16T01:07:14.517 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-16T01:07:14.517 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T01:07:14.597 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d5cb26ca0>, signals=[15]) 2023-12-16T01:07:14.598 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T01:07:14.607 INFO:teuthology.task.internal:Opening connections... 2023-12-16T01:07:14.607 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:07:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:07:14.692 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T01:07:14.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:07:14.774 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T01:07:14.781 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-12-16T01:07:14.799 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-12-16T01:07:14.799 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-12-16T01:07:14.855 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-12-16T01:07:14.855 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T01:07:14.856 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T01:07:14.857 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-12-16T01:07:14.882 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-12-16T01:07:14.899 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-12-16T01:07:14.899 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-16T01:07:14.954 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-12-16T01:07:14.954 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2023-12-16T01:07:14.954 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-12-16T01:07:14.954 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T01:07:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T01:07:14.956 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-16T01:07:14.982 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T01:07:14.992 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T01:07:14.999 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T01:07:14.999 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2023-12-16T01:07:15.002 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2023-12-16T01:07:15.017 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T01:07:15.023 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T01:07:15.023 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2023-12-16T01:07:15.058 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2023-12-16T01:07:15.094 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T01:07:15.142 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T01:07:15.159 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T01:07:15.159 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T01:07:15.160 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T01:07:15.160 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T01:07:15.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T01:07:15.177 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2023-12-16T01:07:15.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T01:07:15.179 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-12-16T01:07:15.234 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-361.el9.x86_64 2023-12-16T01:07:15.234 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-361.el9.x86_64 2023-12-16T01:07:15.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2023-12-16T01:07:15.236 INFO:teuthology.orchestra.run.smithi157.stdout:5.14.0-361.el9.x86_64 2023-12-16T01:07:15.236 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.14.0-361.el9.x86_64 2023-12-16T01:07:15.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2023-12-16T01:07:17.332 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-16T01:07:17.389 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-16T01:07:18.657 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2023-12-16T01:07:18.732 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-12-16T01:07:19.531 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-12-16T01:07:20.417 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 7.9 MB 00:01 2023-12-16T01:07:22.023 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-12-16T01:07:27.706 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.8 MB 00:02 2023-12-16T01:07:27.899 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 18 MB 00:06 2023-12-16T01:07:29.165 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 15 kB 00:00 2023-12-16T01:07:30.092 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2023-12-16T01:07:33.199 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-12-16T01:07:34.808 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2023-12-16T01:07:34.908 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-12-16T01:07:35.593 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 30 MB/s | 20 MB 00:00 2023-12-16T01:07:37.064 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T01:07:37.064 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T01:07:37.157 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:07:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2023-12-16T01:07:37.165 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2023-12-16T01:07:37.165 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2023-12-16T01:07:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:07:37.165 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 96 M 2023-12-16T01:07:37.165 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 121 M 2023-12-16T01:07:37.165 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2023-12-16T01:07:37.734 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 11 MB/s | 5.6 MB 00:00 2023-12-16T01:07:38.293 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 19 MB/s | 20 MB 00:01 2023-12-16T01:07:38.868 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 23 MB/s | 38 MB 00:01 2023-12-16T01:07:39.210 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 22 MB/s | 32 MB 00:01 2023-12-16T01:07:39.210 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2023-12-16T01:07:39.210 INFO:teuthology.orchestra.run.smithi107.stdout:Total 47 MB/s | 96 MB 00:02 2023-12-16T01:07:40.067 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2023-12-16T01:07:40.367 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 9.9 kB/s | 1.7 kB 00:00 2023-12-16T01:07:40.438 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2023-12-16T01:07:40.438 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2023-12-16T01:07:41.750 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2023-12-16T01:07:41.750 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2023-12-16T01:07:42.441 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T01:07:42.441 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T01:07:42.552 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-12-16T01:07:42.557 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-12-16T01:07:42.557 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2023-12-16T01:07:42.557 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-12-16T01:07:42.557 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout:Install 4 Packages 2023-12-16T01:07:42.558 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:07:42.559 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 96 M 2023-12-16T01:07:42.559 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 121 M 2023-12-16T01:07:42.559 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-12-16T01:07:43.135 INFO:teuthology.orchestra.run.smithi157.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 12 MB/s | 5.6 MB 00:00 2023-12-16T01:07:43.686 INFO:teuthology.orchestra.run.smithi157.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 20 MB/s | 20 MB 00:01 2023-12-16T01:07:44.094 INFO:teuthology.orchestra.run.smithi157.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 27 MB/s | 38 MB 00:01 2023-12-16T01:07:44.569 INFO:teuthology.orchestra.run.smithi157.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 23 MB/s | 32 MB 00:01 2023-12-16T01:07:44.570 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-12-16T01:07:44.570 INFO:teuthology.orchestra.run.smithi157.stdout:Total 48 MB/s | 96 MB 00:02 2023-12-16T01:07:44.637 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2023-12-16T01:07:45.274 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T01:07:45.418 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T01:07:45.426 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-12-16T01:07:45.812 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-12-16T01:07:45.812 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-12-16T01:07:47.133 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-12-16T01:07:47.134 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-12-16T01:07:48.187 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T01:07:48.419 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T01:07:50.072 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-12-16T01:07:50.713 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T01:07:50.845 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T01:07:52.986 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T01:07:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:07:53.647 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T01:07:53.832 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T01:07:57.792 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:07:58.451 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T01:07:58.656 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:03.282 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:27.110 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:27.111 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T01:08:27.111 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T01:08:27.111 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:08:27.498 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2023-12-16T01:08:28.024 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T01:08:28.169 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T01:08:28.169 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T01:08:28.169 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T01:08:28.170 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T01:08:28.170 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T01:08:28.170 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-16T01:08:28.170 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T01:08:28.170 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T01:08:28.288 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T01:08:28.288 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T01:08:28.289 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2023-12-16T01:08:28.322 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T01:08:28.323 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:08:28.324 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T01:08:28.325 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T01:08:28.325 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-391.el9.x86_64 2023-12-16T01:08:28.325 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T01:08:28.971 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2023-12-16T01:08:30.354 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T01:08:30.391 INFO:teuthology.orchestra.run.smithi107.stderr:done 2023-12-16T01:08:30.393 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2023-12-16T01:08:30.408 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.XAGWWAnNap 2023-12-16T01:08:30.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XAGWWAnNap 2023-12-16T01:08:30.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.XAGWWAnNap 2023-12-16T01:08:30.620 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.XAGWWAnNap is 6KB 2023-12-16T01:08:30.668 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.XAGWWAnNap 2023-12-16T01:08:30.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T01:08:30.746 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T01:08:30.747 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T01:08:30.747 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T01:08:30.747 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T01:08:30.748 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T01:08:30.900 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2023-12-16T01:08:32.376 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:32.420 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:32.897 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:32.897 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T01:08:32.897 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T01:08:32.897 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T01:08:33.274 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T01:08:33.274 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:08:33.275 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-12-16T01:08:33.785 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T01:08:33.932 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T01:08:33.932 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T01:08:33.932 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T01:08:33.932 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T01:08:33.932 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T01:08:33.932 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-16T01:08:33.932 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T01:08:33.932 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T01:08:34.051 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T01:08:34.051 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T01:08:34.051 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2023-12-16T01:08:34.093 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2023-12-16T01:08:34.093 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2023-12-16T01:08:34.093 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.06 2023-12-16T01:08:34.093 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 68.el9 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Group : Unspecified 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 8264254 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : builder@centos.org 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2023-12-16T01:08:34.094 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:08:34.095 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T01:08:34.096 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T01:08:34.096 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 5.14.0-391.el9.x86_64 2023-12-16T01:08:34.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T01:08:34.738 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2023-12-16T01:08:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T01:08:36.160 INFO:teuthology.orchestra.run.smithi157.stderr:done 2023-12-16T01:08:36.163 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-12-16T01:08:36.178 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.Uyy0qKjWrW 2023-12-16T01:08:36.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Uyy0qKjWrW 2023-12-16T01:08:36.248 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.Uyy0qKjWrW 2023-12-16T01:08:36.388 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.Uyy0qKjWrW is 6KB 2023-12-16T01:08:36.436 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.Uyy0qKjWrW 2023-12-16T01:08:36.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T01:08:36.515 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T01:08:36.515 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T01:08:36.515 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T01:08:36.515 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T01:08:36.517 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T01:08:36.680 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2023-12-16T01:09:00.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-16T01:09:00.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T01:09:00.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:09:06.685 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-16T01:09:06.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:09:06.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:09:35.382 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T01:09:41.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T01:09:44.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T01:09:44.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:09:50.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:09:50.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:09:53.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T01:10:02.769 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T01:10:05.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:10:05.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:10:14.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T01:10:14.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:10:17.423 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-12-16T01:10:17.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T01:10:17.907 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-16T01:10:17.907 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2023-12-16T01:10:17.921 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-391.el9.x86_64 2023-12-16T01:10:17.921 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T01:10:17.921 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T01:10:17.921 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T01:10:18.923 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-16T01:10:18.923 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T01:10:19.018 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2023-12-16T01:10:19.061 DEBUG:teuthology.parallel:result is None 2023-12-16T01:11:05.341 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T01:11:20.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:11:20.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:11:20.640 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-16T01:11:21.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:11:21.009 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-391.el9.x86_64"... 2023-12-16T01:11:21.009 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-12-16T01:11:21.025 INFO:teuthology.orchestra.run.smithi157.stdout:5.14.0-391.el9.x86_64 2023-12-16T01:11:21.025 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T01:11:21.025 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T01:11:21.025 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T01:11:22.026 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-16T01:11:22.026 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T01:11:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2023-12-16T01:11:22.145 DEBUG:teuthology.parallel:result is None 2023-12-16T01:11:22.146 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T01:11:22.154 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T01:11:22.154 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T01:11:22.157 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T01:11:22.174 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T01:11:22.181 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T01:11:22.188 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T01:11:22.188 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T01:11:22.216 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T01:11:22.249 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T01:11:22.255 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T01:11:22.255 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T01:11:22.281 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T01:11:22.319 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T01:11:22.322 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T01:11:22.332 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T01:11:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T01:11:22.338 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T01:11:22.345 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T01:11:22.345 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T01:11:22.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T01:11:22.407 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T01:11:22.416 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T01:11:22.416 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T01:11:22.446 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T01:11:22.463 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T01:11:22.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T01:11:22.588 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T01:11:22.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T01:11:22.712 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:11:22.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T01:11:22.778 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T01:11:22.822 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T01:11:22.884 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T01:11:22.925 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T01:11:22.971 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:11:22.971 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T01:11:23.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2023-12-16T01:11:23.042 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2023-12-16T01:11:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T01:11:23.122 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T01:11:23.543 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T01:11:23.550 INFO:teuthology.task.internal:Starting timer... 2023-12-16T01:11:23.550 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T01:11:23.561 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T01:11:23.569 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2023-12-16T01:11:23.626 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2023-12-16T01:11:23.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2023-12-16T01:11:23.676 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2023-12-16T01:11:23.678 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T01:11:23.678 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2023-12-16T01:11:23.695 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2023-12-16T01:11:23.695 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2023-12-16T01:11:23.721 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2023-12-16T01:11:23.721 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2023-12-16T01:11:23.722 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T01:11:23.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T01:11:23.763 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T01:11:23.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T01:11:23.792 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T01:11:23.792 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2023-12-16T01:11:23.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2023-12-16T01:11:23.874 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T01:11:23.884 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-16T01:11:23.884 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T01:11:23.902 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T01:11:23.904 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T01:16:52.699 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2023-12-16T01:16:52.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T01:16:52.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:16:52.784 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-12-16T01:16:52.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T01:16:52.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:16:52.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T01:16:52.939 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-16T01:16:53.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T01:16:53.004 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T01:16:53.014 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T01:16:53.015 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T01:16:53.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T01:16:53.017 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T01:16:53.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T01:16:53.046 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T01:16:53.062 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T01:16:53.074 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T01:16:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T01:16:53.104 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2023-12-16T01:16:53.117 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2023-12-16T01:16:53.119 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2023-12-16T01:16:53.133 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2023-12-16T01:16:53.134 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T01:16:53.149 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T01:16:53.150 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T01:16:53.166 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T01:16:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2023-12-16T01:16:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T01:16:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2023-12-16T01:16:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.209 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2023-12-16T01:16:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T01:16:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-12-16T01:16:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T01:16:53.213 INFO:teuthology.run_tasks:Running task install... 2023-12-16T01:16:53.221 DEBUG:teuthology.task.install:project ceph 2023-12-16T01:16:53.222 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}} 2023-12-16T01:16:53.222 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T01:16:53.222 INFO:teuthology.task.install:Using flavor: default 2023-12-16T01:16:53.228 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-12-16T01:16:53.228 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-16T01:16:53.228 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T01:16:53.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:16:53.231 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T01:16:53.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:16:53.382 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/ 2023-12-16T01:16:53.383 INFO:teuthology.task.install.rpm:Package version is 19.0.0-191.g6d933094 2023-12-16T01:16:53.457 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/ 2023-12-16T01:16:53.457 INFO:teuthology.task.install.rpm:Package version is 19.0.0-191.g6d933094 2023-12-16T01:16:53.560 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T01:16:53.561 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:16:53.561 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T01:16:53.588 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-16T01:16:53.589 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6d933094a156ec7587742e5aa25fba5ba27ec678/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T01:16:53.638 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T01:16:53.639 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:16:53.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T01:16:53.657 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T01:16:53.666 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-16T01:16:53.667 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6d933094a156ec7587742e5aa25fba5ba27ec678/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T01:16:53.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T01:16:53.736 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T01:16:53.802 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2023-12-16T01:16:53.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2023-12-16T01:16:53.814 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T01:16:53.881 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2023-12-16T01:16:53.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2023-12-16T01:16:54.051 INFO:teuthology.orchestra.run.smithi157.stdout:73 files removed 2023-12-16T01:16:54.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-16T01:16:54.139 INFO:teuthology.orchestra.run.smithi107.stdout:73 files removed 2023-12-16T01:16:54.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-16T01:16:54.778 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 208 kB/s | 79 kB 00:00 2023-12-16T01:16:54.906 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 188 kB/s | 79 kB 00:00 2023-12-16T01:16:55.153 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 29 kB/s | 9.5 kB 00:00 2023-12-16T01:16:55.291 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 28 kB/s | 9.5 kB 00:00 2023-12-16T01:16:55.521 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2023-12-16T01:16:55.641 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-12-16T01:16:56.027 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-16T01:16:56.081 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-16T01:16:57.452 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2023-12-16T01:16:57.506 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2023-12-16T01:16:58.235 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 7.9 MB 00:00 2023-12-16T01:16:58.522 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-12-16T01:16:59.961 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 28 MB/s | 18 MB 00:00 2023-12-16T01:17:00.248 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 30 MB/s | 18 MB 00:00 2023-12-16T01:17:04.428 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 5.8 MB 00:01 2023-12-16T01:17:05.225 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.8 MB 00:01 2023-12-16T01:17:05.736 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 15 kB 00:00 2023-12-16T01:17:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2023-12-16T01:17:07.330 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-16T01:17:08.063 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-12-16T01:17:12.013 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-12-16T01:17:12.869 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-16T01:17:14.477 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T01:17:14.478 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T01:17:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-16T01:17:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-16T01:17:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-16T01:17:14.514 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-16T01:17:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-16T01:17:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-16T01:17:14.520 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-16T01:17:14.596 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout:=================================================================================================== 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout:=================================================================================================== 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-191.g6d933094.el9 ceph 6.5 k 2023-12-16T01:17:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-191.g6d933094.el9 ceph 5.2 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 73 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 409 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-191.g6d933094.el9 ceph 859 k 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 5.8 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-191.g6d933094.el9 ceph 141 k 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.4 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 47 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.5 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 133 k 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 1.8 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 19 M 2023-12-16T01:17:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 7.4 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 50 k 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 112 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 312 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-191.g6d933094.el9 ceph 8.6 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 171 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-191.g6d933094.el9 ceph 41 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 622 M 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 262 k 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 808 k 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.0.0-191.g6d933094.el9 ceph 217 k 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.0.0-191.g6d933094.el9 ceph 27 k 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 18 k 2023-12-16T01:17:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-191.g6d933094.el9 ceph 31 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-191.g6d933094.el9 ceph 719 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 5.2 M 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-191.g6d933094.el9 ceph 126 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 108 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 44 M 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 50 M 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-16T01:17:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-191.g6d933094.el9 ceph 161 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 614 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-191.g6d933094.el9 ceph 321 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 769 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-191.g6d933094.el9 ceph 298 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.1 M 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-191.g6d933094.el9 ceph 99 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 337 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-191.g6d933094.el9 ceph 85 k 2023-12-16T01:17:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 506 k 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-191.g6d933094.el9 ceph 3.0 M 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 50 M 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-191.g6d933094.el9 ceph 170 k 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.2 M 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-16T01:17:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-191.g6d933094.el9 ceph 3.3 M 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-191.g6d933094.el9 ceph 3.0 M 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-16T01:17:14.615 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-191.g6d933094.el9 ceph 19 M 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 21 M 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 28 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-191.g6d933094.el9 ceph 2.1 M 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 243 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-191.g6d933094.el9 ceph 4.4 M 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-191.g6d933094.el9 ceph 18 M 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 15 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-191.g6d933094.el9 ceph 24 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T01:17:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-191.g6d933094.el9 ceph 163 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T01:17:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-191.g6d933094.el9 ceph 476 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-191.g6d933094.el9 ceph 4.8 M 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-16T01:17:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-191.g6d933094.el9 ceph 45 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-191.g6d933094.el9 ceph 130 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T01:17:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T01:17:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T01:17:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T01:17:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout:=================================================================================================== 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout:Install 162 Packages 2023-12-16T01:17:14.623 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 15 Packages 2023-12-16T01:17:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:17:14.624 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.1 G 2023-12-16T01:17:14.624 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2023-12-16T01:17:15.278 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T01:17:15.279 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T01:17:15.312 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-16T01:17:15.313 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-16T01:17:15.314 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-16T01:17:15.315 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-16T01:17:15.316 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-16T01:17:15.319 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-16T01:17:15.320 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-16T01:17:15.347 INFO:teuthology.orchestra.run.smithi107.stdout:(1/177): ceph-19.0.0-191.g6d933094.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2023-12-16T01:17:15.397 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-12-16T01:17:15.423 INFO:teuthology.orchestra.run.smithi157.stdout:=================================================================================================== 2023-12-16T01:17:15.423 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2023-12-16T01:17:15.423 INFO:teuthology.orchestra.run.smithi157.stdout:=================================================================================================== 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:19.0.0-191.g6d933094.el9 ceph 6.5 k 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:19.0.0-191.g6d933094.el9 ceph 5.2 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 73 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 409 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:19.0.0-191.g6d933094.el9 ceph 859 k 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 5.8 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-191.g6d933094.el9 ceph 141 k 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.4 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 47 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.5 M 2023-12-16T01:17:15.424 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 133 k 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 1.8 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 19 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 7.4 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 50 k 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 112 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 312 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:19.0.0-191.g6d933094.el9 ceph 8.6 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 171 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:19.0.0-191.g6d933094.el9 ceph 41 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 622 M 2023-12-16T01:17:15.425 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 262 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 808 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:19.0.0-191.g6d933094.el9 ceph 217 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell x86_64 2:19.0.0-191.g6d933094.el9 ceph 27 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 18 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:19.0.0-191.g6d933094.el9 ceph 31 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:19.0.0-191.g6d933094.el9 ceph 719 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 5.2 M 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:19.0.0-191.g6d933094.el9 ceph 126 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 108 k 2023-12-16T01:17:15.426 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 44 M 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 50 M 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:19.0.0-191.g6d933094.el9 ceph 161 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 614 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:19.0.0-191.g6d933094.el9 ceph 321 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 769 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:19.0.0-191.g6d933094.el9 ceph 298 k 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.1 M 2023-12-16T01:17:15.427 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:19.0.0-191.g6d933094.el9 ceph 99 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 337 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:19.0.0-191.g6d933094.el9 ceph 85 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 506 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:19.0.0-191.g6d933094.el9 ceph 3.0 M 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 50 M 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:19.0.0-191.g6d933094.el9 ceph 170 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 1.2 M 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-16T01:17:15.428 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:19.0.0-191.g6d933094.el9 ceph 3.3 M 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:19.0.0-191.g6d933094.el9 ceph 3.0 M 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-12-16T01:17:15.429 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:19.0.0-191.g6d933094.el9 ceph 19 M 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-debuginfo x86_64 2:19.0.0-191.g6d933094.el9 ceph 21 M 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 28 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:19.0.0-191.g6d933094.el9 ceph 2.1 M 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 243 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:19.0.0-191.g6d933094.el9 ceph 4.4 M 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:19.0.0-191.g6d933094.el9 ceph 18 M 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:19.0.0-191.g6d933094.el9 ceph-noarch 15 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:19.0.0-191.g6d933094.el9 ceph 24 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T01:17:15.430 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:19.0.0-191.g6d933094.el9 ceph 163 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T01:17:15.431 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:19.0.0-191.g6d933094.el9 ceph 476 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:19.0.0-191.g6d933094.el9 ceph 4.8 M 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T01:17:15.432 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:19.0.0-191.g6d933094.el9 ceph 45 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:19.0.0-191.g6d933094.el9 ceph 130 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T01:17:15.433 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T01:17:15.434 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T01:17:15.435 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T01:17:15.436 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-16T01:17:15.437 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:=================================================================================================== 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:Install 162 Packages 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 15 Packages 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:17:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.1 G 2023-12-16T01:17:15.439 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-12-16T01:17:16.069 INFO:teuthology.orchestra.run.smithi157.stdout:(1/177): ceph-19.0.0-191.g6d933094.el9.x86_64.r 35 kB/s | 6.5 kB 00:00 2023-12-16T01:17:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:(2/177): ceph-base-19.0.0-191.g6d933094.el9.x86 4.9 MB/s | 5.2 MB 00:01 2023-12-16T01:17:17.305 INFO:teuthology.orchestra.run.smithi107.stdout:(3/177): ceph-common-19.0.0-191.g6d933094.el9.x 9.8 MB/s | 19 MB 00:01 2023-12-16T01:17:18.944 INFO:teuthology.orchestra.run.smithi157.stdout:(2/177): ceph-base-19.0.0-191.g6d933094.el9.x86 1.7 MB/s | 5.2 MB 00:03 2023-12-16T01:17:19.404 INFO:teuthology.orchestra.run.smithi107.stdout:(4/177): ceph-debuginfo-19.0.0-191.g6d933094.el 9.9 MB/s | 21 MB 00:02 2023-12-16T01:17:19.555 INFO:teuthology.orchestra.run.smithi107.stdout:(5/177): ceph-fuse-19.0.0-191.g6d933094.el9.x86 5.6 MB/s | 859 kB 00:00 2023-12-16T01:17:20.971 INFO:teuthology.orchestra.run.smithi107.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-191.g6d9330 4.1 MB/s | 5.8 MB 00:01 2023-12-16T01:17:21.038 INFO:teuthology.orchestra.run.smithi107.stdout:(7/177): ceph-immutable-object-cache-19.0.0-191 2.1 MB/s | 141 kB 00:00 2023-12-16T01:17:21.239 INFO:teuthology.orchestra.run.smithi107.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 7.0 MB/s | 1.4 MB 00:00 2023-12-16T01:17:21.605 INFO:teuthology.orchestra.run.smithi107.stdout:(9/177): ceph-mds-19.0.0-191.g6d933094.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2023-12-16T01:17:25.652 INFO:teuthology.orchestra.run.smithi157.stdout:(3/177): ceph-common-19.0.0-191.g6d933094.el9.x 2.0 MB/s | 19 MB 00:09 2023-12-16T01:17:27.738 INFO:teuthology.orchestra.run.smithi107.stdout:(10/177): ceph-mds-debuginfo-19.0.0-191.g6d9330 7.7 MB/s | 47 MB 00:06 2023-12-16T01:17:28.096 INFO:teuthology.orchestra.run.smithi107.stdout:(11/177): ceph-mgr-19.0.0-191.g6d933094.el9.x86 4.1 MB/s | 1.5 MB 00:00 2023-12-16T01:17:31.955 INFO:teuthology.orchestra.run.smithi107.stdout:(12/177): ceph-mgr-debuginfo-19.0.0-191.g6d9330 5.0 MB/s | 19 MB 00:03 2023-12-16T01:17:32.896 INFO:teuthology.orchestra.run.smithi107.stdout:(13/177): ceph-mon-19.0.0-191.g6d933094.el9.x86 4.7 MB/s | 4.4 MB 00:00 2023-12-16T01:17:32.952 INFO:teuthology.orchestra.run.smithi157.stdout:(4/177): ceph-debuginfo-19.0.0-191.g6d933094.el 2.9 MB/s | 21 MB 00:07 2023-12-16T01:17:33.500 INFO:teuthology.orchestra.run.smithi157.stdout:(5/177): ceph-fuse-19.0.0-191.g6d933094.el9.x86 1.5 MB/s | 859 kB 00:00 2023-12-16T01:17:34.150 INFO:teuthology.orchestra.run.smithi157.stdout:(6/177): ceph-base-debuginfo-19.0.0-191.g6d9330 4.0 MB/s | 73 MB 00:18 2023-12-16T01:17:34.251 INFO:teuthology.orchestra.run.smithi157.stdout:(7/177): ceph-immutable-object-cache-19.0.0-191 1.4 MB/s | 141 kB 00:00 2023-12-16T01:17:34.443 INFO:teuthology.orchestra.run.smithi157.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 7.3 MB/s | 1.4 MB 00:00 2023-12-16T01:17:34.768 INFO:teuthology.orchestra.run.smithi157.stdout:(9/177): ceph-mds-19.0.0-191.g6d933094.el9.x86_ 6.4 MB/s | 2.1 MB 00:00 2023-12-16T01:17:34.877 INFO:teuthology.orchestra.run.smithi157.stdout:(10/177): ceph-fuse-debuginfo-19.0.0-191.g6d933 4.2 MB/s | 5.8 MB 00:01 2023-12-16T01:17:35.468 INFO:teuthology.orchestra.run.smithi157.stdout:(11/177): ceph-mgr-19.0.0-191.g6d933094.el9.x86 2.5 MB/s | 1.5 MB 00:00 2023-12-16T01:17:37.721 INFO:teuthology.orchestra.run.smithi107.stdout:(14/177): ceph-base-debuginfo-19.0.0-191.g6d933 3.3 MB/s | 73 MB 00:22 2023-12-16T01:17:41.177 INFO:teuthology.orchestra.run.smithi157.stdout:(12/177): ceph-mgr-debuginfo-19.0.0-191.g6d9330 3.3 MB/s | 19 MB 00:05 2023-12-16T01:17:41.862 INFO:teuthology.orchestra.run.smithi107.stdout:(15/177): ceph-osd-19.0.0-191.g6d933094.el9.x86 4.3 MB/s | 18 MB 00:04 2023-12-16T01:17:42.735 INFO:teuthology.orchestra.run.smithi157.stdout:(13/177): ceph-mon-19.0.0-191.g6d933094.el9.x86 2.8 MB/s | 4.4 MB 00:01 2023-12-16T01:17:43.410 INFO:teuthology.orchestra.run.smithi157.stdout:(14/177): ceph-mds-debuginfo-19.0.0-191.g6d9330 5.5 MB/s | 47 MB 00:08 2023-12-16T01:17:48.760 INFO:teuthology.orchestra.run.smithi157.stdout:(15/177): ceph-osd-19.0.0-191.g6d933094.el9.x86 3.3 MB/s | 18 MB 00:05 2023-12-16T01:17:59.359 INFO:teuthology.orchestra.run.smithi107.stdout:(16/177): ceph-mon-debuginfo-19.0.0-191.g6d9330 4.2 MB/s | 112 MB 00:26 2023-12-16T01:18:01.301 INFO:teuthology.orchestra.run.smithi107.stdout:(17/177): ceph-radosgw-19.0.0-191.g6d933094.el9 4.4 MB/s | 8.6 MB 00:01 2023-12-16T01:18:07.766 INFO:teuthology.orchestra.run.smithi157.stdout:(16/177): ceph-mon-debuginfo-19.0.0-191.g6d9330 4.5 MB/s | 112 MB 00:25 2023-12-16T01:18:08.841 INFO:teuthology.orchestra.run.smithi157.stdout:(17/177): ceph-radosgw-19.0.0-191.g6d933094.el9 8.0 MB/s | 8.6 MB 00:01 2023-12-16T01:18:25.689 INFO:teuthology.orchestra.run.smithi157.stdout:(18/177): ceph-radosgw-debuginfo-19.0.0-191.g6d 10 MB/s | 171 MB 00:16 2023-12-16T01:18:25.823 INFO:teuthology.orchestra.run.smithi157.stdout:(19/177): ceph-selinux-19.0.0-191.g6d933094.el9 181 kB/s | 24 kB 00:00 2023-12-16T01:18:27.629 INFO:teuthology.orchestra.run.smithi107.stdout:(18/177): ceph-radosgw-debuginfo-19.0.0-191.g6d 6.5 MB/s | 171 MB 00:26 2023-12-16T01:18:27.788 INFO:teuthology.orchestra.run.smithi107.stdout:(19/177): ceph-selinux-19.0.0-191.g6d933094.el9 152 kB/s | 24 kB 00:00 2023-12-16T01:18:29.898 INFO:teuthology.orchestra.run.smithi157.stdout:(20/177): ceph-test-19.0.0-191.g6d933094.el9.x8 10 MB/s | 41 MB 00:04 2023-12-16T01:18:34.120 INFO:teuthology.orchestra.run.smithi107.stdout:(20/177): ceph-test-19.0.0-191.g6d933094.el9.x8 6.5 MB/s | 41 MB 00:06 2023-12-16T01:18:39.470 INFO:teuthology.orchestra.run.smithi107.stdout:(21/177): ceph-osd-debuginfo-19.0.0-191.g6d9330 5.4 MB/s | 312 MB 00:57 2023-12-16T01:18:39.853 INFO:teuthology.orchestra.run.smithi107.stdout:(22/177): cephfs-mirror-19.0.0-191.g6d933094.el 567 kB/s | 217 kB 00:00 2023-12-16T01:18:39.953 INFO:teuthology.orchestra.run.smithi107.stdout:(23/177): cephfs-shell-19.0.0-191.g6d933094.el9 271 kB/s | 27 kB 00:00 2023-12-16T01:18:41.595 INFO:teuthology.orchestra.run.smithi107.stdout:(24/177): ceph-common-debuginfo-19.0.0-191.g6d9 4.8 MB/s | 409 MB 01:25 2023-12-16T01:18:41.612 INFO:teuthology.orchestra.run.smithi107.stdout:(25/177): libcephfs-devel-19.0.0-191.g6d933094. 19 kB/s | 31 kB 00:01 2023-12-16T01:18:42.079 INFO:teuthology.orchestra.run.smithi107.stdout:(26/177): libcephfs2-19.0.0-191.g6d933094.el9.x 1.5 MB/s | 719 kB 00:00 2023-12-16T01:18:42.212 INFO:teuthology.orchestra.run.smithi107.stdout:(27/177): libcephsqlite-19.0.0-191.g6d933094.el 1.2 MB/s | 163 kB 00:00 2023-12-16T01:18:42.296 INFO:teuthology.orchestra.run.smithi107.stdout:(28/177): librados-devel-19.0.0-191.g6d933094.e 1.5 MB/s | 126 kB 00:00 2023-12-16T01:18:42.388 INFO:teuthology.orchestra.run.smithi107.stdout:(29/177): librados-devel-debuginfo-19.0.0-191.g 1.2 MB/s | 108 kB 00:00 2023-12-16T01:18:43.213 INFO:teuthology.orchestra.run.smithi107.stdout:(30/177): libcephfs2-debuginfo-19.0.0-191.g6d93 3.2 MB/s | 5.2 MB 00:01 2023-12-16T01:18:43.422 INFO:teuthology.orchestra.run.smithi107.stdout:(31/177): libradosstriper1-19.0.0-191.g6d933094 2.2 MB/s | 476 kB 00:00 2023-12-16T01:18:49.338 INFO:teuthology.orchestra.run.smithi107.stdout:(32/177): librados2-debuginfo-19.0.0-191.g6d933 6.3 MB/s | 44 MB 00:06 2023-12-16T01:18:50.163 INFO:teuthology.orchestra.run.smithi107.stdout:(33/177): librgw2-19.0.0-191.g6d933094.el9.x86_ 5.8 MB/s | 4.8 MB 00:00 2023-12-16T01:18:50.280 INFO:teuthology.orchestra.run.smithi107.stdout:(34/177): python3-ceph-argparse-19.0.0-191.g6d9 387 kB/s | 45 kB 00:00 2023-12-16T01:18:50.413 INFO:teuthology.orchestra.run.smithi107.stdout:(35/177): python3-ceph-common-19.0.0-191.g6d933 975 kB/s | 130 kB 00:00 2023-12-16T01:18:50.580 INFO:teuthology.orchestra.run.smithi107.stdout:(36/177): python3-cephfs-19.0.0-191.g6d933094.e 969 kB/s | 161 kB 00:00 2023-12-16T01:18:50.780 INFO:teuthology.orchestra.run.smithi107.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-191.g 3.0 MB/s | 614 kB 00:00 2023-12-16T01:18:50.947 INFO:teuthology.orchestra.run.smithi107.stdout:(38/177): python3-rados-19.0.0-191.g6d933094.el 1.9 MB/s | 321 kB 00:00 2023-12-16T01:18:51.172 INFO:teuthology.orchestra.run.smithi107.stdout:(39/177): python3-rados-debuginfo-19.0.0-191.g6 3.3 MB/s | 769 kB 00:00 2023-12-16T01:18:51.322 INFO:teuthology.orchestra.run.smithi107.stdout:(40/177): python3-rbd-19.0.0-191.g6d933094.el9. 1.9 MB/s | 298 kB 00:00 2023-12-16T01:18:51.556 INFO:teuthology.orchestra.run.smithi107.stdout:(41/177): python3-rbd-debuginfo-19.0.0-191.g6d9 4.8 MB/s | 1.1 MB 00:00 2023-12-16T01:18:51.681 INFO:teuthology.orchestra.run.smithi107.stdout:(42/177): python3-rgw-19.0.0-191.g6d933094.el9. 796 kB/s | 99 kB 00:00 2023-12-16T01:18:51.790 INFO:teuthology.orchestra.run.smithi107.stdout:(43/177): python3-rgw-debuginfo-19.0.0-191.g6d9 3.0 MB/s | 337 kB 00:00 2023-12-16T01:18:51.898 INFO:teuthology.orchestra.run.smithi107.stdout:(44/177): rbd-fuse-19.0.0-191.g6d933094.el9.x86 785 kB/s | 85 kB 00:00 2023-12-16T01:18:52.048 INFO:teuthology.orchestra.run.smithi107.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-191.g6d9330 3.3 MB/s | 506 kB 00:00 2023-12-16T01:18:52.607 INFO:teuthology.orchestra.run.smithi107.stdout:(46/177): rbd-mirror-19.0.0-191.g6d933094.el9.x 5.4 MB/s | 3.0 MB 00:00 2023-12-16T01:18:59.247 INFO:teuthology.orchestra.run.smithi107.stdout:(47/177): rbd-mirror-debuginfo-19.0.0-191.g6d93 7.6 MB/s | 50 MB 00:06 2023-12-16T01:18:59.406 INFO:teuthology.orchestra.run.smithi107.stdout:(48/177): rbd-nbd-19.0.0-191.g6d933094.el9.x86_ 1.1 MB/s | 170 kB 00:00 2023-12-16T01:19:00.023 INFO:teuthology.orchestra.run.smithi107.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-191.g6d93309 2.0 MB/s | 1.2 MB 00:00 2023-12-16T01:19:00.123 INFO:teuthology.orchestra.run.smithi107.stdout:(50/177): ceph-grafana-dashboards-19.0.0-191.g6 281 kB/s | 28 kB 00:00 2023-12-16T01:19:00.256 INFO:teuthology.orchestra.run.smithi107.stdout:(51/177): ceph-mgr-cephadm-19.0.0-191.g6d933094 998 kB/s | 133 kB 00:00 2023-12-16T01:19:01.007 INFO:teuthology.orchestra.run.smithi107.stdout:(52/177): librbd1-debuginfo-19.0.0-191.g6d93309 2.9 MB/s | 50 MB 00:17 2023-12-16T01:19:01.107 INFO:teuthology.orchestra.run.smithi107.stdout:(53/177): ceph-mgr-dashboard-19.0.0-191.g6d9330 2.1 MB/s | 1.8 MB 00:00 2023-12-16T01:19:01.299 INFO:teuthology.orchestra.run.smithi107.stdout:(54/177): ceph-mgr-modules-core-19.0.0-191.g6d9 1.2 MB/s | 243 kB 00:00 2023-12-16T01:19:01.391 INFO:teuthology.orchestra.run.smithi107.stdout:(55/177): ceph-mgr-rook-19.0.0-191.g6d933094.el 549 kB/s | 50 kB 00:00 2023-12-16T01:19:01.507 INFO:teuthology.orchestra.run.smithi107.stdout:(56/177): ceph-prometheus-alerts-19.0.0-191.g6d 130 kB/s | 15 kB 00:00 2023-12-16T01:19:01.866 INFO:teuthology.orchestra.run.smithi107.stdout:(57/177): ceph-volume-19.0.0-191.g6d933094.el9. 732 kB/s | 262 kB 00:00 2023-12-16T01:19:02.025 INFO:teuthology.orchestra.run.smithi107.stdout:(58/177): cephadm-19.0.0-191.g6d933094.el9.noar 5.0 MB/s | 808 kB 00:00 2023-12-16T01:19:02.133 INFO:teuthology.orchestra.run.smithi107.stdout:(59/177): cephfs-top-19.0.0-191.g6d933094.el9.n 168 kB/s | 18 kB 00:00 2023-12-16T01:19:02.309 INFO:teuthology.orchestra.run.smithi107.stdout:(60/177): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2023-12-16T01:19:02.359 INFO:teuthology.orchestra.run.smithi107.stdout:(61/177): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2023-12-16T01:19:02.393 INFO:teuthology.orchestra.run.smithi107.stdout:(62/177): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-12-16T01:19:02.426 INFO:teuthology.orchestra.run.smithi107.stdout:(63/177): elfutils-libelf-devel-0.190-1.el9.x86 647 kB/s | 21 kB 00:00 2023-12-16T01:19:02.460 INFO:teuthology.orchestra.run.smithi107.stdout:(64/177): flex-2.6.4-9.el9.x86_64.rpm 9.0 MB/s | 307 kB 00:00 2023-12-16T01:19:02.494 INFO:teuthology.orchestra.run.smithi107.stdout:(65/177): flexiblas-3.0.4-8.el9.x86_64.rpm 950 kB/s | 32 kB 00:00 2023-12-16T01:19:02.569 INFO:teuthology.orchestra.run.smithi107.stdout:(66/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2023-12-16T01:19:02.602 INFO:teuthology.orchestra.run.smithi107.stdout:(67/177): flexiblas-openblas-openmp-3.0.4-8.el9 514 kB/s | 17 kB 00:00 2023-12-16T01:19:02.636 INFO:teuthology.orchestra.run.smithi107.stdout:(68/177): jq-1.6-16.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-16T01:19:02.670 INFO:teuthology.orchestra.run.smithi107.stdout:(69/177): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2023-12-16T01:19:02.703 INFO:teuthology.orchestra.run.smithi107.stdout:(70/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-12-16T01:19:02.737 INFO:teuthology.orchestra.run.smithi107.stdout:(71/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-16T01:19:02.779 INFO:teuthology.orchestra.run.smithi107.stdout:(72/177): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2023-12-16T01:19:02.821 INFO:teuthology.orchestra.run.smithi107.stdout:(73/177): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-12-16T01:19:02.855 INFO:teuthology.orchestra.run.smithi107.stdout:(74/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 733 kB/s | 24 kB 00:00 2023-12-16T01:19:02.888 INFO:teuthology.orchestra.run.smithi107.stdout:(75/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-16T01:19:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:(76/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-12-16T01:19:02.955 INFO:teuthology.orchestra.run.smithi107.stdout:(77/177): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-12-16T01:19:02.989 INFO:teuthology.orchestra.run.smithi107.stdout:(78/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-12-16T01:19:03.089 INFO:teuthology.orchestra.run.smithi107.stdout:(79/177): ceph-mgr-diskprediction-local-19.0.0- 3.6 MB/s | 7.4 MB 00:02 2023-12-16T01:19:03.114 INFO:teuthology.orchestra.run.smithi107.stdout:(80/177): openblas-0.3.21-2.el9.x86_64.rpm 273 kB/s | 34 kB 00:00 2023-12-16T01:19:03.190 INFO:teuthology.orchestra.run.smithi107.stdout:(81/177): openblas-openmp-0.3.21-2.el9.x86_64.r 47 MB/s | 4.7 MB 00:00 2023-12-16T01:19:03.232 INFO:teuthology.orchestra.run.smithi107.stdout:(82/177): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2023-12-16T01:19:03.273 INFO:teuthology.orchestra.run.smithi107.stdout:(83/177): postgresql-contrib-13.11-1.el9.x86_64 9.8 MB/s | 811 kB 00:00 2023-12-16T01:19:03.299 INFO:teuthology.orchestra.run.smithi107.stdout:(84/177): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-12-16T01:19:03.382 INFO:teuthology.orchestra.run.smithi107.stdout:(85/177): postgresql-server-13.11-1.el9.x86_64. 52 MB/s | 5.7 MB 00:00 2023-12-16T01:19:03.408 INFO:teuthology.orchestra.run.smithi107.stdout:(86/177): python3-attrs-20.3.0-7.el9.noarch.rpm 735 kB/s | 78 kB 00:00 2023-12-16T01:19:03.442 INFO:teuthology.orchestra.run.smithi107.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 6.8 MB/s | 228 kB 00:00 2023-12-16T01:19:03.525 INFO:teuthology.orchestra.run.smithi107.stdout:(88/177): python3-babel-2.9.1-2.el9.noarch.rpm 50 MB/s | 5.8 MB 00:00 2023-12-16T01:19:03.542 INFO:teuthology.orchestra.run.smithi107.stdout:(89/177): python3-jsonpatch-1.21-16.el9.noarch. 249 kB/s | 24 kB 00:00 2023-12-16T01:19:03.559 INFO:teuthology.orchestra.run.smithi107.stdout:(90/177): python3-jsonpointer-2.0-4.el9.noarch. 539 kB/s | 18 kB 00:00 2023-12-16T01:19:03.584 INFO:teuthology.orchestra.run.smithi107.stdout:(91/177): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-16T01:19:03.610 INFO:teuthology.orchestra.run.smithi107.stdout:(92/177): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2023-12-16T01:19:03.743 INFO:teuthology.orchestra.run.smithi107.stdout:(93/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-12-16T01:19:03.768 INFO:teuthology.orchestra.run.smithi107.stdout:(94/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-12-16T01:19:03.813 INFO:teuthology.orchestra.run.smithi107.stdout:(95/177): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-12-16T01:19:03.827 INFO:teuthology.orchestra.run.smithi107.stdout:(96/177): python3-prettytable-0.7.2-27.el9.noar 708 kB/s | 41 kB 00:00 2023-12-16T01:19:03.852 INFO:teuthology.orchestra.run.smithi107.stdout:(97/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-16T01:19:03.878 INFO:teuthology.orchestra.run.smithi107.stdout:(98/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-16T01:19:03.895 INFO:teuthology.orchestra.run.smithi107.stdout:(99/177): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2023-12-16T01:19:03.912 INFO:teuthology.orchestra.run.smithi107.stdout:(100/177): python3-requests-oauthlib-1.3.0-12.e 1.3 MB/s | 43 kB 00:00 2023-12-16T01:19:03.992 INFO:teuthology.orchestra.run.smithi107.stdout:(101/177): python3-toml-0.10.2-6.el9.noarch.rpm 534 kB/s | 39 kB 00:00 2023-12-16T01:19:04.162 INFO:teuthology.orchestra.run.smithi107.stdout:(102/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2023-12-16T01:19:04.179 INFO:teuthology.orchestra.run.smithi107.stdout:(103/177): python3-wcwidth-0.2.5-8.el9.noarch.r 216 kB/s | 41 kB 00:00 2023-12-16T01:19:04.204 INFO:teuthology.orchestra.run.smithi107.stdout:(104/177): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-16T01:19:04.221 INFO:teuthology.orchestra.run.smithi107.stdout:(105/177): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-12-16T01:19:04.247 INFO:teuthology.orchestra.run.smithi107.stdout:(106/177): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.0 MB/s | 85 kB 00:00 2023-12-16T01:19:04.272 INFO:teuthology.orchestra.run.smithi107.stdout:(107/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-16T01:19:04.297 INFO:teuthology.orchestra.run.smithi107.stdout:(108/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2023-12-16T01:19:04.323 INFO:teuthology.orchestra.run.smithi107.stdout:(109/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-16T01:19:04.356 INFO:teuthology.orchestra.run.smithi107.stdout:(110/177): libgfortran-11.4.1-2.3.el9.x86_64.rp 13 MB/s | 803 kB 00:00 2023-12-16T01:19:04.381 INFO:teuthology.orchestra.run.smithi107.stdout:(111/177): libquadmath-11.4.1-2.3.el9.x86_64.rp 3.3 MB/s | 195 kB 00:00 2023-12-16T01:19:04.406 INFO:teuthology.orchestra.run.smithi107.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-16T01:19:04.441 INFO:teuthology.orchestra.run.smithi107.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 20 MB/s | 1.1 MB 00:00 2023-12-16T01:19:04.465 INFO:teuthology.orchestra.run.smithi107.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-16T01:19:04.499 INFO:teuthology.orchestra.run.smithi107.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 2.1 MB/s | 124 kB 00:00 2023-12-16T01:19:04.524 INFO:teuthology.orchestra.run.smithi107.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 1.9 MB/s | 113 kB 00:00 2023-12-16T01:19:04.549 INFO:teuthology.orchestra.run.smithi107.stdout:(117/177): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-12-16T01:19:04.841 INFO:teuthology.orchestra.run.smithi107.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 842 kB/s | 245 kB 00:00 2023-12-16T01:19:05.358 INFO:teuthology.orchestra.run.smithi107.stdout:(119/177): gperftools-libs-2.9.1-2.el9.x86_64.r 598 kB/s | 309 kB 00:00 2023-12-16T01:19:06.051 INFO:teuthology.orchestra.run.smithi157.stdout:(21/177): ceph-common-debuginfo-19.0.0-191.g6d9 3.8 MB/s | 409 MB 01:47 2023-12-16T01:19:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:(120/177): openssl-devel-3.0.7-25.el9.x86_64.rp 2.6 MB/s | 4.1 MB 00:01 2023-12-16T01:19:06.218 INFO:teuthology.orchestra.run.smithi157.stdout:(22/177): cephfs-mirror-19.0.0-191.g6d933094.el 1.3 MB/s | 217 kB 00:00 2023-12-16T01:19:06.285 INFO:teuthology.orchestra.run.smithi157.stdout:(23/177): cephfs-shell-19.0.0-191.g6d933094.el9 407 kB/s | 27 kB 00:00 2023-12-16T01:19:06.352 INFO:teuthology.orchestra.run.smithi157.stdout:(24/177): libcephfs-devel-19.0.0-191.g6d933094. 469 kB/s | 31 kB 00:00 2023-12-16T01:19:06.519 INFO:teuthology.orchestra.run.smithi157.stdout:(25/177): libcephfs2-19.0.0-191.g6d933094.el9.x 4.2 MB/s | 719 kB 00:00 2023-12-16T01:19:06.609 INFO:teuthology.orchestra.run.smithi107.stdout:(121/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 53 kB/s | 26 kB 00:00 2023-12-16T01:19:06.984 INFO:teuthology.orchestra.run.smithi107.stdout:(122/177): liboath-2.6.7-2.el9.x86_64.rpm 130 kB/s | 49 kB 00:00 2023-12-16T01:19:07.301 INFO:teuthology.orchestra.run.smithi107.stdout:(123/177): libarrow-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2023-12-16T01:19:07.310 INFO:teuthology.orchestra.run.smithi157.stdout:(26/177): libcephfs2-debuginfo-19.0.0-191.g6d93 6.5 MB/s | 5.2 MB 00:00 2023-12-16T01:19:07.326 INFO:teuthology.orchestra.run.smithi107.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 197 kB/s | 67 kB 00:00 2023-12-16T01:19:07.386 INFO:teuthology.orchestra.run.smithi157.stdout:(27/177): libcephsqlite-19.0.0-191.g6d933094.el 2.1 MB/s | 163 kB 00:00 2023-12-16T01:19:07.418 INFO:teuthology.orchestra.run.smithi107.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2023-12-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi157.stdout:(28/177): librados-devel-19.0.0-191.g6d933094.e 1.5 MB/s | 126 kB 00:00 2023-12-16T01:19:07.553 INFO:teuthology.orchestra.run.smithi157.stdout:(29/177): librados-devel-debuginfo-19.0.0-191.g 1.3 MB/s | 108 kB 00:00 2023-12-16T01:19:07.635 INFO:teuthology.orchestra.run.smithi107.stdout:(126/177): python3-asyncssh-2.13.2-3.el9.noarch 2.5 MB/s | 548 kB 00:00 2023-12-16T01:19:07.677 INFO:teuthology.orchestra.run.smithi107.stdout:(127/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2023-12-16T01:19:07.744 INFO:teuthology.orchestra.run.smithi107.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2023-12-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi107.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 351 kB/s | 32 kB 00:00 2023-12-16T01:19:07.869 INFO:teuthology.orchestra.run.smithi107.stdout:(130/177): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-12-16T01:19:07.903 INFO:teuthology.orchestra.run.smithi107.stdout:(131/177): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-12-16T01:19:08.037 INFO:teuthology.orchestra.run.smithi107.stdout:(132/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2023-12-16T01:19:08.062 INFO:teuthology.orchestra.run.smithi107.stdout:(133/177): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2023-12-16T01:19:08.128 INFO:teuthology.orchestra.run.smithi107.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2023-12-16T01:19:08.195 INFO:teuthology.orchestra.run.smithi107.stdout:(135/177): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-12-16T01:19:08.221 INFO:teuthology.orchestra.run.smithi107.stdout:(136/177): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2023-12-16T01:19:08.288 INFO:teuthology.orchestra.run.smithi107.stdout:(137/177): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2023-12-16T01:19:08.313 INFO:teuthology.orchestra.run.smithi107.stdout:(138/177): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2023-12-16T01:19:08.388 INFO:teuthology.orchestra.run.smithi107.stdout:(139/177): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-12-16T01:19:08.414 INFO:teuthology.orchestra.run.smithi107.stdout:(140/177): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2023-12-16T01:19:08.555 INFO:teuthology.orchestra.run.smithi107.stdout:(141/177): python3-jwt+crypto-2.4.0-1.el9.noarc 54 kB/s | 9.0 kB 00:00 2023-12-16T01:19:08.572 INFO:teuthology.orchestra.run.smithi107.stdout:(142/177): python3-jwt-2.4.0-1.el9.noarch.rpm 258 kB/s | 41 kB 00:00 2023-12-16T01:19:08.781 INFO:teuthology.orchestra.run.smithi107.stdout:(143/177): python3-logutils-0.3.5-21.el9.noarch 222 kB/s | 46 kB 00:00 2023-12-16T01:19:08.889 INFO:teuthology.orchestra.run.smithi107.stdout:(144/177): python3-more-itertools-8.12.0-2.el9. 728 kB/s | 79 kB 00:00 2023-12-16T01:19:08.965 INFO:teuthology.orchestra.run.smithi107.stdout:(145/177): python3-kubernetes-26.1.0-2.el9.noar 2.6 MB/s | 1.0 MB 00:00 2023-12-16T01:19:09.007 INFO:teuthology.orchestra.run.smithi107.stdout:(146/177): python3-natsort-7.1.1-5.el9.noarch.r 494 kB/s | 58 kB 00:00 2023-12-16T01:19:09.107 INFO:teuthology.orchestra.run.smithi107.stdout:(147/177): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-12-16T01:19:09.132 INFO:teuthology.orchestra.run.smithi107.stdout:(148/177): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2023-12-16T01:19:09.207 INFO:teuthology.orchestra.run.smithi107.stdout:(149/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2023-12-16T01:19:09.266 INFO:teuthology.orchestra.run.smithi107.stdout:(150/177): python3-pyperclip-1.8.2-2.el9.noarch 211 kB/s | 28 kB 00:00 2023-12-16T01:19:09.308 INFO:teuthology.orchestra.run.smithi107.stdout:(151/177): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2023-12-16T01:19:09.367 INFO:teuthology.orchestra.run.smithi107.stdout:(152/177): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-12-16T01:19:09.425 INFO:teuthology.orchestra.run.smithi107.stdout:(153/177): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2023-12-16T01:19:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:(154/177): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2023-12-16T01:19:09.534 INFO:teuthology.orchestra.run.smithi107.stdout:(155/177): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2023-12-16T01:19:09.593 INFO:teuthology.orchestra.run.smithi107.stdout:(156/177): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-12-16T01:19:09.685 INFO:teuthology.orchestra.run.smithi107.stdout:(157/177): python3-websocket-client-1.2.3-2.el9 597 kB/s | 90 kB 00:00 2023-12-16T01:19:09.727 INFO:teuthology.orchestra.run.smithi107.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2023-12-16T01:19:09.785 INFO:teuthology.orchestra.run.smithi107.stdout:(159/177): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2023-12-16T01:19:09.827 INFO:teuthology.orchestra.run.smithi107.stdout:(160/177): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-16T01:19:10.219 INFO:teuthology.orchestra.run.smithi107.stdout:(161/177): thrift-0.15.0-2.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2023-12-16T01:19:10.703 INFO:teuthology.orchestra.run.smithi157.stdout:(30/177): ceph-osd-debuginfo-19.0.0-191.g6d9330 3.8 MB/s | 312 MB 01:21 2023-12-16T01:19:10.861 INFO:teuthology.orchestra.run.smithi107.stdout:(162/177): librados2-19.0.0-191.g6d933094.el9.x 3.2 MB/s | 3.3 MB 00:01 2023-12-16T01:19:10.894 INFO:teuthology.orchestra.run.smithi107.stdout:(163/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-16T01:19:10.928 INFO:teuthology.orchestra.run.smithi107.stdout:(164/177): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-16T01:19:10.962 INFO:teuthology.orchestra.run.smithi107.stdout:(165/177): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-16T01:19:10.995 INFO:teuthology.orchestra.run.smithi107.stdout:(166/177): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-12-16T01:19:11.029 INFO:teuthology.orchestra.run.smithi107.stdout:(167/177): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-12-16T01:19:11.054 INFO:teuthology.orchestra.run.smithi107.stdout:(168/177): libacl-2.3.1-4.el9.x86_64.rpm 886 kB/s | 22 kB 00:00 2023-12-16T01:19:11.096 INFO:teuthology.orchestra.run.smithi107.stdout:(169/177): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2023-12-16T01:19:11.380 INFO:teuthology.orchestra.run.smithi107.stdout:(170/177): NetworkManager-1.45.7-1.el9.x86_64.r 8.0 MB/s | 2.3 MB 00:00 2023-12-16T01:19:11.488 INFO:teuthology.orchestra.run.smithi107.stdout:(171/177): NetworkManager-libnm-1.45.7-1.el9.x8 16 MB/s | 1.8 MB 00:00 2023-12-16T01:19:11.512 INFO:teuthology.orchestra.run.smithi157.stdout:(31/177): libradosstriper1-19.0.0-191.g6d933094 589 kB/s | 476 kB 00:00 2023-12-16T01:19:11.530 INFO:teuthology.orchestra.run.smithi107.stdout:(172/177): NetworkManager-team-1.45.7-1.el9.x86 1.0 MB/s | 43 kB 00:00 2023-12-16T01:19:11.589 INFO:teuthology.orchestra.run.smithi107.stdout:(173/177): librbd1-19.0.0-191.g6d933094.el9.x86 2.2 MB/s | 3.0 MB 00:01 2023-12-16T01:19:11.639 INFO:teuthology.orchestra.run.smithi107.stdout:(174/177): NetworkManager-tui-1.45.7-1.el9.x86_ 2.2 MB/s | 246 kB 00:00 2023-12-16T01:19:11.723 INFO:teuthology.orchestra.run.smithi107.stdout:(175/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 26 MB/s | 2.2 MB 00:00 2023-12-16T01:19:11.815 INFO:teuthology.orchestra.run.smithi107.stdout:(176/177): openssl-3.0.7-25.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2023-12-16T01:19:16.545 INFO:teuthology.orchestra.run.smithi157.stdout:(32/177): librados2-debuginfo-19.0.0-191.g6d933 4.8 MB/s | 44 MB 00:08 2023-12-16T01:19:17.644 INFO:teuthology.orchestra.run.smithi157.stdout:(33/177): librgw2-19.0.0-191.g6d933094.el9.x86_ 4.3 MB/s | 4.8 MB 00:01 2023-12-16T01:19:17.736 INFO:teuthology.orchestra.run.smithi157.stdout:(34/177): python3-ceph-argparse-19.0.0-191.g6d9 494 kB/s | 45 kB 00:00 2023-12-16T01:19:17.828 INFO:teuthology.orchestra.run.smithi157.stdout:(35/177): python3-ceph-common-19.0.0-191.g6d933 1.4 MB/s | 130 kB 00:00 2023-12-16T01:19:17.920 INFO:teuthology.orchestra.run.smithi157.stdout:(36/177): python3-cephfs-19.0.0-191.g6d933094.e 1.7 MB/s | 161 kB 00:00 2023-12-16T01:19:18.095 INFO:teuthology.orchestra.run.smithi157.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-191.g 3.4 MB/s | 614 kB 00:00 2023-12-16T01:19:18.196 INFO:teuthology.orchestra.run.smithi157.stdout:(38/177): python3-rados-19.0.0-191.g6d933094.el 3.1 MB/s | 321 kB 00:00 2023-12-16T01:19:18.329 INFO:teuthology.orchestra.run.smithi157.stdout:(39/177): python3-rados-debuginfo-19.0.0-191.g6 5.6 MB/s | 769 kB 00:00 2023-12-16T01:19:18.388 INFO:teuthology.orchestra.run.smithi157.stdout:(40/177): python3-rbd-19.0.0-191.g6d933094.el9. 5.0 MB/s | 298 kB 00:00 2023-12-16T01:19:18.522 INFO:teuthology.orchestra.run.smithi157.stdout:(41/177): python3-rbd-debuginfo-19.0.0-191.g6d9 8.5 MB/s | 1.1 MB 00:00 2023-12-16T01:19:18.622 INFO:teuthology.orchestra.run.smithi157.stdout:(42/177): python3-rgw-19.0.0-191.g6d933094.el9. 995 kB/s | 99 kB 00:00 2023-12-16T01:19:18.722 INFO:teuthology.orchestra.run.smithi157.stdout:(43/177): python3-rgw-debuginfo-19.0.0-191.g6d9 3.3 MB/s | 337 kB 00:00 2023-12-16T01:19:18.800 INFO:teuthology.orchestra.run.smithi157.stdout:(44/177): rbd-fuse-19.0.0-191.g6d933094.el9.x86 1.1 MB/s | 85 kB 00:00 2023-12-16T01:19:18.976 INFO:teuthology.orchestra.run.smithi157.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-191.g6d9330 2.8 MB/s | 506 kB 00:00 2023-12-16T01:19:19.575 INFO:teuthology.orchestra.run.smithi157.stdout:(46/177): rbd-mirror-19.0.0-191.g6d933094.el9.x 5.0 MB/s | 3.0 MB 00:00 2023-12-16T01:19:30.641 INFO:teuthology.orchestra.run.smithi157.stdout:(47/177): rbd-mirror-debuginfo-19.0.0-191.g6d93 4.6 MB/s | 50 MB 00:11 2023-12-16T01:19:30.741 INFO:teuthology.orchestra.run.smithi157.stdout:(48/177): rbd-nbd-19.0.0-191.g6d933094.el9.x86_ 1.7 MB/s | 170 kB 00:00 2023-12-16T01:19:31.083 INFO:teuthology.orchestra.run.smithi157.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-191.g6d93309 3.6 MB/s | 1.2 MB 00:00 2023-12-16T01:19:31.175 INFO:teuthology.orchestra.run.smithi157.stdout:(50/177): ceph-grafana-dashboards-19.0.0-191.g6 308 kB/s | 28 kB 00:00 2023-12-16T01:19:31.267 INFO:teuthology.orchestra.run.smithi157.stdout:(51/177): ceph-mgr-cephadm-19.0.0-191.g6d933094 1.4 MB/s | 133 kB 00:00 2023-12-16T01:19:31.834 INFO:teuthology.orchestra.run.smithi157.stdout:(52/177): ceph-mgr-dashboard-19.0.0-191.g6d9330 3.1 MB/s | 1.8 MB 00:00 2023-12-16T01:19:34.067 INFO:teuthology.orchestra.run.smithi157.stdout:(53/177): ceph-mgr-diskprediction-local-19.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-12-16T01:19:34.509 INFO:teuthology.orchestra.run.smithi157.stdout:(54/177): librbd1-debuginfo-19.0.0-191.g6d93309 2.2 MB/s | 50 MB 00:22 2023-12-16T01:19:34.534 INFO:teuthology.orchestra.run.smithi157.stdout:(55/177): ceph-mgr-modules-core-19.0.0-191.g6d9 521 kB/s | 243 kB 00:00 2023-12-16T01:19:34.568 INFO:teuthology.orchestra.run.smithi157.stdout:(56/177): ceph-mgr-rook-19.0.0-191.g6d933094.el 862 kB/s | 50 kB 00:00 2023-12-16T01:19:34.593 INFO:teuthology.orchestra.run.smithi157.stdout:(57/177): ceph-prometheus-alerts-19.0.0-191.g6d 259 kB/s | 15 kB 00:00 2023-12-16T01:19:34.652 INFO:teuthology.orchestra.run.smithi157.stdout:(58/177): ceph-volume-19.0.0-191.g6d933094.el9. 3.1 MB/s | 262 kB 00:00 2023-12-16T01:19:34.710 INFO:teuthology.orchestra.run.smithi157.stdout:(59/177): cephfs-top-19.0.0-191.g6d933094.el9.n 313 kB/s | 18 kB 00:00 2023-12-16T01:19:35.011 INFO:teuthology.orchestra.run.smithi157.stdout:(60/177): cephadm-19.0.0-191.g6d933094.el9.noar 1.9 MB/s | 808 kB 00:00 2023-12-16T01:19:35.253 INFO:teuthology.orchestra.run.smithi157.stdout:(61/177): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 662 kB 00:00 2023-12-16T01:19:35.520 INFO:teuthology.orchestra.run.smithi157.stdout:(62/177): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 920 kB 00:00 2023-12-16T01:19:35.836 INFO:teuthology.orchestra.run.smithi157.stdout:(63/177): boost-program-options-1.75.0-8.el9.x8 182 kB/s | 106 kB 00:00 2023-12-16T01:19:35.979 INFO:teuthology.orchestra.run.smithi157.stdout:(64/177): elfutils-libelf-devel-0.190-1.el9.x86 47 kB/s | 21 kB 00:00 2023-12-16T01:19:36.004 INFO:teuthology.orchestra.run.smithi157.stdout:(65/177): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 307 kB 00:00 2023-12-16T01:19:36.029 INFO:teuthology.orchestra.run.smithi157.stdout:(66/177): flexiblas-3.0.4-8.el9.x86_64.rpm 640 kB/s | 32 kB 00:00 2023-12-16T01:19:36.088 INFO:teuthology.orchestra.run.smithi157.stdout:(67/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2023-12-16T01:19:36.115 INFO:teuthology.orchestra.run.smithi157.stdout:(68/177): flexiblas-openblas-openmp-3.0.4-8.el9 207 kB/s | 17 kB 00:00 2023-12-16T01:19:36.140 INFO:teuthology.orchestra.run.smithi157.stdout:(69/177): jq-1.6-16.el9.x86_64.rpm 3.5 MB/s | 186 kB 00:00 2023-12-16T01:19:36.166 INFO:teuthology.orchestra.run.smithi157.stdout:(70/177): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2023-12-16T01:19:36.191 INFO:teuthology.orchestra.run.smithi157.stdout:(71/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-16T01:19:36.216 INFO:teuthology.orchestra.run.smithi157.stdout:(72/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 889 kB/s | 44 kB 00:00 2023-12-16T01:19:36.241 INFO:teuthology.orchestra.run.smithi157.stdout:(73/177): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-16T01:19:36.275 INFO:teuthology.orchestra.run.smithi157.stdout:(74/177): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-12-16T01:19:36.300 INFO:teuthology.orchestra.run.smithi157.stdout:(75/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 425 kB/s | 24 kB 00:00 2023-12-16T01:19:36.326 INFO:teuthology.orchestra.run.smithi157.stdout:(76/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 927 kB/s | 46 kB 00:00 2023-12-16T01:19:36.351 INFO:teuthology.orchestra.run.smithi157.stdout:(77/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-16T01:19:36.377 INFO:teuthology.orchestra.run.smithi157.stdout:(78/177): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-16T01:19:36.402 INFO:teuthology.orchestra.run.smithi157.stdout:(79/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-12-16T01:19:36.427 INFO:teuthology.orchestra.run.smithi157.stdout:(80/177): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2023-12-16T01:19:36.511 INFO:teuthology.orchestra.run.smithi157.stdout:(81/177): openblas-openmp-0.3.21-2.el9.x86_64.r 44 MB/s | 4.7 MB 00:00 2023-12-16T01:19:36.544 INFO:teuthology.orchestra.run.smithi157.stdout:(82/177): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2023-12-16T01:19:36.578 INFO:teuthology.orchestra.run.smithi157.stdout:(83/177): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-12-16T01:19:36.603 INFO:teuthology.orchestra.run.smithi157.stdout:(84/177): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-16T01:19:36.687 INFO:teuthology.orchestra.run.smithi157.stdout:(85/177): postgresql-server-13.11-1.el9.x86_64. 52 MB/s | 5.7 MB 00:00 2023-12-16T01:19:36.720 INFO:teuthology.orchestra.run.smithi157.stdout:(86/177): python3-attrs-20.3.0-7.el9.noarch.rpm 683 kB/s | 78 kB 00:00 2023-12-16T01:19:36.754 INFO:teuthology.orchestra.run.smithi157.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 6.8 MB/s | 228 kB 00:00 2023-12-16T01:19:36.846 INFO:teuthology.orchestra.run.smithi157.stdout:(88/177): python3-babel-2.9.1-2.el9.noarch.rpm 46 MB/s | 5.8 MB 00:00 2023-12-16T01:19:36.862 INFO:teuthology.orchestra.run.smithi157.stdout:(89/177): python3-jsonpatch-1.21-16.el9.noarch. 231 kB/s | 24 kB 00:00 2023-12-16T01:19:36.887 INFO:teuthology.orchestra.run.smithi157.stdout:(90/177): python3-jsonpointer-2.0-4.el9.noarch. 739 kB/s | 18 kB 00:00 2023-12-16T01:19:36.913 INFO:teuthology.orchestra.run.smithi157.stdout:(91/177): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-16T01:19:36.938 INFO:teuthology.orchestra.run.smithi157.stdout:(92/177): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-12-16T01:19:37.013 INFO:teuthology.orchestra.run.smithi157.stdout:(93/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 48 MB/s | 4.8 MB 00:00 2023-12-16T01:19:37.039 INFO:teuthology.orchestra.run.smithi157.stdout:(94/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 217 kB 00:00 2023-12-16T01:19:37.064 INFO:teuthology.orchestra.run.smithi157.stdout:(95/177): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-16T01:19:37.089 INFO:teuthology.orchestra.run.smithi157.stdout:(96/177): python3-prettytable-0.7.2-27.el9.noar 827 kB/s | 41 kB 00:00 2023-12-16T01:19:37.114 INFO:teuthology.orchestra.run.smithi157.stdout:(97/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-16T01:19:37.140 INFO:teuthology.orchestra.run.smithi157.stdout:(98/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-16T01:19:37.174 INFO:teuthology.orchestra.run.smithi157.stdout:(99/177): python3-pytz-2021.1-5.el9.noarch.rpm 809 kB/s | 47 kB 00:00 2023-12-16T01:19:37.199 INFO:teuthology.orchestra.run.smithi157.stdout:(100/177): python3-requests-oauthlib-1.3.0-12.e 732 kB/s | 43 kB 00:00 2023-12-16T01:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:(101/177): python3-toml-0.10.2-6.el9.noarch.rpm 695 kB/s | 39 kB 00:00 2023-12-16T01:19:37.416 INFO:teuthology.orchestra.run.smithi157.stdout:(102/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-16T01:19:37.441 INFO:teuthology.orchestra.run.smithi157.stdout:(103/177): python3-wcwidth-0.2.5-8.el9.noarch.r 227 kB/s | 41 kB 00:00 2023-12-16T01:19:37.467 INFO:teuthology.orchestra.run.smithi157.stdout:(104/177): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-12-16T01:19:37.492 INFO:teuthology.orchestra.run.smithi157.stdout:(105/177): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-16T01:19:37.517 INFO:teuthology.orchestra.run.smithi157.stdout:(106/177): xfsprogs-devel-5.19.0-4.el9.x86_64.r 1.7 MB/s | 85 kB 00:00 2023-12-16T01:19:37.543 INFO:teuthology.orchestra.run.smithi157.stdout:(107/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-16T01:19:37.568 INFO:teuthology.orchestra.run.smithi157.stdout:(108/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2023-12-16T01:19:37.593 INFO:teuthology.orchestra.run.smithi157.stdout:(109/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-16T01:19:37.619 INFO:teuthology.orchestra.run.smithi157.stdout:(110/177): libgfortran-11.4.1-2.3.el9.x86_64.rp 16 MB/s | 803 kB 00:00 2023-12-16T01:19:37.644 INFO:teuthology.orchestra.run.smithi157.stdout:(111/177): libquadmath-11.4.1-2.3.el9.x86_64.rp 3.9 MB/s | 195 kB 00:00 2023-12-16T01:19:37.669 INFO:teuthology.orchestra.run.smithi157.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-16T01:19:37.711 INFO:teuthology.orchestra.run.smithi157.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2023-12-16T01:19:37.736 INFO:teuthology.orchestra.run.smithi157.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-16T01:19:37.761 INFO:teuthology.orchestra.run.smithi157.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2023-12-16T01:19:37.787 INFO:teuthology.orchestra.run.smithi157.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-12-16T01:19:37.812 INFO:teuthology.orchestra.run.smithi157.stdout:(117/177): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-12-16T01:19:37.946 INFO:teuthology.orchestra.run.smithi157.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 1.8 MB/s | 245 kB 00:00 2023-12-16T01:19:38.071 INFO:teuthology.orchestra.run.smithi157.stdout:(119/177): openssl-devel-3.0.7-25.el9.x86_64.rp 15 MB/s | 4.1 MB 00:00 2023-12-16T01:19:38.229 INFO:teuthology.orchestra.run.smithi157.stdout:(120/177): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2023-12-16T01:19:38.280 INFO:teuthology.orchestra.run.smithi157.stdout:(121/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 523 kB/s | 26 kB 00:00 2023-12-16T01:19:38.372 INFO:teuthology.orchestra.run.smithi157.stdout:(122/177): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2023-12-16T01:19:38.397 INFO:teuthology.orchestra.run.smithi157.stdout:(123/177): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2023-12-16T01:19:38.422 INFO:teuthology.orchestra.run.smithi157.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-16T01:19:38.473 INFO:teuthology.orchestra.run.smithi157.stdout:(125/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2023-12-16T01:19:38.506 INFO:teuthology.orchestra.run.smithi157.stdout:(126/177): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2023-12-16T01:19:38.540 INFO:teuthology.orchestra.run.smithi157.stdout:(127/177): python3-asyncssh-2.13.2-3.el9.noarch 8.0 MB/s | 548 kB 00:00 2023-12-16T01:19:38.565 INFO:teuthology.orchestra.run.smithi157.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 739 kB/s | 43 kB 00:00 2023-12-16T01:19:38.591 INFO:teuthology.orchestra.run.smithi157.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2023-12-16T01:19:38.616 INFO:teuthology.orchestra.run.smithi157.stdout:(130/177): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2023-12-16T01:19:38.666 INFO:teuthology.orchestra.run.smithi157.stdout:(131/177): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2023-12-16T01:19:38.684 INFO:teuthology.orchestra.run.smithi107.stdout:(177/177): ceph-test-debuginfo-19.0.0-191.g6d93 9.6 MB/s | 622 MB 01:04 2023-12-16T01:19:38.689 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2023-12-16T01:19:38.689 INFO:teuthology.orchestra.run.smithi107.stdout:Total 15 MB/s | 2.1 GB 02:24 2023-12-16T01:19:38.699 INFO:teuthology.orchestra.run.smithi157.stdout:(132/177): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-12-16T01:19:38.733 INFO:teuthology.orchestra.run.smithi157.stdout:(133/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2023-12-16T01:19:38.758 INFO:teuthology.orchestra.run.smithi157.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2023-12-16T01:19:38.784 INFO:teuthology.orchestra.run.smithi157.stdout:(135/177): python3-google-auth-2.23.4-1.el9.noa 3.9 MB/s | 197 kB 00:00 2023-12-16T01:19:38.809 INFO:teuthology.orchestra.run.smithi157.stdout:(136/177): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2023-12-16T01:19:38.826 INFO:teuthology.orchestra.run.smithi157.stdout:(137/177): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2023-12-16T01:19:38.843 INFO:teuthology.orchestra.run.smithi157.stdout:(138/177): python3-jaraco-collections-3.0.0-8.e 694 kB/s | 23 kB 00:00 2023-12-16T01:19:38.852 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2023-12-16T01:19:38.868 INFO:teuthology.orchestra.run.smithi157.stdout:(139/177): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2023-12-16T01:19:38.885 INFO:teuthology.orchestra.run.smithi157.stdout:(140/177): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2023-12-16T01:19:38.902 INFO:teuthology.orchestra.run.smithi157.stdout:(141/177): python3-jwt+crypto-2.4.0-1.el9.noarc 271 kB/s | 9.0 kB 00:00 2023-12-16T01:19:38.919 INFO:teuthology.orchestra.run.smithi157.stdout:(142/177): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2023-12-16T01:19:38.953 INFO:teuthology.orchestra.run.smithi157.stdout:(143/177): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2023-12-16T01:19:38.995 INFO:teuthology.orchestra.run.smithi157.stdout:(144/177): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2023-12-16T01:19:39.036 INFO:teuthology.orchestra.run.smithi157.stdout:(145/177): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2023-12-16T01:19:39.043 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2023-12-16T01:19:39.044 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2023-12-16T01:19:39.079 INFO:teuthology.orchestra.run.smithi157.stdout:(146/177): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2023-12-16T01:19:39.121 INFO:teuthology.orchestra.run.smithi157.stdout:(147/177): python3-portend-3.1.0-2.el9.noarch.r 395 kB/s | 16 kB 00:00 2023-12-16T01:19:39.188 INFO:teuthology.orchestra.run.smithi157.stdout:(148/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-12-16T01:19:39.229 INFO:teuthology.orchestra.run.smithi157.stdout:(149/177): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2023-12-16T01:19:39.255 INFO:teuthology.orchestra.run.smithi157.stdout:(150/177): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2023-12-16T01:19:39.281 INFO:teuthology.orchestra.run.smithi157.stdout:(151/177): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2023-12-16T01:19:39.305 INFO:teuthology.orchestra.run.smithi157.stdout:(152/177): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2023-12-16T01:19:39.339 INFO:teuthology.orchestra.run.smithi157.stdout:(153/177): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-16T01:19:39.364 INFO:teuthology.orchestra.run.smithi157.stdout:(154/177): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2023-12-16T01:19:39.390 INFO:teuthology.orchestra.run.smithi157.stdout:(155/177): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-16T01:19:39.415 INFO:teuthology.orchestra.run.smithi157.stdout:(156/177): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-12-16T01:19:39.448 INFO:teuthology.orchestra.run.smithi157.stdout:(157/177): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-12-16T01:19:39.474 INFO:teuthology.orchestra.run.smithi157.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2023-12-16T01:19:39.499 INFO:teuthology.orchestra.run.smithi157.stdout:(159/177): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2023-12-16T01:19:39.524 INFO:teuthology.orchestra.run.smithi157.stdout:(160/177): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-12-16T01:19:39.733 INFO:teuthology.orchestra.run.smithi157.stdout:(161/177): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2023-12-16T01:19:40.075 INFO:teuthology.orchestra.run.smithi157.stdout:(162/177): librados2-19.0.0-191.g6d933094.el9.x 6.0 MB/s | 3.3 MB 00:00 2023-12-16T01:19:40.108 INFO:teuthology.orchestra.run.smithi157.stdout:(163/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-16T01:19:40.142 INFO:teuthology.orchestra.run.smithi157.stdout:(164/177): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-16T01:19:40.176 INFO:teuthology.orchestra.run.smithi157.stdout:(165/177): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-16T01:19:40.209 INFO:teuthology.orchestra.run.smithi157.stdout:(166/177): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-12-16T01:19:40.243 INFO:teuthology.orchestra.run.smithi157.stdout:(167/177): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-12-16T01:19:40.278 INFO:teuthology.orchestra.run.smithi157.stdout:(168/177): libacl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 22 kB 00:00 2023-12-16T01:19:40.310 INFO:teuthology.orchestra.run.smithi157.stdout:(169/177): xfsdump-3.1.12-4.el9.x86_64.rpm 9.5 MB/s | 321 kB 00:00 2023-12-16T01:19:40.369 INFO:teuthology.orchestra.run.smithi157.stdout:(170/177): librbd1-19.0.0-191.g6d933094.el9.x86 4.8 MB/s | 3.0 MB 00:00 2023-12-16T01:19:41.144 INFO:teuthology.orchestra.run.smithi157.stdout:(171/177): NetworkManager-1.45.7-1.el9.x86_64.r 2.7 MB/s | 2.3 MB 00:00 2023-12-16T01:19:41.186 INFO:teuthology.orchestra.run.smithi157.stdout:(172/177): NetworkManager-libnm-1.45.7-1.el9.x8 2.2 MB/s | 1.8 MB 00:00 2023-12-16T01:19:41.244 INFO:teuthology.orchestra.run.smithi157.stdout:(173/177): NetworkManager-team-1.45.7-1.el9.x86 432 kB/s | 43 kB 00:00 2023-12-16T01:19:41.295 INFO:teuthology.orchestra.run.smithi157.stdout:(174/177): NetworkManager-tui-1.45.7-1.el9.x86_ 2.2 MB/s | 246 kB 00:00 2023-12-16T01:19:41.395 INFO:teuthology.orchestra.run.smithi157.stdout:(175/177): openssl-3.0.7-25.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2023-12-16T01:19:41.504 INFO:teuthology.orchestra.run.smithi157.stdout:(176/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2023-12-16T01:19:45.987 INFO:teuthology.orchestra.run.smithi157.stdout:(177/177): ceph-test-debuginfo-19.0.0-191.g6d93 8.2 MB/s | 622 MB 01:16 2023-12-16T01:19:45.992 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-12-16T01:19:45.992 INFO:teuthology.orchestra.run.smithi157.stdout:Total 14 MB/s | 2.1 GB 02:30 2023-12-16T01:19:46.156 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-12-16T01:19:46.348 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-12-16T01:19:46.348 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-12-16T01:19:52.326 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2023-12-16T01:19:52.326 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2023-12-16T01:19:59.657 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-12-16T01:19:59.657 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-12-16T01:20:12.533 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2023-12-16T01:20:12.683 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 1/192 2023-12-16T01:20:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/192 2023-12-16T01:20:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/192 2023-12-16T01:20:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/192 2023-12-16T01:20:12.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/192 2023-12-16T01:20:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/192 2023-12-16T01:20:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/192 2023-12-16T01:20:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/192 2023-12-16T01:20:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-191.g6d933094.el9.x86_64 9/192 2023-12-16T01:20:13.463 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-191.g6d933094.el9.x86_64 9/192 2023-12-16T01:20:13.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 10/192 2023-12-16T01:20:13.578 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 10/192 2023-12-16T01:20:13.614 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-191.g6d933094.el9.x86_64 11/192 2023-12-16T01:20:13.674 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/192 2023-12-16T01:20:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/192 2023-12-16T01:20:13.896 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/192 2023-12-16T01:20:13.924 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 15/192 2023-12-16T01:20:14.009 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 15/192 2023-12-16T01:20:14.033 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_ 16/192 2023-12-16T01:20:14.221 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_ 16/192 2023-12-16T01:20:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T01:20:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T01:20:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T01:20:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T01:20:14.741 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T01:20:14.832 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/192 2023-12-16T01:20:14.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/192 2023-12-16T01:20:14.939 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/192 2023-12-16T01:20:14.991 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/192 2023-12-16T01:20:15.022 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/192 2023-12-16T01:20:15.058 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/192 2023-12-16T01:20:15.100 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/192 2023-12-16T01:20:15.163 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/192 2023-12-16T01:20:15.199 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/192 2023-12-16T01:20:15.227 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/192 2023-12-16T01:20:15.296 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/192 2023-12-16T01:20:15.332 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-191.g6d933094.el9.x 30/192 2023-12-16T01:20:15.375 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-191.g6d933094.el9 31/192 2023-12-16T01:20:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-191.g6d933094.el9.x86_64 32/192 2023-12-16T01:20:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/192 2023-12-16T01:20:15.627 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/192 2023-12-16T01:20:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/192 2023-12-16T01:20:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/192 2023-12-16T01:20:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/192 2023-12-16T01:20:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/192 2023-12-16T01:20:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-191.g6d933094.el9.x86_64 39/192 2023-12-16T01:20:16.400 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/192 2023-12-16T01:20:16.540 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/192 2023-12-16T01:20:16.592 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/192 2023-12-16T01:20:16.698 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/192 2023-12-16T01:20:16.728 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/192 2023-12-16T01:20:16.784 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/192 2023-12-16T01:20:16.857 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/192 2023-12-16T01:20:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/192 2023-12-16T01:20:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/192 2023-12-16T01:20:16.986 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/192 2023-12-16T01:20:17.021 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/192 2023-12-16T01:20:17.064 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/192 2023-12-16T01:20:17.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/192 2023-12-16T01:20:17.242 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/192 2023-12-16T01:20:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/192 2023-12-16T01:20:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/192 2023-12-16T01:20:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/192 2023-12-16T01:20:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/192 2023-12-16T01:20:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/192 2023-12-16T01:20:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/192 2023-12-16T01:20:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/192 2023-12-16T01:20:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/192 2023-12-16T01:20:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/192 2023-12-16T01:20:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/192 2023-12-16T01:20:17.807 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/192 2023-12-16T01:20:18.005 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/192 2023-12-16T01:20:18.049 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/192 2023-12-16T01:20:18.179 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/192 2023-12-16T01:20:18.218 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/192 2023-12-16T01:20:18.248 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/192 2023-12-16T01:20:18.281 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/192 2023-12-16T01:20:18.314 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/192 2023-12-16T01:20:18.345 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/192 2023-12-16T01:20:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/192 2023-12-16T01:20:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/192 2023-12-16T01:20:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/192 2023-12-16T01:20:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/192 2023-12-16T01:20:18.517 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/192 2023-12-16T01:20:18.594 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/192 2023-12-16T01:20:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/192 2023-12-16T01:20:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/192 2023-12-16T01:20:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/192 2023-12-16T01:20:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/192 2023-12-16T01:20:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/192 2023-12-16T01:20:18.847 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/192 2023-12-16T01:20:18.950 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/192 2023-12-16T01:20:19.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/192 2023-12-16T01:20:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/192 2023-12-16T01:20:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/192 2023-12-16T01:20:19.829 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/192 2023-12-16T01:20:19.869 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-12-16T01:20:19.877 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T01:20:19.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/192 2023-12-16T01:20:20.005 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/192 2023-12-16T01:20:20.061 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 1/192 2023-12-16T01:20:20.146 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/192 2023-12-16T01:20:20.179 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/192 2023-12-16T01:20:20.181 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/192 2023-12-16T01:20:20.211 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/192 2023-12-16T01:20:20.223 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/192 2023-12-16T01:20:20.262 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/192 2023-12-16T01:20:20.287 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/192 2023-12-16T01:20:20.289 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/192 2023-12-16T01:20:20.338 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/192 2023-12-16T01:20:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/192 2023-12-16T01:20:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:19.0.0-191.g6d933094.el9.x86_64 9/192 2023-12-16T01:20:20.841 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:19.0.0-191.g6d933094.el9.x86_64 9/192 2023-12-16T01:20:20.864 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 10/192 2023-12-16T01:20:20.940 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 10/192 2023-12-16T01:20:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/192 2023-12-16T01:20:20.971 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:19.0.0-191.g6d933094.el9.x86_64 11/192 2023-12-16T01:20:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/192 2023-12-16T01:20:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/192 2023-12-16T01:20:21.195 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/192 2023-12-16T01:20:21.242 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/192 2023-12-16T01:20:21.299 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 15/192 2023-12-16T01:20:21.405 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 15/192 2023-12-16T01:20:21.429 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_ 16/192 2023-12-16T01:20:21.626 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_ 16/192 2023-12-16T01:20:21.758 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T01:20:21.801 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T01:20:21.980 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T01:20:22.186 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T01:20:22.322 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/192 2023-12-16T01:20:22.404 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T01:20:22.421 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/192 2023-12-16T01:20:22.453 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/192 2023-12-16T01:20:22.490 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jq-1.6-16.el9.x86_64 101/192 2023-12-16T01:20:22.503 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/192 2023-12-16T01:20:22.540 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/192 2023-12-16T01:20:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 102/192 2023-12-16T01:20:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 103/192 2023-12-16T01:20:22.610 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/192 2023-12-16T01:20:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/192 2023-12-16T01:20:22.656 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/192 2023-12-16T01:20:22.662 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/192 2023-12-16T01:20:22.694 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/192 2023-12-16T01:20:22.744 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/192 2023-12-16T01:20:22.786 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/192 2023-12-16T01:20:22.850 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/192 2023-12-16T01:20:22.885 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/192 2023-12-16T01:20:22.912 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/192 2023-12-16T01:20:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/192 2023-12-16T01:20:22.982 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/192 2023-12-16T01:20:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-191.g6d933094.el9.x86_64 107/192 2023-12-16T01:20:23.017 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:19.0.0-191.g6d933094.el9.x 30/192 2023-12-16T01:20:23.061 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:19.0.0-191.g6d933094.el9 31/192 2023-12-16T01:20:23.067 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-191.g6d933094.el9.x86_64 107/192 2023-12-16T01:20:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-191.g6d933094.el9.x86_64 108/192 2023-12-16T01:20:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/192 2023-12-16T01:20:23.135 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:19.0.0-191.g6d933094.el9.x86_64 32/192 2023-12-16T01:20:23.278 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/192 2023-12-16T01:20:23.339 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/192 2023-12-16T01:20:23.554 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/192 2023-12-16T01:20:23.581 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-191.g6d933094.el9.x86_64 111/192 2023-12-16T01:20:23.651 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-191.g6d933094.el9.x86_64 111/192 2023-12-16T01:20:23.674 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-191.g6d933094.el9.x86_64 112/192 2023-12-16T01:20:23.874 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/192 2023-12-16T01:20:23.950 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/192 2023-12-16T01:20:23.991 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/192 2023-12-16T01:20:24.038 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/192 2023-12-16T01:20:24.076 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:19.0.0-191.g6d933094.el9.x86_64 39/192 2023-12-16T01:20:24.119 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/192 2023-12-16T01:20:24.270 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/192 2023-12-16T01:20:24.310 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/192 2023-12-16T01:20:24.418 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/192 2023-12-16T01:20:24.455 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/192 2023-12-16T01:20:24.526 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/192 2023-12-16T01:20:24.609 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/192 2023-12-16T01:20:24.639 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/192 2023-12-16T01:20:24.684 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/192 2023-12-16T01:20:24.730 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/192 2023-12-16T01:20:24.767 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/192 2023-12-16T01:20:24.810 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/192 2023-12-16T01:20:24.853 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/192 2023-12-16T01:20:24.988 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/192 2023-12-16T01:20:25.041 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/192 2023-12-16T01:20:25.071 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/192 2023-12-16T01:20:25.112 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/192 2023-12-16T01:20:25.207 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/192 2023-12-16T01:20:25.247 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/192 2023-12-16T01:20:25.288 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/192 2023-12-16T01:20:25.328 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/192 2023-12-16T01:20:25.425 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/192 2023-12-16T01:20:25.465 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/192 2023-12-16T01:20:25.531 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/192 2023-12-16T01:20:25.592 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/192 2023-12-16T01:20:25.756 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 113/192 2023-12-16T01:20:25.784 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/192 2023-12-16T01:20:25.795 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 113/192 2023-12-16T01:20:25.827 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/192 2023-12-16T01:20:25.957 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/192 2023-12-16T01:20:26.005 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/192 2023-12-16T01:20:26.034 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/192 2023-12-16T01:20:26.067 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/192 2023-12-16T01:20:26.105 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/192 2023-12-16T01:20:26.139 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/192 2023-12-16T01:20:26.167 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/192 2023-12-16T01:20:26.210 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/192 2023-12-16T01:20:26.249 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/192 2023-12-16T01:20:26.281 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/192 2023-12-16T01:20:26.318 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/192 2023-12-16T01:20:26.333 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 113/192 2023-12-16T01:20:26.383 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 114/192 2023-12-16T01:20:26.396 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/192 2023-12-16T01:20:26.429 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/192 2023-12-16T01:20:26.462 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/192 2023-12-16T01:20:26.472 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 114/192 2023-12-16T01:20:26.472 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T01:20:26.472 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T01:20:26.472 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:26.503 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/192 2023-12-16T01:20:26.509 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 115/192 2023-12-16T01:20:26.538 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/192 2023-12-16T01:20:26.628 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/192 2023-12-16T01:20:26.666 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/192 2023-12-16T01:20:26.769 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/192 2023-12-16T01:20:26.834 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/192 2023-12-16T01:20:27.579 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/192 2023-12-16T01:20:27.622 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/192 2023-12-16T01:20:27.656 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/192 2023-12-16T01:20:27.737 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T01:20:27.826 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/192 2023-12-16T01:20:27.874 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/192 2023-12-16T01:20:28.054 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/192 2023-12-16T01:20:28.088 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/192 2023-12-16T01:20:28.167 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/192 2023-12-16T01:20:28.842 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/192 2023-12-16T01:20:28.952 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/192 2023-12-16T01:20:30.212 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/192 2023-12-16T01:20:30.297 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/192 2023-12-16T01:20:30.338 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/192 2023-12-16T01:20:30.382 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-16.el9.x86_64 101/192 2023-12-16T01:20:30.455 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-5.4.4-4.el9.x86_64 102/192 2023-12-16T01:20:30.486 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : luarocks-3.9.2-1.el9.noarch 103/192 2023-12-16T01:20:30.514 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/192 2023-12-16T01:20:30.547 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/192 2023-12-16T01:20:30.850 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/192 2023-12-16T01:20:30.905 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:19.0.0-191.g6d933094.el9.x86_64 107/192 2023-12-16T01:20:31.002 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:19.0.0-191.g6d933094.el9.x86_64 107/192 2023-12-16T01:20:31.032 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:19.0.0-191.g6d933094.el9.x86_64 108/192 2023-12-16T01:20:31.068 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/192 2023-12-16T01:20:31.499 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/192 2023-12-16T01:20:31.530 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:19.0.0-191.g6d933094.el9.x86_64 111/192 2023-12-16T01:20:31.601 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:19.0.0-191.g6d933094.el9.x86_64 111/192 2023-12-16T01:20:31.624 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:19.0.0-191.g6d933094.el9.x86_64 112/192 2023-12-16T01:20:33.682 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 113/192 2023-12-16T01:20:33.728 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 113/192 2023-12-16T01:20:34.271 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 113/192 2023-12-16T01:20:34.306 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 114/192 2023-12-16T01:20:34.377 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 114/192 2023-12-16T01:20:34.377 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T01:20:34.377 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T01:20:34.377 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:34.417 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 115/192 2023-12-16T01:20:38.927 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 115/192 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2023-12-16T01:20:38.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 116/192 2023-12-16T01:20:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 116/192 2023-12-16T01:20:39.106 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:39.106 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-16T01:20:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 117/192 2023-12-16T01:20:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 117/192 2023-12-16T01:20:40.694 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:40.694 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T01:20:40.694 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T01:20:40.695 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T01:20:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 118/192 2023-12-16T01:20:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 118/192 2023-12-16T01:20:40.917 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:40.917 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T01:20:40.917 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T01:20:40.917 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T01:20:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 119/192 2023-12-16T01:20:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 119/192 2023-12-16T01:20:41.384 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:41.384 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T01:20:41.385 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T01:20:41.385 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T01:20:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 120/192 2023-12-16T01:20:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-191.g6d933094.el9.noarch 121/192 2023-12-16T01:20:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-191.g6d933094.el9.noarch 121/192 2023-12-16T01:20:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-191.g6d933094.el 122/192 2023-12-16T01:20:42.061 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-191.g6d933094.e 123/192 2023-12-16T01:20:42.086 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noar 124/192 2023-12-16T01:20:42.309 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noar 124/192 2023-12-16T01:20:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.no 125/192 2023-12-16T01:20:43.291 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.no 125/192 2023-12-16T01:20:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-191.g6d93 126/192 2023-12-16T01:20:43.419 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-191.g6d93 126/192 2023-12-16T01:20:43.575 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-191.g6d933094.el9 127/192 2023-12-16T01:20:43.598 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 128/192 2023-12-16T01:20:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 128/192 2023-12-16T01:20:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T01:20:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T01:20:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T01:20:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 129/192 2023-12-16T01:20:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 129/192 2023-12-16T01:20:43.726 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-191.g6d933094.el9.x86_64 130/192 2023-12-16T01:20:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/192 2023-12-16T01:20:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 132/192 2023-12-16T01:20:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 132/192 2023-12-16T01:20:44.565 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:44.565 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T01:20:44.565 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T01:20:44.565 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T01:20:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:44.601 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-191.g6d9330 133/192 2023-12-16T01:20:44.623 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-191.g6d9330 133/192 2023-12-16T01:20:44.623 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:44.623 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T01:20:44.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 134/192 2023-12-16T01:20:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 134/192 2023-12-16T01:20:44.699 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:44.699 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-16T01:20:44.699 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T01:20:44.699 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T01:20:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 135/192 2023-12-16T01:20:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 135/192 2023-12-16T01:20:45.017 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:45.017 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T01:20:45.017 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T01:20:45.017 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T01:20:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 115/192 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2023-12-16T01:20:46.779 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:46.944 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 116/192 2023-12-16T01:20:46.960 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 116/192 2023-12-16T01:20:46.960 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:46.960 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-16T01:20:46.960 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:48.548 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 117/192 2023-12-16T01:20:48.573 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 117/192 2023-12-16T01:20:48.573 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:48.574 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T01:20:48.574 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T01:20:48.574 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T01:20:48.574 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:48.773 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 118/192 2023-12-16T01:20:48.795 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 118/192 2023-12-16T01:20:48.795 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:48.795 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T01:20:48.795 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T01:20:48.795 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T01:20:48.795 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:48.831 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-191.g6d933094.el9.x86_64 136/192 2023-12-16T01:20:48.881 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-191.g6d933094.el9.x86_64 137/192 2023-12-16T01:20:48.930 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-191.g6d933094.el9.x86_64 138/192 2023-12-16T01:20:48.962 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 139/192 2023-12-16T01:20:48.989 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 140/192 2023-12-16T01:20:49.176 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.0.0-191.g6d933094.el9.x86_64 141/192 2023-12-16T01:20:49.241 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 119/192 2023-12-16T01:20:49.263 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 119/192 2023-12-16T01:20:49.264 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:49.264 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T01:20:49.264 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T01:20:49.264 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T01:20:49.264 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:49.299 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/192 2023-12-16T01:20:49.328 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-191.g6d933094.el9.x86_64 143/192 2023-12-16T01:20:49.350 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.2-8.el9.noarch 120/192 2023-12-16T01:20:49.361 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-191.g6d933094.el9.x86_6 144/192 2023-12-16T01:20:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 145/192 2023-12-16T01:20:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 146/192 2023-12-16T01:20:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/192 2023-12-16T01:20:49.551 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 148/192 2023-12-16T01:20:49.597 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 149/192 2023-12-16T01:20:49.799 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:19.0.0-191.g6d933094.el9.noarch 121/192 2023-12-16T01:20:49.841 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:19.0.0-191.g6d933094.el9.noarch 121/192 2023-12-16T01:20:49.871 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-191.g6d933094.el 122/192 2023-12-16T01:20:49.931 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-191.g6d933094.e 123/192 2023-12-16T01:20:49.955 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noar 124/192 2023-12-16T01:20:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noar 124/192 2023-12-16T01:20:50.182 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T01:20:50.229 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T01:20:50.288 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.no 125/192 2023-12-16T01:20:50.288 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T01:20:51.065 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.0.0-191.g6d933094.el9.noarch 151/192 2023-12-16T01:20:51.206 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.no 125/192 2023-12-16T01:20:51.232 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-191.g6d93 126/192 2023-12-16T01:20:51.331 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-191.g6d93 126/192 2023-12-16T01:20:51.498 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-191.g6d933094.el9 127/192 2023-12-16T01:20:51.525 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 128/192 2023-12-16T01:20:51.548 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 128/192 2023-12-16T01:20:51.548 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:51.548 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T01:20:51.548 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T01:20:51.548 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T01:20:51.548 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:51.593 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 129/192 2023-12-16T01:20:51.603 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 129/192 2023-12-16T01:20:51.656 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:19.0.0-191.g6d933094.el9.x86_64 130/192 2023-12-16T01:20:52.441 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/192 2023-12-16T01:20:52.471 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 132/192 2023-12-16T01:20:52.493 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 132/192 2023-12-16T01:20:52.494 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:52.494 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T01:20:52.494 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T01:20:52.494 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T01:20:52.494 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:52.530 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-191.g6d9330 133/192 2023-12-16T01:20:52.552 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-191.g6d9330 133/192 2023-12-16T01:20:52.552 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:52.552 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T01:20:52.552 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:52.606 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 134/192 2023-12-16T01:20:52.628 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 134/192 2023-12-16T01:20:52.628 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:52.628 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-16T01:20:52.628 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T01:20:52.628 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T01:20:52.628 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:52.923 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 135/192 2023-12-16T01:20:52.945 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 135/192 2023-12-16T01:20:52.946 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T01:20:52.946 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T01:20:52.946 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T01:20:52.946 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T01:20:52.946 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:20:56.785 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:19.0.0-191.g6d933094.el9.x86_64 136/192 2023-12-16T01:20:56.834 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:19.0.0-191.g6d933094.el9.x86_64 137/192 2023-12-16T01:20:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:19.0.0-191.g6d933094.el9.x86_64 138/192 2023-12-16T01:20:56.908 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 139/192 2023-12-16T01:20:56.935 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 140/192 2023-12-16T01:20:57.129 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-shell-2:19.0.0-191.g6d933094.el9.x86_64 141/192 2023-12-16T01:20:57.241 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/192 2023-12-16T01:20:57.273 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:19.0.0-191.g6d933094.el9.x86_64 143/192 2023-12-16T01:20:57.297 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:19.0.0-191.g6d933094.el9.x86_6 144/192 2023-12-16T01:20:57.352 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 145/192 2023-12-16T01:20:57.405 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 146/192 2023-12-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/192 2023-12-16T01:20:57.463 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 148/192 2023-12-16T01:20:57.500 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 149/192 2023-12-16T01:20:58.113 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T01:20:58.156 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T01:20:58.175 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T01:20:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/192 2023-12-16T01:20:58.982 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:19.0.0-191.g6d933094.el9.noarch 151/192 2023-12-16T01:21:06.637 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/192 2023-12-16T01:21:37.631 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-debuginfo-2:19.0.0-191.g6d933094.el9.x 153/192 2023-12-16T01:21:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-debuginfo-2:19.0.0-191.g6d933094.el9 154/192 2023-12-16T01:21:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x 155/192 2023-12-16T01:21:42.727 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 156/192 2023-12-16T01:21:44.912 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-191.g6d933094.el9.x8 157/192 2023-12-16T01:21:45.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-debuginfo-2:19.0.0-191.g6d933094.el9.x 153/192 2023-12-16T01:21:46.376 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-debuginfo-2:19.0.0-191.g6d933094.el9 154/192 2023-12-16T01:21:46.545 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x 155/192 2023-12-16T01:21:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 156/192 2023-12-16T01:21:53.080 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-191.g6d933094.el9.x8 157/192 2023-12-16T01:21:56.105 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-191.g6d933094.el9.x8 158/192 2023-12-16T01:22:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-191.g6d933094.el9.x8 158/192 2023-12-16T01:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-191.g6d933094.el9.x8 159/192 2023-12-16T01:22:34.673 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-191.g6d933094.el9.x8 159/192 2023-12-16T01:22:43.009 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-191.g6d933094.el9.x8 160/192 2023-12-16T01:22:51.140 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-191.g6d933094.el9.x8 160/192 2023-12-16T01:23:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-191.g6d933094.el 161/192 2023-12-16T01:23:45.527 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-debuginfo-2:19.0.0-191.g6d933094.el9.x 162/192 2023-12-16T01:23:45.791 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-191.g6d933094.el9. 163/192 2023-12-16T01:23:50.690 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-debuginfo-2:19.0.0-191.g6d933094. 164/192 2023-12-16T01:23:53.007 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-191.g6d933094.el 161/192 2023-12-16T01:23:53.782 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-debuginfo-2:19.0.0-191.g6d933094.el9.x 162/192 2023-12-16T01:23:53.836 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-191.g6d933094.el9. 163/192 2023-12-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados2-debuginfo-2:19.0.0-191.g6d933094.el9.x 165/192 2023-12-16T01:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librbd1-debuginfo-2:19.0.0-191.g6d933094.el9.x86 166/192 2023-12-16T01:23:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-191.g6d933094. 167/192 2023-12-16T01:23:56.453 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-debuginfo-2:19.0.0-191.g6d933094.e 168/192 2023-12-16T01:23:56.521 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-191.g6d933094.el9 169/192 2023-12-16T01:23:56.600 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-191.g6d933094.el9 170/192 2023-12-16T01:23:58.492 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-debuginfo-2:19.0.0-191.g6d933094. 164/192 2023-12-16T01:24:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x8 171/192 2023-12-16T01:24:02.364 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-191.g6d933094.el9. 172/192 2023-12-16T01:24:02.427 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86 173/192 2023-12-16T01:24:02.476 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 174/192 2023-12-16T01:24:02.523 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/192 2023-12-16T01:24:02.619 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/192 2023-12-16T01:24:02.656 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/192 2023-12-16T01:24:02.681 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/192 2023-12-16T01:24:02.706 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/192 2023-12-16T01:24:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/192 2023-12-16T01:24:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T01:24:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T01:24:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/192 2023-12-16T01:24:02.876 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/192 2023-12-16T01:24:02.901 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/192 2023-12-16T01:24:02.901 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T01:24:02.986 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T01:24:03.011 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T01:24:03.026 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T01:24:03.026 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T01:24:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T01:24:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T01:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T01:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 189/192 2023-12-16T01:24:03.355 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 190/192 2023-12-16T01:24:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 191/192 2023-12-16T01:24:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T01:24:04.179 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados2-debuginfo-2:19.0.0-191.g6d933094.el9.x 165/192 2023-12-16T01:24:04.467 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librbd1-debuginfo-2:19.0.0-191.g6d933094.el9.x86 166/192 2023-12-16T01:24:04.791 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-191.g6d933094. 167/192 2023-12-16T01:24:05.118 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-debuginfo-2:19.0.0-191.g6d933094.e 168/192 2023-12-16T01:24:05.392 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-191.g6d933094.el9 169/192 2023-12-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-191.g6d933094.el9 170/192 2023-12-16T01:24:11.324 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x8 171/192 2023-12-16T01:24:11.475 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-191.g6d933094.el9. 172/192 2023-12-16T01:24:11.529 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86 173/192 2023-12-16T01:24:11.605 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 174/192 2023-12-16T01:24:11.654 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/192 2023-12-16T01:24:11.747 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/192 2023-12-16T01:24:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/192 2023-12-16T01:24:12.235 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/192 2023-12-16T01:24:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T01:24:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-191.g6d933094.el9.x86_64 1/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 2/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-191.g6d933094.el9.x 3/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 4/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-191.g6d933094.el9 5/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 6/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-191.g6d933094.el9.x86_64 7/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x 8/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-191.g6d9330 9/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 11/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-191.g6d933094.el9.x8 12/192 2023-12-16T01:24:12.409 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 13/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-191.g6d933094.el9.x8 14/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 15/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-191.g6d933094.el9.x8 16/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 17/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-191.g6d933094.el9.x8 18/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 19/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-191.g6d933094.el 20/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 21/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-191.g6d933094.el9.x86_64 22/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-191.g6d933094.el9.x 23/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 24/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.0.0-191.g6d933094.el9.x86_64 25/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-191.g6d933094.el9.x86_6 26/192 2023-12-16T01:24:12.410 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 27/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-191.g6d933094.el9. 28/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 29/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-191.g6d933094.el9.x86_64 30/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-191.g6d933094. 31/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-debuginfo-2:19.0.0-191.g6d933094.el9.x 32/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_ 33/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-debuginfo-2:19.0.0-191.g6d933094.el9.x86 34/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-191.g6d933094.el9.x86_64 35/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-191.g6d933094.el9 36/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-191.g6d933094.el9.x 37/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-191.g6d933094.el9.x86_64 38/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-191.g6d933094. 39/192 2023-12-16T01:24:12.411 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-191.g6d933094.el9.x86_64 40/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-191.g6d933094.e 41/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-191.g6d933094.el9.x86_64 42/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-191.g6d933094.el9 43/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-191.g6d933094.el9.x86_64 44/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-191.g6d933094.el9 45/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-191.g6d933094.el9.x86_64 46/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x8 47/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 48/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-191.g6d933094.el9. 49/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-191.g6d933094.el9.x86_64 50/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86 51/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-191.g6d933094.e 52/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noar 53/192 2023-12-16T01:24:12.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.no 54/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-191.g6d93 55/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-191.g6d933094.el9 56/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 57/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-191.g6d933094.el 58/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 59/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-191.g6d933094.el9.noarch 60/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.0.0-191.g6d933094.el9.noarch 61/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 65/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/192 2023-12-16T01:24:12.413 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jq-1.6-16.el9.x86_64 70/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 71/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 75/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 76/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 77/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 78/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 79/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 80/192 2023-12-16T01:24:12.414 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 81/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 82/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.11-1.el9.x86_64 83/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 84/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 85/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 86/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 89/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/192 2023-12-16T01:24:12.415 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 97/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 98/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 99/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 100/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 101/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 102/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 103/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 104/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 105/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 106/192 2023-12-16T01:24:12.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 107/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 108/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 109/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 110/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 111/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 112/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 113/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 114/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 115/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 116/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 117/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 118/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 119/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/192 2023-12-16T01:24:12.417 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 121/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 122/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 123/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 124/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 126/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 127/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 128/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 129/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 130/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 131/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 132/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 133/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 134/192 2023-12-16T01:24:12.418 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 135/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 136/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 137/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 138/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 139/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 140/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 141/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 142/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 143/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 144/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 145/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 146/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 147/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 148/192 2023-12-16T01:24:12.419 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 156/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 157/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 159/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 161/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 162/192 2023-12-16T01:24:12.420 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-191.g6d933094.el9.x86_64 163/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-191.g6d933094.el9.x86_64 165/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 167/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 168/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/192 2023-12-16T01:24:12.421 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 181/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 182/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 183/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 184/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 185/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 187/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/192 2023-12-16T01:24:12.422 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/192 2023-12-16T01:24:12.569 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/192 2023-12-16T01:24:12.879 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/192 2023-12-16T01:24:12.879 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T01:24:13.755 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T01:24:14.008 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/192 2023-12-16T01:24:14.046 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/192 2023-12-16T01:24:14.072 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/192 2023-12-16T01:24:14.072 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T01:24:14.156 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T01:24:14.181 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T01:24:14.200 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T01:24:14.200 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T01:24:14.391 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T01:24:14.392 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T01:24:14.495 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T01:24:14.533 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 189/192 2023-12-16T01:24:14.559 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 190/192 2023-12-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 191/192 2023-12-16T01:24:14.650 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T01:24:15.376 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/192 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: acl-2.3.1-4.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-16T01:24:15.377 INFO:teuthology.orchestra.run.smithi107.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.378 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.379 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:15.381 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: jq-1.6-16.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-16T01:24:15.382 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.383 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T01:24:15.384 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.11-1.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T01:24:15.385 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-16T01:24:15.386 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T01:24:15.387 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T01:24:15.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-16T01:24:15.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T01:24:15.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T01:24:15.391 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.392 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-16T01:24:15.393 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T01:24:15.394 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-16T01:24:15.394 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:15.394 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2023-12-16T01:24:16.044 DEBUG:teuthology.parallel:result is None 2023-12-16T01:24:23.475 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:19.0.0-191.g6d933094.el9.x86_64 1/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 2/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-191.g6d933094.el9.x 3/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 4/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-191.g6d933094.el9 5/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 6/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:19.0.0-191.g6d933094.el9.x86_64 7/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x 8/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-191.g6d9330 9/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/192 2023-12-16T01:24:23.476 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 11/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-191.g6d933094.el9.x8 12/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 13/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-191.g6d933094.el9.x8 14/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 15/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-191.g6d933094.el9.x8 16/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 17/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-191.g6d933094.el9.x8 18/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 19/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-191.g6d933094.el 20/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 21/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:19.0.0-191.g6d933094.el9.x86_64 22/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-191.g6d933094.el9.x 23/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 24/192 2023-12-16T01:24:23.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-shell-2:19.0.0-191.g6d933094.el9.x86_64 25/192 2023-12-16T01:24:23.478 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:19.0.0-191.g6d933094.el9.x86_6 26/192 2023-12-16T01:24:23.478 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 27/192 2023-12-16T01:24:23.478 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-191.g6d933094.el9. 28/192 2023-12-16T01:24:23.478 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 29/192 2023-12-16T01:24:23.492 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:19.0.0-191.g6d933094.el9.x86_64 30/192 2023-12-16T01:24:23.492 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-191.g6d933094. 31/192 2023-12-16T01:24:23.492 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-debuginfo-2:19.0.0-191.g6d933094.el9.x 32/192 2023-12-16T01:24:23.492 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_ 33/192 2023-12-16T01:24:23.492 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-debuginfo-2:19.0.0-191.g6d933094.el9.x86 34/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:19.0.0-191.g6d933094.el9.x86_64 35/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:19.0.0-191.g6d933094.el9 36/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:19.0.0-191.g6d933094.el9.x 37/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:19.0.0-191.g6d933094.el9.x86_64 38/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-191.g6d933094. 39/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:19.0.0-191.g6d933094.el9.x86_64 40/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-191.g6d933094.e 41/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:19.0.0-191.g6d933094.el9.x86_64 42/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-191.g6d933094.el9 43/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:19.0.0-191.g6d933094.el9.x86_64 44/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-191.g6d933094.el9 45/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:19.0.0-191.g6d933094.el9.x86_64 46/192 2023-12-16T01:24:23.493 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x8 47/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 48/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-191.g6d933094.el9. 49/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:19.0.0-191.g6d933094.el9.x86_64 50/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86 51/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-191.g6d933094.e 52/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noar 53/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.no 54/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-191.g6d93 55/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-191.g6d933094.el9 56/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 57/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-191.g6d933094.el 58/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 59/192 2023-12-16T01:24:23.494 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:19.0.0-191.g6d933094.el9.noarch 60/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:19.0.0-191.g6d933094.el9.noarch 61/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 65/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-16.el9.x86_64 70/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 71/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/192 2023-12-16T01:24:23.495 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 75/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 76/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 77/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 78/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 79/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 80/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 81/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 82/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-13.11-1.el9.x86_64 83/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 84/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 85/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 86/192 2023-12-16T01:24:23.496 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 89/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 97/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 98/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 99/192 2023-12-16T01:24:23.497 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 100/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 101/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 102/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 103/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 104/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 105/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 106/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 107/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 108/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 109/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 110/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 111/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 112/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 113/192 2023-12-16T01:24:23.498 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 114/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 115/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 116/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 117/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 118/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 119/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 121/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 122/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 123/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 124/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 126/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 127/192 2023-12-16T01:24:23.499 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 128/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 129/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 130/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 131/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 132/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 133/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 134/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 135/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 136/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 137/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 138/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 139/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 140/192 2023-12-16T01:24:23.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 141/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 142/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 143/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 144/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 145/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 146/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 147/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 148/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/192 2023-12-16T01:24:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 156/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 157/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 159/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : re2-1:20211101-3.el9.x86_64 161/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 162/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:19.0.0-191.g6d933094.el9.x86_64 163/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:19.0.0-191.g6d933094.el9.x86_64 165/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/192 2023-12-16T01:24:23.502 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 167/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 168/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/192 2023-12-16T01:24:23.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 181/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 182/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 183/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 184/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 185/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 187/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/192 2023-12-16T01:24:23.504 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/192 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/192 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: acl-2.3.1-4.el9.x86_64 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-16T01:24:26.357 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.2-8.el9.noarch 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.7.4-5.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.358 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.360 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:19.0.0-191.g6d933094.el9.noarch 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.4-9.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T01:24:26.361 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-16.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T01:24:26.362 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: lua-5.4.4-4.el9.x86_64 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-16T01:24:26.363 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-13.11-1.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.364 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T01:24:26.365 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T01:24:26.366 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T01:24:26.367 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T01:24:26.368 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-debuginfo-2:19.0.0-191.g6d933094.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: re2-1:20211101-3.el9.x86_64 2023-12-16T01:24:26.369 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:26.370 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-12-16T01:24:26.996 DEBUG:teuthology.parallel:result is None 2023-12-16T01:24:26.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:24:27.141 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T01:24:27.167 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-191.g6d933094.el9 2023-12-16T01:24:27.168 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-191.g6d933094.el9 2023-12-16T01:24:27.168 INFO:teuthology.task.install:The correct ceph version 19.0.0-191.g6d933094 is installed. 2023-12-16T01:24:27.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:24:27.310 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T01:24:27.333 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-191.g6d933094.el9 2023-12-16T01:24:27.333 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-191.g6d933094.el9 2023-12-16T01:24:27.333 INFO:teuthology.task.install:The correct ceph version 19.0.0-191.g6d933094 is installed. 2023-12-16T01:24:27.335 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T01:24:27.335 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:27.335 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T01:24:27.368 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:27.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T01:24:27.403 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T01:24:27.403 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:27.403 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T01:24:27.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T01:24:27.507 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:27.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T01:24:27.536 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T01:24:27.603 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T01:24:27.603 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:27.603 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T01:24:27.632 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T01:24:27.700 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:27.700 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T01:24:27.726 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T01:24:27.794 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T01:24:27.795 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:27.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T01:24:27.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T01:24:27.889 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:27.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T01:24:27.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T01:24:27.985 INFO:teuthology.run_tasks:Running task ceph... 2023-12-16T01:24:28.072 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-16T01:24:28.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2023-12-16T01:24:28.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2023-12-16T01:24:28.105 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-16T01:24:28.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T01:24:28.143 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T01:24:28.169 INFO:tasks.ceph:Creating extra log directories... 2023-12-16T01:24:28.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T01:24:28.210 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T01:24:28.242 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-16T01:24:28.242 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-16T01:24:28.242 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-16T01:24:28.242 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:28.242 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-16T01:24:28.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-16T01:24:28.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-16T01:24:28.436 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:28.436 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-16T01:24:28.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-16T01:24:28.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-16T01:24:28.607 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-16T01:24:28.607 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-16T01:24:28.607 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7493430', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5996, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLT84M/AV4/HUmQiSlGYB/nrejtLpviyEn/4EtWnZz8KcMAU5KAdOrigkJ236Kj6RvLUrCQ7ad/npxeP8t5sPhU=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDoiuyy1K2+BNhSVOZJEcguRfEKbkT4j6v44LDb2O/Dc/gQv5MX3eYQww3y/nyYUkzBDgBHlMN6IPUlnTKInKo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-16_00:09:48', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-16T01:24:28.608 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T01:24:28.610 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T01:24:28.657 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T01:24:28.666 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T01:24:28.723 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:28.723 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T01:24:28.745 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T01:24:28.746 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2023-12-16T01:24:28.800 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T01:24:28.800 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:28.800 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-16T01:24:28.800 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:28.801 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:28.801 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-12-16 01:24:03.786077199 +0000 2023-12-16T01:24:28.801 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-12-16 01:16:22.330405102 +0000 2023-12-16T01:24:28.801 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-12-16 01:16:22.330405102 +0000 2023-12-16T01:24:28.801 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-12-16 01:16:22.330405102 +0000 2023-12-16T01:24:28.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T01:24:28.865 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-12-16T01:24:28.865 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-12-16T01:24:28.866 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000180663 s, 2.8 MB/s 2023-12-16T01:24:28.866 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T01:24:28.923 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-12-16 01:24:03.786077199 +0000 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-12-16 01:16:22.824396941 +0000 2023-12-16T01:24:28.977 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-12-16 01:16:22.824396941 +0000 2023-12-16T01:24:28.978 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-12-16 01:16:22.824396941 +0000 2023-12-16T01:24:28.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T01:24:29.042 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-12-16T01:24:29.043 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-12-16T01:24:29.043 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000232268 s, 2.2 MB/s 2023-12-16T01:24:29.044 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T01:24:29.099 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2023-12-16T01:24:29.153 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T01:24:29.153 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:29.153 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-16T01:24:29.153 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:29.154 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:29.154 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-12-16 01:24:03.787077183 +0000 2023-12-16T01:24:29.154 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-12-16 01:16:23.307388962 +0000 2023-12-16T01:24:29.154 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-12-16 01:16:23.307388962 +0000 2023-12-16T01:24:29.154 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-12-16 01:16:23.307388962 +0000 2023-12-16T01:24:29.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T01:24:29.218 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-12-16T01:24:29.218 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-12-16T01:24:29.219 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000205934 s, 2.5 MB/s 2023-12-16T01:24:29.220 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T01:24:29.275 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-12-16 01:24:03.787077183 +0000 2023-12-16T01:24:29.330 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-12-16 01:16:23.796380883 +0000 2023-12-16T01:24:29.331 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-12-16 01:16:23.796380883 +0000 2023-12-16T01:24:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-12-16 01:16:23.796380883 +0000 2023-12-16T01:24:29.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T01:24:29.396 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-12-16T01:24:29.396 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-12-16T01:24:29.396 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000331844 s, 1.5 MB/s 2023-12-16T01:24:29.397 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T01:24:29.453 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:29.453 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:29.453 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T01:24:29.471 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T01:24:29.471 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2023-12-16T01:24:29.527 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-12-16 01:24:14.985614212 +0000 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-12-16 01:16:22.326382314 +0000 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-12-16 01:16:22.326382314 +0000 2023-12-16T01:24:29.528 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-12-16 01:16:22.326382314 +0000 2023-12-16T01:24:29.528 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T01:24:29.595 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-12-16T01:24:29.595 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-12-16T01:24:29.595 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000101979 s, 5.0 MB/s 2023-12-16T01:24:29.596 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T01:24:29.653 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-12-16 01:24:14.985614212 +0000 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-12-16 01:16:22.799373872 +0000 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-12-16 01:16:22.799373872 +0000 2023-12-16T01:24:29.709 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-12-16 01:16:22.799373872 +0000 2023-12-16T01:24:29.710 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T01:24:29.777 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-12-16T01:24:29.777 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-12-16T01:24:29.777 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00010015 s, 5.1 MB/s 2023-12-16T01:24:29.778 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T01:24:29.834 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2023-12-16T01:24:29.889 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T01:24:29.889 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:29.889 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-16T01:24:29.889 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:29.890 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:29.890 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-12-16 01:24:14.985614212 +0000 2023-12-16T01:24:29.890 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-12-16 01:16:23.269365483 +0000 2023-12-16T01:24:29.890 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-12-16 01:16:23.269365483 +0000 2023-12-16T01:24:29.890 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-12-16 01:16:23.269365483 +0000 2023-12-16T01:24:29.891 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T01:24:29.955 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-12-16T01:24:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-12-16T01:24:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000103653 s, 4.9 MB/s 2023-12-16T01:24:29.957 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T01:24:30.013 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-12-16 01:24:14.986614194 +0000 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-12-16 01:16:23.759356738 +0000 2023-12-16T01:24:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-12-16 01:16:23.759356738 +0000 2023-12-16T01:24:30.069 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-12-16 01:16:23.759356738 +0000 2023-12-16T01:24:30.069 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T01:24:30.133 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-12-16T01:24:30.134 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-12-16T01:24:30.134 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 9.8109e-05 s, 5.2 MB/s 2023-12-16T01:24:30.135 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T01:24:30.190 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:30.190 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-16T01:24:30.191 INFO:tasks.ceph:Generating config... 2023-12-16T01:24:30.192 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-16T01:24:30.192 INFO:tasks.ceph:[client] debug client = 20 2023-12-16T01:24:30.192 INFO:tasks.ceph:[client] debug ms = 1 2023-12-16T01:24:30.192 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-16T01:24:30.192 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-16T01:24:30.192 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-12-16T01:24:30.192 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-12-16T01:24:30.192 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-12-16T01:24:30.192 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-16T01:24:30.192 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-16T01:24:30.193 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-16T01:24:30.194 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-16T01:24:30.194 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-16T01:24:30.195 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-16T01:24:30.195 INFO:tasks.ceph:Setting up mon.a... 2023-12-16T01:24:30.195 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-16T01:24:30.259 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2023-12-16T01:24:30.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-16T01:24:30.305 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T01:24:30.373 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2023-12-16T01:24:30.373 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-16T01:24:30.374 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:30.374 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T01:24:30.427 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:30.512 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid 928cabe9-0ef6-4aba-be14-8cbcf8a73b88 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = pacific 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 928cabe9-0ef6-4aba-be14-8cbcf8a73b88 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2023-12-16T01:24:30.513171+0000 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:created 2023-12-16T01:24:30.513171+0000 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 16 (pacific) 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2023-12-16T01:24:30.513 INFO:teuthology.orchestra.run.smithi107.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2023-12-16T01:24:30.514 INFO:teuthology.orchestra.run.smithi107.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2023-12-16T01:24:30.514 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-16T01:24:30.515 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T01:24:30.529 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 928cabe9-0ef6-4aba-be14-8cbcf8a73b88... 2023-12-16T01:24:30.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T01:24:30.572 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T01:24:30.619 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2023-12-16T01:24:30.619 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2023-12-16T01:24:30.619 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T01:24:30.619 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2023-12-16T01:24:30.619 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.620 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T01:24:30.621 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.107,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: mds beacon grace = 60 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: mds heartbeat grace = 60 2023-12-16T01:24:30.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd heartbeat grace = 60 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 928cabe9-0ef6-4aba-be14-8cbcf8a73b88 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2023-12-16T01:24:30.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2023-12-16T01:24:30.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression mode = aggressive 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 20 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 20 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 10 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2023-12-16T01:24:30.625 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: osd fast shutdown = False 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2023-12-16T01:24:30.626 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T01:24:30.627 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd crush smoke test = False 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:24:30.628 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2023-12-16T01:24:30.629 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.e] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.f] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2023-12-16T01:24:30.630 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: mds valgrind exit = True 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2023-12-16T01:24:30.631 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2023-12-16T01:24:30.632 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2023-12-16T01:24:30.633 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2023-12-16T01:24:30.634 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.107,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: mds beacon grace = 60 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: mds heartbeat grace = 60 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: osd heartbeat grace = 60 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 928cabe9-0ef6-4aba-be14-8cbcf8a73b88 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2023-12-16T01:24:30.635 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.636 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore compression mode = aggressive 2023-12-16T01:24:30.637 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: osd fast shutdown = False 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2023-12-16T01:24:30.638 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2023-12-16T01:24:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T01:24:30.640 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd crush smoke test = False 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T01:24:30.641 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2023-12-16T01:24:30.642 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.e] 2023-12-16T01:24:30.643 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2023-12-16T01:24:30.643 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2023-12-16T01:24:30.643 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.f] 2023-12-16T01:24:30.643 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2023-12-16T01:24:30.643 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2023-12-16T01:24:30.643 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: mds valgrind exit = True 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2023-12-16T01:24:30.644 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2023-12-16T01:24:30.646 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-16T01:24:30.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-16T01:24:30.741 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-16T01:24:30.742 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:30.742 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-16T01:24:30.756 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:30.756 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-16T01:24:30.812 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:24:30.812 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:30.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T01:24:30.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T01:24:30.890 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:30.891 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:30.946 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T01:24:30.946 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:30.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T01:24:30.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T01:24:30.987 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:24:30.988 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:31.043 INFO:tasks.ceph:Setting up mon nodes... 2023-12-16T01:24:31.043 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-16T01:24:31.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-16T01:24:31.098 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-16T01:24:31.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T01:24:31.161 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T01:24:31.163 INFO:tasks.ceph:Setting up mds nodes... 2023-12-16T01:24:31.163 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-16T01:24:31.218 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-16T01:24:31.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-16T01:24:31.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-16T01:24:31.342 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-16T01:24:31.344 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-16T01:24:31.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-12-16T01:24:31.466 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-12-16T01:24:31.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-12-16T01:24:31.494 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-16T01:24:31.549 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-16T01:24:31.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-16T01:24:31.578 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-16T01:24:31.673 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-16T01:24:31.675 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-16T01:24:31.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-12-16T01:24:31.797 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-12-16T01:24:31.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-12-16T01:24:31.825 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-16T01:24:31.826 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T01:24:31.868 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-16T01:24:31.882 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-16T01:24:31.883 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-16T01:24:31.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-16T01:24:31.949 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:31.949 INFO:tasks.ceph:role: osd.0 2023-12-16T01:24:31.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:24:31.949 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T01:24:32.023 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:32.023 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:32.023 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:32.023 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:32.023 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:32.023 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:32.024 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:32.024 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:32.024 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:32.024 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:32.524 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-12-16T01:24:32.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-12-16T01:24:32.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-16T01:24:32.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-16T01:24:32.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-16T01:24:32.730 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:32.731 INFO:tasks.ceph:role: osd.1 2023-12-16T01:24:32.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:24:32.731 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T01:24:32.805 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:32.806 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:33.269 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-12-16T01:24:33.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-12-16T01:24:33.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-16T01:24:33.362 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-16T01:24:33.393 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-16T01:24:33.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:33.460 INFO:tasks.ceph:role: osd.2 2023-12-16T01:24:33.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:24:33.461 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-16T01:24:33.534 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:34.016 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-12-16T01:24:34.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-12-16T01:24:34.018 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-16T01:24:34.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-16T01:24:34.170 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-16T01:24:34.236 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:34.237 INFO:tasks.ceph:role: osd.3 2023-12-16T01:24:34.237 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:24:34.237 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-16T01:24:34.310 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:34.310 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:34.311 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:34.311 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:34.311 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:34.311 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:34.311 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:34.810 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-12-16T01:24:34.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-12-16T01:24:34.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-16T01:24:34.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-16T01:24:34.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:35.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:35.075+0000 7f6d8ec1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-16T01:24:35.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:35.076+0000 7f6d8ec1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-16T01:24:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:35.076+0000 7f6d8ec1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T01:24:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:35.076+0000 7f6d8ec1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T01:24:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:35.076+0000 7f6d8ec1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T01:24:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:35.076+0000 7f6d8ec1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-16T01:24:37.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T01:24:37.958 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:38.046+0000 7f5b7d80e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-16T01:24:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:38.046+0000 7f5b7d80e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-16T01:24:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:38.046+0000 7f5b7d80e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T01:24:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:38.046+0000 7f5b7d80e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T01:24:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:38.046+0000 7f5b7d80e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T01:24:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:38.047+0000 7f5b7d80e500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-16T01:24:40.886 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T01:24:40.917 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:41.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:41.008+0000 7f5e3e61a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-16T01:24:41.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:41.008+0000 7f5e3e61a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-16T01:24:41.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:41.008+0000 7f5e3e61a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T01:24:41.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:41.008+0000 7f5e3e61a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T01:24:41.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:41.008+0000 7f5e3e61a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T01:24:41.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:41.008+0000 7f5e3e61a500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-16T01:24:43.856 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T01:24:43.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:43.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:43.977+0000 7f40edcbe500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-16T01:24:43.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:43.977+0000 7f40edcbe500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-16T01:24:43.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:43.977+0000 7f40edcbe500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T01:24:43.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:43.977+0000 7f40edcbe500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T01:24:43.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:43.977+0000 7f40edcbe500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T01:24:43.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:24:43.978+0000 7f40edcbe500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-16T01:24:46.835 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T01:24:46.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-16T01:24:46.898 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:46.898 INFO:tasks.ceph:role: osd.4 2023-12-16T01:24:46.898 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T01:24:46.899 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T01:24:46.969 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:46.969 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:46.969 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:46.969 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:46.969 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:46.969 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:46.970 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:46.970 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:46.970 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:46.970 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:47.002 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-12-16T01:24:47.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-12-16T01:24:47.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-16T01:24:47.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-16T01:24:47.150 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-16T01:24:47.218 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:47.218 INFO:tasks.ceph:role: osd.5 2023-12-16T01:24:47.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T01:24:47.218 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:47.286 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:47.317 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-12-16T01:24:47.319 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-12-16T01:24:47.319 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-16T01:24:47.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-16T01:24:47.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-16T01:24:47.531 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:47.531 INFO:tasks.ceph:role: osd.6 2023-12-16T01:24:47.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T01:24:47.531 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-16T01:24:47.598 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:47.598 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:47.598 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:47.598 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:47.598 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:47.598 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:47.599 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:47.599 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:47.599 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:47.599 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:47.630 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-12-16T01:24:47.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-12-16T01:24:47.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-16T01:24:47.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-16T01:24:47.773 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-16T01:24:47.841 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T01:24:47.841 INFO:tasks.ceph:role: osd.7 2023-12-16T01:24:47.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T01:24:47.841 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-16T01:24:47.908 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T01:24:47.908 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T01:24:47.908 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T01:24:47.909 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T01:24:47.941 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-12-16T01:24:47.943 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-12-16T01:24:47.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-16T01:24:48.014 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-16T01:24:48.086 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:48.182+0000 7fc95cca1500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-16T01:24:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:48.182+0000 7fc95cca1500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-16T01:24:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:48.182+0000 7fc95cca1500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T01:24:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:48.182+0000 7fc95cca1500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T01:24:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:48.182+0000 7fc95cca1500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T01:24:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:48.182+0000 7fc95cca1500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-16T01:24:51.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T01:24:51.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:51.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:51.149+0000 7f6670a67500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-16T01:24:51.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:51.149+0000 7f6670a67500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-16T01:24:51.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:51.149+0000 7f6670a67500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T01:24:51.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:51.149+0000 7f6670a67500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T01:24:51.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:51.149+0000 7f6670a67500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T01:24:51.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:51.149+0000 7f6670a67500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-16T01:24:53.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T01:24:54.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:54.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:54.108+0000 7fa433caf500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-16T01:24:54.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:54.109+0000 7fa433caf500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-16T01:24:54.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:54.109+0000 7fa433caf500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T01:24:54.112 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:54.109+0000 7fa433caf500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T01:24:54.112 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:54.109+0000 7fa433caf500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T01:24:54.112 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:54.109+0000 7fa433caf500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-16T01:24:56.959 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-16T01:24:56.990 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:24:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:57.081+0000 7fbe5be25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-16T01:24:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:57.081+0000 7fbe5be25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-16T01:24:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:57.081+0000 7fbe5be25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T01:24:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:57.081+0000 7fbe5be25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T01:24:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:57.081+0000 7fbe5be25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T01:24:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:24:57.081+0000 7fbe5be25500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-16T01:24:58.609 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:24:58.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:24:59.928 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-16T01:24:59.958 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-16T01:24:59.958 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:59.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-16T01:24:59.991 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:24:59.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-16T01:25:00.061 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.062 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-16T01:25:00.131 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-12-16T01:25:00.200 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-16T01:25:00.269 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.269 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-16T01:25:00.336 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-16T01:25:00.402 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.403 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-16T01:25:00.469 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.469 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-16T01:25:00.501 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-16T01:25:00.572 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.572 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-16T01:25:00.642 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.642 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-12-16T01:25:00.710 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.710 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-16T01:25:00.779 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-16T01:25:00.847 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.847 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-16T01:25:00.915 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:00.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-16T01:25:00.983 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:00.983 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-16T01:25:00.999 INFO:tasks.ceph:Adding keys to all mons... 2023-12-16T01:25:00.999 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T01:25:01.041 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T01:25:01.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2023-12-16T01:25:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/Hxl7yviBRAAncnjPI7oUiY7OgEYCQHlyg== 2023-12-16T01:25:01.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2023-12-16T01:25:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/HxlyjsGDRAAYi0QGVX+EBgwy19uz7OuwA== 2023-12-16T01:25:01.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/HxlEAZtFBAAm1lEAavy+Leo+MRHiulOhg== 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.e] 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/Hxl0InMGxAA98plJvbn9r0KKZEh4RhtMw== 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBT/HxlvuKSBBAAfEDYwvIazrBtnE/FU0XUaw== 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBW/HxlWiTSAhAA3iYqkTmnSehfMunmT87C5g== 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBZ/HxlBduJABAAa2z0QR+uSH+/uMajBN+pQw== 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBb/HxlYIpPOhAAtoOUkragJP0tuZiZasDjnA== 2023-12-16T01:25:01.066 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/HxlrB6gCRAAnEhRtAp9/lkEGQhGHRvshQ== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/HxlzNvBIBAAtNOA56KL7gIa474HWs+TQA== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/Hxl58wjKBAAE1xgHfPeNd90/YLuRr1dqA== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.f] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/HxlfhuHLxAAh/8HMrBMyBL12BxMgtgLTw== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBg/HxltWftChAAC4vxY1bHIMx2exC/T8oE8A== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBj/Hxl2WIDCRAA27iuji5UF4HfJd8rJCTCVw== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBm/HxlK2yYBhAA5ojCvdMt/W6UKiD6ge3hDw== 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2023-12-16T01:25:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBp/HxllYDxBBAAfpG9F4/ZspERa3zxSNT4qQ== 2023-12-16T01:25:01.068 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2023-12-16T01:25:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBP/HxlJefFMxAAD4i7bszSrl10I8J51ho2cA== 2023-12-16T01:25:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2023-12-16T01:25:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/Hxl7yviBRAAncnjPI7oUiY7OgEYCQHlyg== 2023-12-16T01:25:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2023-12-16T01:25:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/HxlyjsGDRAAYi0QGVX+EBgwy19uz7OuwA== 2023-12-16T01:25:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/HxlEAZtFBAAm1lEAavy+Leo+MRHiulOhg== 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.e] 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/Hxl0InMGxAA98plJvbn9r0KKZEh4RhtMw== 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBT/HxlvuKSBBAAfEDYwvIazrBtnE/FU0XUaw== 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBW/HxlWiTSAhAA3iYqkTmnSehfMunmT87C5g== 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBZ/HxlBduJABAAa2z0QR+uSH+/uMajBN+pQw== 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2023-12-16T01:25:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBb/HxlYIpPOhAAtoOUkragJP0tuZiZasDjnA== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/HxlrB6gCRAAnEhRtAp9/lkEGQhGHRvshQ== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/HxlzNvBIBAAtNOA56KL7gIa474HWs+TQA== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/Hxl58wjKBAAE1xgHfPeNd90/YLuRr1dqA== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.f] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/HxlfhuHLxAAh/8HMrBMyBL12BxMgtgLTw== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBg/HxltWftChAAC4vxY1bHIMx2exC/T8oE8A== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBj/Hxl2WIDCRAA27iuji5UF4HfJd8rJCTCVw== 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2023-12-16T01:25:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBm/HxlK2yYBhAA5ojCvdMt/W6UKiD6ge3hDw== 2023-12-16T01:25:01.072 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2023-12-16T01:25:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBp/HxllYDxBBAAfpG9F4/ZspERa3zxSNT4qQ== 2023-12-16T01:25:01.072 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2023-12-16T01:25:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBP/HxlJefFMxAAD4i7bszSrl10I8J51ho2cA== 2023-12-16T01:25:01.072 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T01:25:01.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T01:25:01.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.166 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.222 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.283 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.337 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.339 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.393 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.446 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.449 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.500 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.504 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.556 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T01:25:01.558 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T01:25:01.610 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.667 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.669 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.724 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.726 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T01:25:01.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.785 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.840 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.892 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:01.948 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T01:25:02.000 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T01:25:02.002 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T01:25:02.058 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-16T01:25:02.059 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-16T01:25:02.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T01:25:02.181 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-16T01:25:02.208 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-16T01:25:02.235 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T01:25:02.332 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-16T01:25:02.359 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-16T01:25:02.426 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T01:25:02.523 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-16T01:25:02.550 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:25:02.552 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T01:25:02.605 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-16T01:25:02.605 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T01:25:02.605 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-16T01:25:02.605 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-12-16T01:25:02.607 INFO:tasks.ceph.mon.a:Started 2023-12-16T01:25:02.608 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T01:25:02.608 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-16T01:25:02.608 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-12-16T01:25:02.648 INFO:tasks.ceph.mon.b:Started 2023-12-16T01:25:02.648 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T01:25:02.648 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-16T01:25:02.648 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-12-16T01:25:02.650 INFO:tasks.ceph.mon.c:Started 2023-12-16T01:25:02.650 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-16T01:25:02.651 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-16T01:25:02.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-12-16T01:25:02.653 INFO:tasks.ceph.mgr.y:Started 2023-12-16T01:25:02.653 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-16T01:25:02.653 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-12-16T01:25:02.655 INFO:tasks.ceph.mgr.x:Started 2023-12-16T01:25:02.655 INFO:tasks.ceph:Setting crush tunables to default 2023-12-16T01:25:02.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2023-12-16T01:25:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.768+0000 7ff155f1d640 1 Processor -- start 2023-12-16T01:25:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.768+0000 7ff155f1d640 1 -- start start 2023-12-16T01:25:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff155f1d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff1500c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff155f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 0x7ff15006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff155f1d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff150159ba0 con 0x7ff1500c82b0 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff155f1d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff15006f720 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff155f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff150070040 con 0x7ff15015d600 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff14ffff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 msgr2=0x7ff15006fb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff1500c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff14effd640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff1500c82b0 legacy=0x7ff150159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff1500c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.769+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 0x7ff15006fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.970+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff1500c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.970+0000 7ff14ffff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 msgr2=0x7ff15006fb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2023-12-16T01:25:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.970+0000 7ff14effd640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff1500c82b0 legacy=0x7ff150159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.970+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff1500c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:02.970+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 0x7ff15006fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:03.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:03.371+0000 7ff14effd640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff1500c82b0 legacy=0x7ff150159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:03.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:03.371+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff1500c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:03.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:03.371+0000 7ff14ffff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 msgr2=0x7ff15006fb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2023-12-16T01:25:03.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:03.371+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff1500c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:03.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:03.371+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 0x7ff15006fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:04.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:04.172+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff1500c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:04.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:04.172+0000 7ff14ffff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 msgr2=0x7ff15006fb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2023-12-16T01:25:04.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:04.172+0000 7ff14effd640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff1500c82b0 legacy=0x7ff150159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:04.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:04.172+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff1500c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:04.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:04.172+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 0x7ff15006fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:05.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 msgr2=0x7ff15006fb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff15015d600 0x7ff15006fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff1500c7040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff1500c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff1500c82b0 legacy=0x7ff150159490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 0x7ff13c005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015a3e0 con 0x7ff13c006190 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14d7fa640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff13c0036c0 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14f7fe640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 msgr2=0x7ff13c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c006190 legacy=0x7ff13c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:05.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.769+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 0x7ff13c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:05.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.970+0000 7ff14f7fe640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 msgr2=0x7ff13c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2023-12-16T01:25:05.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.970+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c006190 legacy=0x7ff13c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:05.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:05.970+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 0x7ff13c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:06.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:06.371+0000 7ff14f7fe640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 msgr2=0x7ff13c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2023-12-16T01:25:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:06.371+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c006190 legacy=0x7ff13c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:06.371+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 0x7ff13c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:07.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:07.172+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c006190 legacy=0x7ff13c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:07.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:07.172+0000 7ff14f7fe640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 msgr2=0x7ff13c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2023-12-16T01:25:07.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:07.172+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 0x7ff13c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.769+0000 7ff14d7fa640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 msgr2=0x7ff13c005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.769+0000 7ff14d7fa640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0036c0 0x7ff13c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.769+0000 7ff14d7fa640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c006190 legacy=0x7ff13c008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.769+0000 7ff14ffff640 1 -- reap_dead start 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.769+0000 7ff14d7fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff13c009ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14d7fa640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff150159ba0 con 0x7ff13c00a410 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14d7fa640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015a3e0 con 0x7ff13c005be0 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14d7fa640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff15006f720 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff13c009ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c00a410 legacy=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:08.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff13c009ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:08.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.770+0000 7ff14ffff640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff13c005be0 legacy=0x7ff13c009490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:08.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.971+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c00a410 legacy=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:08.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.971+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff13c009ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:08.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.971+0000 7ff14ffff640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff13c005be0 legacy=0x7ff13c009490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:08.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:08.971+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff13c009ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:09.372+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c00a410 legacy=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:09.372+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff13c009ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:09.372+0000 7ff14ffff640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff13c005be0 legacy=0x7ff13c009490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:09.372+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff13c009ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:10.172+0000 7ff14effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c00a410 legacy=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2023-12-16T01:25:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:10.172+0000 7ff14ffff640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff13c005be0 legacy=0x7ff13c009490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2023-12-16T01:25:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:10.172+0000 7ff14f7fe640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff13c009ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2023-12-16T01:25:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:10.172+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff13c009ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:10.221 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:00:07.514 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:25:10.535 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:00:07.827 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:25:10.637 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:00:07.861 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:25:10.637 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:00:07.862 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:25:10.963 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:00:08.188 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:25:10.963 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:00:08.188 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 msgr2=0x7ff13c009ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff15006f720 0x7ff13c009ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff13c005be0 legacy=0x7ff13c009490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7ff13c00a410 legacy=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff13c0088f0 2023-12-16T01:25:11.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14d7fa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff150070040 con 0x7ff13c011100 2023-12-16T01:25:11.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14effd640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2023-12-16T01:25:11.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.769+0000 7ff14effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:11.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.949+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:11.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.968+0000 7ff14f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35290/0 (socket says 172.21.15.107:35290) 2023-12-16T01:25:11.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.968+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 learned_addr learned my addr 172.21.15.107:0/1873819219 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:11.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.970+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2023-12-16T01:25:11.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:11.970+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:12.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.003+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:12.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.003+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:12.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.003+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:12.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.003+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.233+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.235+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.235+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.235+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.235+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:12.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.486+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:12.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.636+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:12.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.637+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:12.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.637+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:12.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.637+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:12.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.637+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:12.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.655+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:12.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.655+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:12.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.655+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:12.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:12.655+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:13.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.459+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:13.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.472+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:13.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.489+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:13.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.489+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:13.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.489+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:13.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.489+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:13.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.495+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:13.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.495+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:13.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.495+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:13.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:13.495+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 msgr2=0x7ff13c0134f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c011100 0x7ff13c0134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c0088f0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14ffff640 1 -- 172.21.15.107:0/1873819219 reap_dead start 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0086a0 con 0x7ff13c0092c0 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff13c005be0 2023-12-16T01:25:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff150070040 con 0x7ff13c0088f0 2023-12-16T01:25:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.770+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:14.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.771+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:14.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.972+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:14.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.972+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:14.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:14.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:14.973+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.375+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.375+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.375+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.375+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.375+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.375+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.376+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:15.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.376+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:15.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.376+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:15.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:15.376+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:16.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.178+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:16.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.178+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:16.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.179+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.179+0000 7ff14f7fe640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.179+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.179+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.180+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.180+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.180+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:16.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:16.180+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 msgr2=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c0088f0 0x7ff13c008d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.107:3300/0 conn(0x7ff13c005be0 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> v1:172.21.15.157:6789/0 conn(0x7ff13c0092c0 legacy=0x7ff13c00b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.770+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff150159ba0 con 0x7ff13c009730 2023-12-16T01:25:17.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.771+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff13c0134f0 2023-12-16T01:25:17.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.772+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:17.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.772+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:17.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.772+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:17.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.772+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:17.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.772+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:17.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.974+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:17.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.975+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:17.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.975+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:17.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.975+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:17.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:17.975+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T01:25:18.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:18.377+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:18.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:18.378+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:18.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:18.378+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:18.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:18.378+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:18.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:18.378+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T01:25:19.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:19.180+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:19.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:19.181+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:19.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:19.181+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:19.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:19.181+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:19.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:19.181+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T01:25:20.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 msgr2=0x7ff13c00ff20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:20.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff13c0134f0 0x7ff13c00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:20.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 >> v1:172.21.15.107:6789/0 conn(0x7ff13c009730 legacy=0x7ff13c00e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:20.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14ffff640 1 -- 172.21.15.107:0/1873819219 reap_dead start 2023-12-16T01:25:20.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 0x7ff13c00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015a3e0 con 0x7ff13c0105b0 2023-12-16T01:25:20.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c009490 con 0x7ff13c0088f0 2023-12-16T01:25:20.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14d7fa640 1 -- 172.21.15.107:0/1873819219 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff13c005b40 2023-12-16T01:25:20.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.771+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 0x7ff13c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:20.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.774+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T01:25:20.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.774+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T01:25:20.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.774+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 0x7ff13c00a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T01:25:20.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.774+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T01:25:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.851+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029590150 0 0) 0x7ff13c009490 con 0x7ff13c0088f0 2023-12-16T01:25:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.851+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff138003520 con 0x7ff13c0088f0 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263166655 0 0) 0x7ff138003520 con 0x7ff13c0088f0 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 msgr2=0x7ff13c00a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 --2- 172.21.15.107:0/1873819219 >> v2:172.21.15.157:3300/0 conn(0x7ff13c005b40 0x7ff13c00a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 >> v1:172.21.15.107:6789/0 conn(0x7ff13c0105b0 legacy=0x7ff13c0109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0134f0 con 0x7ff13c0088f0 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7ff144015470 con 0x7ff13c0088f0 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 >> v1:172.21.15.157:6789/0 conn(0x7ff13c0088f0 legacy=0x7ff13c008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:20.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff138003970 0x7ff138003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1380047c0 0x7ff138004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1380051d0 0x7ff13800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15015da90 con 0x7ff1380051d0 2023-12-16T01:25:20.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800c120 con 0x7ff1380047c0 2023-12-16T01:25:20.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.896+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800c2e0 con 0x7ff138003970 2023-12-16T01:25:20.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.899+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1380047c0 0x7ff138004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:20.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.925+0000 7ff14ffff640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1380051d0 0x7ff13800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:20.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.927+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff138003970 msgr2=0x7ff138003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:20.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.927+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff138003970 0x7ff138003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:20.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.927+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1380051d0 msgr2=0x7ff13800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:20.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.927+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1380051d0 0x7ff13800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:20.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.927+0000 7ff14effd640 1 -- 172.21.15.107:0/1873819219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138003520 con 0x7ff1380047c0 2023-12-16T01:25:20.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.927+0000 7ff14ffff640 1 -- 172.21.15.107:0/1873819219 reap_dead start 2023-12-16T01:25:20.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.936+0000 7ff14effd640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1380047c0 0x7ff138004c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff140000ea0 tx=0x7ff1380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cb074b3d6c24b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:20.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.975+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140032660 con 0x7ff1380047c0 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.975+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1400327c0 con 0x7ff1380047c0 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.975+0000 7ff14e7fc640 1 -- 172.21.15.107:0/1873819219 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140032c10 con 0x7ff1380047c0 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 -- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1380047c0 msgr2=0x7ff138004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1380047c0 0x7ff138004c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff140000ea0 tx=0x7ff1380057f0 comp rx=0 tx=0).stop 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 -- 172.21.15.107:0/1873819219 shutdown_connections 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 --2- 172.21.15.107:0/1873819219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1380047c0 0x7ff138004c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 -- 172.21.15.107:0/1873819219 >> 172.21.15.107:0/1873819219 conn(0x7ff1500cbef0 msgr2=0x7ff1500cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 -- 172.21.15.107:0/1873819219 shutdown_connections 2023-12-16T01:25:20.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.976+0000 7ff155f1d640 1 -- 172.21.15.107:0/1873819219 wait complete. 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.977+0000 7ff155f1d640 1 Processor -- start 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 -- start start 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1380047c0 0x7ff1501ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff15014f530 0x7ff150152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1500cb8d0 0x7ff150148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1501e2a00 con 0x7ff15014f530 2023-12-16T01:25:20.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500cb540 con 0x7ff1500cb8d0 2023-12-16T01:25:20.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.978+0000 7ff155f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1501f2e90 con 0x7ff1380047c0 2023-12-16T01:25:20.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.980+0000 7ff14effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff15014f530 0x7ff150152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:20.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.993+0000 7ff14effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff15014f530 0x7ff150152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48534/0 (socket says 172.21.15.107:48534) 2023-12-16T01:25:20.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.993+0000 7ff14effd640 1 -- 172.21.15.107:0/1838286600 learned_addr learned my addr 172.21.15.107:0/1838286600 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:20.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:20.996+0000 7ff14ffff640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1500cb8d0 0x7ff150148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:21.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.000+0000 7ff14f7fe640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1380047c0 0x7ff1501ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:21.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.004+0000 7ff14ffff640 1 -- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1380047c0 msgr2=0x7ff1501ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:21.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.004+0000 7ff14ffff640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1380047c0 0x7ff1501ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:21.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.004+0000 7ff14ffff640 1 -- 172.21.15.107:0/1838286600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff15014f530 msgr2=0x7ff150152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:21.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.004+0000 7ff14ffff640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff15014f530 0x7ff150152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:21.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.004+0000 7ff14ffff640 1 -- 172.21.15.107:0/1838286600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500cb260 con 0x7ff1500cb8d0 2023-12-16T01:25:21.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.008+0000 7ff14ffff640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1500cb8d0 0x7ff150148de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff15015d9e0 tx=0x7ff14800dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:21.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.042+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800bbd0 con 0x7ff1500cb8d0 2023-12-16T01:25:21.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.042+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff148006e90 con 0x7ff1500cb8d0 2023-12-16T01:25:21.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.042+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1501f3130 con 0x7ff1500cb8d0 2023-12-16T01:25:21.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.042+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800f3f0 con 0x7ff1500cb8d0 2023-12-16T01:25:21.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.042+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1501ef160 con 0x7ff1500cb8d0 2023-12-16T01:25:21.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.043+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1500740e0 con 0x7ff1500cb8d0 2023-12-16T01:25:21.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.225+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff14800f850 con 0x7ff1500cb8d0 2023-12-16T01:25:21.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.233+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff14801c900 con 0x7ff1500cb8d0 2023-12-16T01:25:21.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.233+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7ff14801c460 con 0x7ff1500cb8d0 2023-12-16T01:25:21.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.299+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff1500c6e20 con 0x7ff1500cb8d0 2023-12-16T01:25:21.493 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:21.493+0000 7f05f7a44040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T01:25:21.547 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:21.546+0000 7f05f7a44040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T01:25:21.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.547+0000 7ff137fff640 1 -- 172.21.15.107:0/1838286600 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff14800fc90 con 0x7ff1500cb8d0 2023-12-16T01:25:21.547 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1500cb8d0 msgr2=0x7ff150148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1500cb8d0 0x7ff150148de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff15015d9e0 tx=0x7ff14800dd40 comp rx=0 tx=0).stop 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 shutdown_connections 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1500cb8d0 0x7ff150148de0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff15014f530 0x7ff150152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 --2- 172.21.15.107:0/1838286600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1380047c0 0x7ff1501ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 >> 172.21.15.107:0/1838286600 conn(0x7ff1500cbef0 msgr2=0x7ff15006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 shutdown_connections 2023-12-16T01:25:21.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:21.548+0000 7ff155f1d640 1 -- 172.21.15.107:0/1838286600 wait complete. 2023-12-16T01:25:21.560 INFO:tasks.ceph:check_enable_crimson: False 2023-12-16T01:25:21.560 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-16T01:25:21.560 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:21.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-16T01:25:21.587 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:21.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-16T01:25:21.633 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:21.633+0000 7f9e4164c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T01:25:21.654 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:21.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-16T01:25:21.685 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:21.684+0000 7f9e4164c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T01:25:21.723 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:25:21.724 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-16T01:25:21.791 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:21.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-16T01:25:21.819 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:21.819 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-16T01:25:21.888 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:21.888 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-16T01:25:21.954 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-12-16T01:25:21.954 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-16T01:25:22.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 8e86e509-9355-4172-a028-a45b40c78281 0 2023-12-16T01:25:22.102 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.101+0000 7f05f7a44040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T01:25:22.156 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.155+0000 7f05f7a44040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T01:25:22.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.163+0000 7f58593d5640 1 Processor -- start 2023-12-16T01:25:22.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.163+0000 7f58593d5640 1 -- start start 2023-12-16T01:25:22.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.164+0000 7f58593d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.164+0000 7f58593d5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5854159760 0x7f5854159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.164+0000 7f58593d5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5854071420 con 0x7f5854071c40 2023-12-16T01:25:22.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.164+0000 7f58593d5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5854155b20 con 0x7f5854159760 2023-12-16T01:25:22.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.164+0000 7f58593d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585415a0b0 con 0x7f585414fd70 2023-12-16T01:25:22.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.165+0000 7f5852ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.165+0000 7f58537fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5854159760 0x7f5854159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.165+0000 7f5852ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:56868/0 (socket says 172.21.15.157:56868) 2023-12-16T01:25:22.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.165+0000 7f5852ffd640 1 -- 172.21.15.157:0/1571289783 learned_addr learned my addr 172.21.15.157:0/1571289783 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:22.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.168+0000 7f5852ffd640 1 -- 172.21.15.157:0/1571289783 >> v2:172.21.15.107:3300/0 conn(0x7f5854159760 msgr2=0x7f5854159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:22.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.168+0000 7f5852ffd640 1 --2- 172.21.15.157:0/1571289783 >> v2:172.21.15.107:3300/0 conn(0x7f5854159760 0x7f5854159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.168+0000 7f5852ffd640 1 -- 172.21.15.157:0/1571289783 >> v1:172.21.15.107:6789/0 conn(0x7f5854071c40 legacy=0x7f58540c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.168+0000 7f5852ffd640 1 -- 172.21.15.157:0/1571289783 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58541592d0 con 0x7f585414fd70 2023-12-16T01:25:22.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.171+0000 7f5852ffd640 1 --2- 172.21.15.157:0/1571289783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854070ee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5844009870 tx=0x7f584402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ba3e6321c566c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:22.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.176+0000 7f5851ffb640 1 -- 172.21.15.157:0/1571289783 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844031640 con 0x7f585414fd70 2023-12-16T01:25:22.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.176+0000 7f5851ffb640 1 -- 172.21.15.157:0/1571289783 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58440317a0 con 0x7f585414fd70 2023-12-16T01:25:22.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.176+0000 7f5851ffb640 1 -- 172.21.15.157:0/1571289783 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844031b30 con 0x7f585414fd70 2023-12-16T01:25:22.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.177+0000 7f58593d5640 1 -- 172.21.15.157:0/1571289783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 msgr2=0x7f5854070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.177+0000 7f58593d5640 1 --2- 172.21.15.157:0/1571289783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854070ee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5844009870 tx=0x7f584402b8f0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.177+0000 7f58593d5640 1 -- 172.21.15.157:0/1571289783 shutdown_connections 2023-12-16T01:25:22.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.177+0000 7f58593d5640 1 --2- 172.21.15.157:0/1571289783 >> v2:172.21.15.107:3300/0 conn(0x7f5854159760 0x7f5854159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.177+0000 7f58593d5640 1 --2- 172.21.15.157:0/1571289783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854070ee0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.178+0000 7f58593d5640 1 -- 172.21.15.157:0/1571289783 >> 172.21.15.157:0/1571289783 conn(0x7f585406cd60 msgr2=0x7f585406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:22.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.178+0000 7f58593d5640 1 -- 172.21.15.157:0/1571289783 shutdown_connections 2023-12-16T01:25:22.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.178+0000 7f58593d5640 1 -- 172.21.15.157:0/1571289783 wait complete. 2023-12-16T01:25:22.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 Processor -- start 2023-12-16T01:25:22.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 -- start start 2023-12-16T01:25:22.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5854071c40 0x7f58540caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854159760 0x7f58540c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58540cb520 con 0x7f5854071c40 2023-12-16T01:25:22.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58541ea7c0 con 0x7f5854159760 2023-12-16T01:25:22.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.180+0000 7f58593d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58540cb020 con 0x7f585414fd70 2023-12-16T01:25:22.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.181+0000 7f58537fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854159760 0x7f58540c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.181+0000 7f58527fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.181+0000 7f5852ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5854071c40 0x7f58540caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.181+0000 7f58537fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854159760 0x7f58540c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52130/0 (socket says 172.21.15.157:52130) 2023-12-16T01:25:22.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.181+0000 7f58537fe640 1 -- 172.21.15.157:0/2602421429 learned_addr learned my addr 172.21.15.157:0/2602421429 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:22.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.186+0000 7f58527fc640 1 -- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854159760 msgr2=0x7f58540c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.186+0000 7f58527fc640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854159760 0x7f58540c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.186+0000 7f58527fc640 1 -- 172.21.15.157:0/2602421429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5854071c40 msgr2=0x7f58540caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.186+0000 7f58527fc640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5854071c40 0x7f58540caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.186+0000 7f58527fc640 1 -- 172.21.15.157:0/2602421429 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440094d0 con 0x7f585414fd70 2023-12-16T01:25:22.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.190+0000 7f58527fc640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854145a30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f584800c340 tx=0x7f584800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:22.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.194+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480052d0 con 0x7f585414fd70 2023-12-16T01:25:22.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.194+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848005450 con 0x7f585414fd70 2023-12-16T01:25:22.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.194+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848007260 con 0x7f585414fd70 2023-12-16T01:25:22.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.194+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58541eb790 con 0x7f585414fd70 2023-12-16T01:25:22.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.194+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58541ea9d0 con 0x7f585414fd70 2023-12-16T01:25:22.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.195+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5854067500 con 0x7f585414fd70 2023-12-16T01:25:22.210 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.209+0000 7f05f7a44040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T01:25:22.266 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.265+0000 7f05f7a44040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T01:25:22.311 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.310+0000 7f05f7a44040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T01:25:22.345 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.344+0000 7f9e4164c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T01:25:22.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.405+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58480067d0 con 0x7f585414fd70 2023-12-16T01:25:22.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.405+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f58480038c0 con 0x7f585414fd70 2023-12-16T01:25:22.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.405+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f5848020060 con 0x7f585414fd70 2023-12-16T01:25:22.410 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.409+0000 7f9e4164c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T01:25:22.418 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.417+0000 7f05f7a44040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-16T01:25:22.458 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.458+0000 7f9e4164c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T01:25:22.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.479+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e86e509-9355-4172-a028-a45b40c78281", "id": 0} v 0) v1 -- 0x7f58540c5da0 con 0x7f585414fd70 2023-12-16T01:25:22.490 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.489+0000 7f05f7a44040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T01:25:22.515 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.515+0000 7f9e4164c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T01:25:22.538 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.537+0000 7f05f7a44040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T01:25:22.562 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.561+0000 7f9e4164c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T01:25:22.593 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.592+0000 7f05f7a44040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T01:25:22.644 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:22.644+0000 7f05f7a44040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T01:25:22.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.664+0000 7f583b7fe640 1 -- 172.21.15.157:0/2602421429 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e86e509-9355-4172-a028-a45b40c78281", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5854071420 con 0x7f585414fd70 2023-12-16T01:25:22.666 INFO:teuthology.orchestra.run.smithi157.stdout:0 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.665+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 msgr2=0x7f5854145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.665+0000 7f58593d5640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854145a30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f584800c340 tx=0x7f584800c800 comp rx=0 tx=0).stop 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 shutdown_connections 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854159760 0x7f58540c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f585414fd70 0x7f5854145a30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 --2- 172.21.15.157:0/2602421429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5854071c40 0x7f58540caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 >> 172.21.15.157:0/2602421429 conn(0x7f585406cd60 msgr2=0x7f585406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 shutdown_connections 2023-12-16T01:25:22.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.666+0000 7f58593d5640 1 -- 172.21.15.157:0/2602421429 wait complete. 2023-12-16T01:25:22.671 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.670+0000 7f9e4164c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-16T01:25:22.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 504aafdb-9fe3-4f96-8b14-b5eda7556a40 1 2023-12-16T01:25:22.749 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.749+0000 7f9e4164c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T01:25:22.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.787+0000 7f08fcfd5640 1 Processor -- start 2023-12-16T01:25:22.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.787+0000 7f08fcfd5640 1 -- start start 2023-12-16T01:25:22.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.788+0000 7f08fcfd5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f80c2710 0x7f08f8157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.788+0000 7f08fcfd5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f806fa00 con 0x7f08f8151630 2023-12-16T01:25:22.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.788+0000 7f08fcfd5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f815b9c0 con 0x7f08f806f590 2023-12-16T01:25:22.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.788+0000 7f08fcfd5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8158490 con 0x7f08f80c2710 2023-12-16T01:25:22.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.789+0000 7f08f6d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f80c2710 0x7f08f8157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.790 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.789+0000 7f08f659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f08f8151630 0x7f08f80c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.157:57802/0 (socket says 172.21.15.157:57802) 2023-12-16T01:25:22.790 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.789+0000 7f08f659c640 1 -- 172.21.15.157:0/408169546 learned_addr learned my addr 172.21.15.157:0/408169546 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-12-16T01:25:22.792 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.791+0000 7f08f6d9d640 1 -- 172.21.15.157:0/408169546 >> v1:172.21.15.157:6789/0 conn(0x7f08f806f590 legacy=0x7f08f80c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.792 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.791+0000 7f08f6d9d640 1 -- 172.21.15.157:0/408169546 >> v1:172.21.15.107:6789/0 conn(0x7f08f8151630 legacy=0x7f08f80c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.792 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.791+0000 7f08f6d9d640 1 -- 172.21.15.157:0/408169546 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f815ab60 con 0x7f08f80c2710 2023-12-16T01:25:22.794 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.793+0000 7f08f6d9d640 1 --2- 172.21.15.157:0/408169546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f80c2710 0x7f08f8157f50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009dc0 tx=0x7f08f002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39616fbef259c85e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:22.799 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.798+0000 7f08f5d9b640 1 -- 172.21.15.157:0/408169546 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f002cd50 con 0x7f08f80c2710 2023-12-16T01:25:22.799 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.798+0000 7f08f5d9b640 1 -- 172.21.15.157:0/408169546 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0034440 con 0x7f08f80c2710 2023-12-16T01:25:22.799 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.798+0000 7f08f5d9b640 1 -- 172.21.15.157:0/408169546 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00347d0 con 0x7f08f80c2710 2023-12-16T01:25:22.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 -- 172.21.15.157:0/408169546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f80c2710 msgr2=0x7f08f8157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 --2- 172.21.15.157:0/408169546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f80c2710 0x7f08f8157f50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009dc0 tx=0x7f08f002bfa0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 -- 172.21.15.157:0/408169546 shutdown_connections 2023-12-16T01:25:22.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 --2- 172.21.15.157:0/408169546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f80c2710 0x7f08f8157f50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 -- 172.21.15.157:0/408169546 >> 172.21.15.157:0/408169546 conn(0x7f08f8061100 msgr2=0x7f08f80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:22.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 -- 172.21.15.157:0/408169546 shutdown_connections 2023-12-16T01:25:22.801 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.799+0000 7f08fcfd5640 1 -- 172.21.15.157:0/408169546 wait complete. 2023-12-16T01:25:22.801 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.800+0000 7f9e4164c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T01:25:22.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.801+0000 7f08fcfd5640 1 Processor -- start 2023-12-16T01:25:22.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.801+0000 7f08fcfd5640 1 -- start start 2023-12-16T01:25:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.802+0000 7f08fcfd5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 0x7f08f81497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.802+0000 7f08fcfd5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08f80c2710 0x7f08f81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.802+0000 7f08fcfd5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f8151630 0x7f08f8159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.802+0000 7f08fcfd5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8155970 con 0x7f08f80c2710 2023-12-16T01:25:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.802+0000 7f08fcfd5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f81edea0 con 0x7f08f8151630 2023-12-16T01:25:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.802+0000 7f08fcfd5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f81ed900 con 0x7f08f806f590 2023-12-16T01:25:22.804 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.803+0000 7f08f659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 0x7f08f81497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.804 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.803+0000 7f08effff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08f80c2710 0x7f08f81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.804 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.803+0000 7f08f6d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f8151630 0x7f08f8159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:22.804 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.803+0000 7f08f659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 0x7f08f81497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:57024/0 (socket says 172.21.15.157:57024) 2023-12-16T01:25:22.804 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.803+0000 7f08f659c640 1 -- 172.21.15.157:0/3730299199 learned_addr learned my addr 172.21.15.157:0/3730299199 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:22.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.807+0000 7f08f659c640 1 -- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f8151630 msgr2=0x7f08f8159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.807+0000 7f08f659c640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f8151630 0x7f08f8159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.807+0000 7f08f659c640 1 -- 172.21.15.157:0/3730299199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08f80c2710 msgr2=0x7f08f81598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:22.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.807+0000 7f08f659c640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08f80c2710 0x7f08f81598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:22.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.807+0000 7f08f659c640 1 -- 172.21.15.157:0/3730299199 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009a70 con 0x7f08f806f590 2023-12-16T01:25:22.810 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.810+0000 7f08f659c640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 0x7f08f81497d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c430 tx=0x7f08e800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.814+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8005ce0 con 0x7f08f806f590 2023-12-16T01:25:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.814+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8005e40 con 0x7f08f806f590 2023-12-16T01:25:22.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.814+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f81edbc0 con 0x7f08f806f590 2023-12-16T01:25:22.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.814+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80072f0 con 0x7f08f806f590 2023-12-16T01:25:22.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.814+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f8156c80 con 0x7f08f806f590 2023-12-16T01:25:22.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.815+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f814ad30 con 0x7f08f806f590 2023-12-16T01:25:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.816+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08e801c440 con 0x7f08f806f590 2023-12-16T01:25:22.857 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.856+0000 7f9e4164c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T01:25:22.908 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:22.908+0000 7f9e4164c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T01:25:22.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.933+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f08e80127b0 con 0x7f08f806f590 2023-12-16T01:25:22.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:22.933+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f08f814ad30 con 0x7f08f806f590 2023-12-16T01:25:23.010 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.010+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "504aafdb-9fe3-4f96-8b14-b5eda7556a40", "id": 1} v 0) v1 -- 0x7f08f80740e0 con 0x7f08f806f590 2023-12-16T01:25:23.049 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:23.048+0000 7f05f7a44040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-16T01:25:23.116 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.115+0000 7f08eeffd640 1 -- 172.21.15.157:0/3730299199 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "504aafdb-9fe3-4f96-8b14-b5eda7556a40", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f08e8017070 con 0x7f08f806f590 2023-12-16T01:25:23.116 INFO:teuthology.orchestra.run.smithi157.stdout:1 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 msgr2=0x7f08f81497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 0x7f08f81497d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c430 tx=0x7f08e800c8f0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 shutdown_connections 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f8151630 0x7f08f8159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08f80c2710 0x7f08f81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 --2- 172.21.15.157:0/3730299199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08f806f590 0x7f08f81497d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 >> 172.21.15.157:0/3730299199 conn(0x7f08f8061100 msgr2=0x7f08f80c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:23.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 shutdown_connections 2023-12-16T01:25:23.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.116+0000 7f08fcfd5640 1 -- 172.21.15.157:0/3730299199 wait complete. 2023-12-16T01:25:23.128 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 6e0e9a98-e924-4263-8a14-d6bba7540b9f 2 2023-12-16T01:25:23.188 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:23.188+0000 7f05f7a44040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T01:25:23.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.229+0000 7ff8e3fde640 1 Processor -- start 2023-12-16T01:25:23.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.229+0000 7ff8e3fde640 1 -- start start 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.230+0000 7ff8e3fde640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8dc0cd6a0 0x7ff8dc0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.230+0000 7ff8e3fde640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff8dc0ca0c0 0x7ff8dc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.230+0000 7ff8e3fde640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc06f870 con 0x7ff8dc1537e0 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.230+0000 7ff8e3fde640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc159600 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.230+0000 7ff8e3fde640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0cdaf0 con 0x7ff8dc0cd6a0 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.231+0000 7ff8e1579640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8dc0cd6a0 0x7ff8dc0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.231+0000 7ff8e257b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff8dc0ca0c0 0x7ff8dc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.231+0000 7ff8e257b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff8dc0ca0c0 0x7ff8dc159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.157:45806/0 (socket says 172.21.15.157:45806) 2023-12-16T01:25:23.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.231+0000 7ff8e257b640 1 -- 172.21.15.157:0/2411479807 learned_addr learned my addr 172.21.15.157:0/2411479807 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:23.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.234+0000 7ff8e257b640 1 -- 172.21.15.157:0/2411479807 >> v2:172.21.15.157:3300/0 conn(0x7ff8dc0cd6a0 msgr2=0x7ff8dc0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:23.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.234+0000 7ff8e257b640 1 --2- 172.21.15.157:0/2411479807 >> v2:172.21.15.157:3300/0 conn(0x7ff8dc0cd6a0 0x7ff8dc0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.234+0000 7ff8e257b640 1 -- 172.21.15.157:0/2411479807 >> v1:172.21.15.157:6789/0 conn(0x7ff8dc1537e0 legacy=0x7ff8dc0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:23.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.234+0000 7ff8e257b640 1 -- 172.21.15.157:0/2411479807 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc15cd90 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.236+0000 7ff8e257b640 1 --2- 172.21.15.157:0/2411479807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc159a50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0ca750 tx=0x7ff8d402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a080a76fbae1268e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.240+0000 7ff8e0d78640 1 -- 172.21.15.157:0/2411479807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d402cb20 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.240+0000 7ff8e0d78640 1 -- 172.21.15.157:0/2411479807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d402cc80 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.240+0000 7ff8e0d78640 1 -- 172.21.15.157:0/2411479807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40343f0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2411479807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 msgr2=0x7ff8dc159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2411479807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc159a50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0ca750 tx=0x7ff8d402bf80 comp rx=0 tx=0).stop 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2411479807 shutdown_connections 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2411479807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc159a50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2411479807 >> v2:172.21.15.157:3300/0 conn(0x7ff8dc0cd6a0 0x7ff8dc0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2411479807 >> 172.21.15.157:0/2411479807 conn(0x7ff8dc061100 msgr2=0x7ff8dc0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2411479807 shutdown_connections 2023-12-16T01:25:23.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.241+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2411479807 wait complete. 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.242+0000 7ff8e3fde640 1 Processor -- start 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.242+0000 7ff8e3fde640 1 -- start start 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e3fde640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e3fde640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8dc0cd6a0 0x7ff8dc0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e3fde640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8dc1537e0 0x7ff8dc0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e3fde640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0c5300 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e3fde640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1f2bb0 con 0x7ff8dc1537e0 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e3fde640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0ccdb0 con 0x7ff8dc0cd6a0 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e1579640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8dc0cd6a0 0x7ff8dc0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e257b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8dc1537e0 0x7ff8dc0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.243+0000 7ff8e1d7a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.244+0000 7ff8e1579640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8dc0cd6a0 0x7ff8dc0cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:57034/0 (socket says 172.21.15.157:57034) 2023-12-16T01:25:23.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.244+0000 7ff8e1579640 1 -- 172.21.15.157:0/2689335224 learned_addr learned my addr 172.21.15.157:0/2689335224 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:23.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.247+0000 7ff8e1d7a640 1 -- 172.21.15.157:0/2689335224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8dc0cd6a0 msgr2=0x7ff8dc0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.247+0000 7ff8e1d7a640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8dc0cd6a0 0x7ff8dc0cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.247+0000 7ff8e1d7a640 1 -- 172.21.15.157:0/2689335224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8dc1537e0 msgr2=0x7ff8dc0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.247+0000 7ff8e1d7a640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8dc1537e0 0x7ff8dc0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.247+0000 7ff8e1d7a640 1 -- 172.21.15.157:0/2689335224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009b30 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.249+0000 7ff8e1d7a640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc0c6690 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c440 tx=0x7ff8d800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.252+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80035f0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.252+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8003770 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.252+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8003b20 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.252+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc0c6de0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.252+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc0c4cb0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.253+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0c4af0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.256+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff8d801c440 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.256+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff8d801b7d0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.353 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:23.352+0000 7f9e4164c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-16T01:25:23.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.371+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7ff8d8017070 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.444+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e0e9a98-e924-4263-8a14-d6bba7540b9f", "id": 2} v 0) v1 -- 0x7ff8dc0740e0 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.491+0000 7ff8d27fc640 1 -- 172.21.15.157:0/2689335224 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e0e9a98-e924-4263-8a14-d6bba7540b9f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff8d801b990 con 0x7ff8dc0ca0c0 2023-12-16T01:25:23.492 INFO:teuthology.orchestra.run.smithi157.stdout:2 2023-12-16T01:25:23.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 msgr2=0x7ff8dc0c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc0c6690 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c440 tx=0x7ff8d800c840 comp rx=0 tx=0).stop 2023-12-16T01:25:23.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 shutdown_connections 2023-12-16T01:25:23.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8dc1537e0 0x7ff8dc0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8dc0cd6a0 0x7ff8dc0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 --2- 172.21.15.157:0/2689335224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8dc0ca0c0 0x7ff8dc0c6690 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 >> 172.21.15.157:0/2689335224 conn(0x7ff8dc061100 msgr2=0x7ff8dc0c2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 shutdown_connections 2023-12-16T01:25:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.492+0000 7ff8e3fde640 1 -- 172.21.15.157:0/2689335224 wait complete. 2023-12-16T01:25:23.494 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:23.493+0000 7f9e4164c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T01:25:23.504 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 18bbf077-7854-4d6c-8c48-325481bdc479 3 2023-12-16T01:25:23.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.604+0000 7feae5a36640 1 Processor -- start 2023-12-16T01:25:23.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.604+0000 7feae5a36640 1 -- start start 2023-12-16T01:25:23.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.605+0000 7feae5a36640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feae006c270 0x7feae00c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.605+0000 7feae5a36640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae015a0d0 con 0x7feae00cd230 2023-12-16T01:25:23.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.605+0000 7feae5a36640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae006b6b0 con 0x7feae00cd610 2023-12-16T01:25:23.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.605+0000 7feae5a36640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae00c8db0 con 0x7feae006c270 2023-12-16T01:25:23.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.606+0000 7feadf7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feae006c270 0x7feae00c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.606+0000 7feade7fc640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7feae00cd610 0x7feae0153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:52786/0 (socket says 172.21.15.157:52786) 2023-12-16T01:25:23.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.606+0000 7feade7fc640 1 -- 172.21.15.157:0/4107000032 learned_addr learned my addr 172.21.15.157:0/4107000032 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-12-16T01:25:23.608 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:23.608+0000 7f9e4164c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T01:25:23.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.608+0000 7feaddffb640 1 -- 172.21.15.157:0/4107000032 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772453644 0 0) 0x7feae006b6b0 con 0x7feae00cd610 2023-12-16T01:25:23.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.608+0000 7feaddffb640 1 -- 172.21.15.157:0/4107000032 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac8003520 con 0x7feae00cd610 2023-12-16T01:25:23.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.609+0000 7feadf7fe640 1 -- 172.21.15.157:0/4107000032 >> v1:172.21.15.157:6789/0 conn(0x7feae00cd610 legacy=0x7feae0153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.609+0000 7feadf7fe640 1 -- 172.21.15.157:0/4107000032 >> v1:172.21.15.107:6789/0 conn(0x7feae00cd230 legacy=0x7feae006bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.609+0000 7feadf7fe640 1 -- 172.21.15.157:0/4107000032 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae015a5e0 con 0x7feae006c270 2023-12-16T01:25:23.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.612+0000 7feadf7fe640 1 --2- 172.21.15.157:0/4107000032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae006c270 0x7feae00c8870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e715c520f02e9db6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:23.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.615+0000 7feaddffb640 1 -- 172.21.15.157:0/4107000032 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead802cd80 con 0x7feae006c270 2023-12-16T01:25:23.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.615+0000 7feaddffb640 1 -- 172.21.15.157:0/4107000032 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8034440 con 0x7feae006c270 2023-12-16T01:25:23.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.615+0000 7feaddffb640 1 -- 172.21.15.157:0/4107000032 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80347d0 con 0x7feae006c270 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 -- 172.21.15.157:0/4107000032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae006c270 msgr2=0x7feae00c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 --2- 172.21.15.157:0/4107000032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae006c270 0x7feae00c8870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802bfd0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 -- 172.21.15.157:0/4107000032 shutdown_connections 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 --2- 172.21.15.157:0/4107000032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae006c270 0x7feae00c8870 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 -- 172.21.15.157:0/4107000032 >> 172.21.15.157:0/4107000032 conn(0x7feae0061100 msgr2=0x7feae00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 -- 172.21.15.157:0/4107000032 shutdown_connections 2023-12-16T01:25:23.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.616+0000 7feae5a36640 1 -- 172.21.15.157:0/4107000032 wait complete. 2023-12-16T01:25:23.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.617+0000 7feae5a36640 1 Processor -- start 2023-12-16T01:25:23.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.617+0000 7feae5a36640 1 -- start start 2023-12-16T01:25:23.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feae5a36640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feae006c270 0x7feae01efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feae5a36640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae00cd230 0x7feae014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feae5a36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae00cd610 0x7feae015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feae5a36640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0156c80 con 0x7feae00cd610 2023-12-16T01:25:23.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feae5a36640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00715f0 con 0x7feae00cd230 2023-12-16T01:25:23.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feae5a36640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae01f03c0 con 0x7feae006c270 2023-12-16T01:25:23.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feade7fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae00cd230 0x7feae014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.618+0000 7feadeffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feae006c270 0x7feae01efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.619+0000 7feadf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae00cd610 0x7feae015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.619+0000 7feadeffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feae006c270 0x7feae01efe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:57050/0 (socket says 172.21.15.157:57050) 2023-12-16T01:25:23.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.619+0000 7feadeffd640 1 -- 172.21.15.157:0/311674012 learned_addr learned my addr 172.21.15.157:0/311674012 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:23.621 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:23.621+0000 7f05f7a44040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T01:25:23.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.622+0000 7feadf7fe640 1 -- 172.21.15.157:0/311674012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feae006c270 msgr2=0x7feae01efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.622+0000 7feadf7fe640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feae006c270 0x7feae01efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.622+0000 7feadf7fe640 1 -- 172.21.15.157:0/311674012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae00cd230 msgr2=0x7feae014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.622+0000 7feadf7fe640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae00cd230 0x7feae014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.622+0000 7feadf7fe640 1 -- 172.21.15.157:0/311674012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009a70 con 0x7feae00cd610 2023-12-16T01:25:23.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.624+0000 7feadf7fe640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae00cd610 0x7feae015cb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fead8033000 tx=0x7fead8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:23.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.628+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8009490 con 0x7feae00cd610 2023-12-16T01:25:23.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.628+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8040650 con 0x7feae00cd610 2023-12-16T01:25:23.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.628+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8040a00 con 0x7feae00cd610 2023-12-16T01:25:23.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.628+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae01552e0 con 0x7feae00cd610 2023-12-16T01:25:23.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.628+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae015d410 con 0x7feae00cd610 2023-12-16T01:25:23.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.629+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae0155470 con 0x7feae00cd610 2023-12-16T01:25:23.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.632+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fead8052430 con 0x7feae00cd610 2023-12-16T01:25:23.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.632+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fead803e890 con 0x7feae00cd610 2023-12-16T01:25:23.659 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:23.658+0000 7f9e4164c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T01:25:23.669 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:23.668+0000 7f05f7a44040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T01:25:23.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.729+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fead8044020 con 0x7feae00cd610 2023-12-16T01:25:23.762 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:23.761+0000 7f9e4164c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T01:25:23.769 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:23.768+0000 7f05f7a44040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T01:25:23.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.803+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "18bbf077-7854-4d6c-8c48-325481bdc479", "id": 3} v 0) v1 -- 0x7feae00740e0 con 0x7feae00cd610 2023-12-16T01:25:23.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.850+0000 7feac7fff640 1 -- 172.21.15.157:0/311674012 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18bbf077-7854-4d6c-8c48-325481bdc479", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fead8039070 con 0x7feae00cd610 2023-12-16T01:25:23.851 INFO:teuthology.orchestra.run.smithi157.stdout:3 2023-12-16T01:25:23.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae00cd610 msgr2=0x7feae015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae00cd610 0x7feae015cb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fead8033000 tx=0x7fead8004a40 comp rx=0 tx=0).stop 2023-12-16T01:25:23.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 shutdown_connections 2023-12-16T01:25:23.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feae00cd610 0x7feae015cb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae00cd230 0x7feae014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 --2- 172.21.15.157:0/311674012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feae006c270 0x7feae01efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 >> 172.21.15.157:0/311674012 conn(0x7feae0061100 msgr2=0x7feae00738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:23.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 shutdown_connections 2023-12-16T01:25:23.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.851+0000 7feae5a36640 1 -- 172.21.15.157:0/311674012 wait complete. 2023-12-16T01:25:23.863 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 43c33869-4c2b-42c8-9273-35b75f1fa0e4 4 2023-12-16T01:25:23.867 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:23.867+0000 7f05f7a44040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T01:25:23.878 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:23.877+0000 7f9e4164c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T01:25:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.964+0000 7f153bea2640 1 Processor -- start 2023-12-16T01:25:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.964+0000 7f153bea2640 1 -- start start 2023-12-16T01:25:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.965+0000 7f153bea2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 0x7f153406e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.965+0000 7f153bea2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f153415d0d0 0x7f153415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.965+0000 7f153bea2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153406e8b0 con 0x7f1534153a60 2023-12-16T01:25:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.965+0000 7f153bea2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153406d6b0 con 0x7f153415d0d0 2023-12-16T01:25:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.965+0000 7f153bea2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153415da60 con 0x7f153415a050 2023-12-16T01:25:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.966+0000 7f153a43f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f153415d0d0 0x7f153415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.966+0000 7f153943d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 0x7f153406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.966+0000 7f153943d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 0x7f153406e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:57056/0 (socket says 172.21.15.157:57056) 2023-12-16T01:25:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.966+0000 7f153943d640 1 -- 172.21.15.157:0/1083172077 learned_addr learned my addr 172.21.15.157:0/1083172077 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.969+0000 7f153943d640 1 -- 172.21.15.157:0/1083172077 >> v2:172.21.15.157:3300/0 conn(0x7f153415d0d0 msgr2=0x7f153415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.969+0000 7f153943d640 1 --2- 172.21.15.157:0/1083172077 >> v2:172.21.15.157:3300/0 conn(0x7f153415d0d0 0x7f153415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.969+0000 7f153943d640 1 -- 172.21.15.157:0/1083172077 >> v1:172.21.15.157:6789/0 conn(0x7f1534153a60 legacy=0x7f15340c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.969+0000 7f153943d640 1 -- 172.21.15.157:0/1083172077 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153415a4b0 con 0x7f153415a050 2023-12-16T01:25:23.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.971+0000 7f153943d640 1 --2- 172.21.15.157:0/1083172077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 0x7f153406e370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1524009870 tx=0x7f152402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d580aef89284cd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:23.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.975+0000 7f1538c3c640 1 -- 172.21.15.157:0/1083172077 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524030840 con 0x7f153415a050 2023-12-16T01:25:23.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.975+0000 7f1538c3c640 1 -- 172.21.15.157:0/1083172077 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15240309a0 con 0x7f153415a050 2023-12-16T01:25:23.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.975+0000 7f1538c3c640 1 -- 172.21.15.157:0/1083172077 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524030d30 con 0x7f153415a050 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 -- 172.21.15.157:0/1083172077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 msgr2=0x7f153406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 --2- 172.21.15.157:0/1083172077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 0x7f153406e370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1524009870 tx=0x7f152402b980 comp rx=0 tx=0).stop 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 -- 172.21.15.157:0/1083172077 shutdown_connections 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 --2- 172.21.15.157:0/1083172077 >> v2:172.21.15.157:3300/0 conn(0x7f153415d0d0 0x7f153415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 --2- 172.21.15.157:0/1083172077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415a050 0x7f153406e370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 -- 172.21.15.157:0/1083172077 >> 172.21.15.157:0/1083172077 conn(0x7f153406fa90 msgr2=0x7f153406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 -- 172.21.15.157:0/1083172077 shutdown_connections 2023-12-16T01:25:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.976+0000 7f153bea2640 1 -- 172.21.15.157:0/1083172077 wait complete. 2023-12-16T01:25:23.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 Processor -- start 2023-12-16T01:25:23.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 -- start start 2023-12-16T01:25:23.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 0x7f15341f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415a050 0x7f15341469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415d0d0 0x7f1534146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:23.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15341481e0 con 0x7f153415a050 2023-12-16T01:25:23.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15341e69c0 con 0x7f1534153a60 2023-12-16T01:25:23.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.978+0000 7f153bea2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15341f3600 con 0x7f153415d0d0 2023-12-16T01:25:23.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.980+0000 7f1539c3e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 0x7f15341f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.981+0000 7f1539c3e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 0x7f15341f2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58628/0 (socket says 172.21.15.157:58628) 2023-12-16T01:25:23.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.981+0000 7f1539c3e640 1 -- 172.21.15.157:0/4176879508 learned_addr learned my addr 172.21.15.157:0/4176879508 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.985+0000 7f153943d640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415a050 0x7f15341469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.985+0000 7f1539c3e640 1 -- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415d0d0 msgr2=0x7f1534146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.985+0000 7f1539c3e640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415d0d0 0x7f1534146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.985+0000 7f1539c3e640 1 -- 172.21.15.157:0/4176879508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415a050 msgr2=0x7f15341469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.985+0000 7f1539c3e640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415a050 0x7f15341469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.985+0000 7f1539c3e640 1 -- 172.21.15.157:0/4176879508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240094d0 con 0x7f1534153a60 2023-12-16T01:25:23.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:23.988+0000 7f1539c3e640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 0x7f15341f2cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c7a0 tx=0x7f152c00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:24.011 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:24.011+0000 7f05f7a44040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T01:25:24.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.020+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c003d80 con 0x7f1534153a60 2023-12-16T01:25:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.021+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c005070 con 0x7f1534153a60 2023-12-16T01:25:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.021+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15341f0010 con 0x7f1534153a60 2023-12-16T01:25:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.021+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c005460 con 0x7f1534153a60 2023-12-16T01:25:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.021+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1534148430 con 0x7f1534153a60 2023-12-16T01:25:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.022+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15340740e0 con 0x7f1534153a60 2023-12-16T01:25:24.045 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:24.044+0000 7f9e4164c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T01:25:24.055 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:24.054+0000 7f05f7a44040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T01:25:24.089 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:24.088+0000 7f9e4164c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T01:25:24.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.125+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f152c00a640 con 0x7f1534153a60 2023-12-16T01:25:24.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.125+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f152c0118b0 con 0x7f1534153a60 2023-12-16T01:25:24.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.126+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f152c017070 con 0x7f1534153a60 2023-12-16T01:25:24.193 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:24.192+0000 7f05f7a44040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T01:25:24.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.195+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43c33869-4c2b-42c8-9273-35b75f1fa0e4", "id": 4} v 0) v1 -- 0x7f1534148620 con 0x7f1534153a60 2023-12-16T01:25:24.233 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:24.232+0000 7f9e4164c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T01:25:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.269+0000 7f152a7fc640 1 -- 172.21.15.157:0/4176879508 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43c33869-4c2b-42c8-9273-35b75f1fa0e4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f152c00ac00 con 0x7f1534153a60 2023-12-16T01:25:24.270 INFO:teuthology.orchestra.run.smithi157.stdout:4 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 msgr2=0x7f15341f2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 0x7f15341f2cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c7a0 tx=0x7f152c00cc60 comp rx=0 tx=0).stop 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 shutdown_connections 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f153415d0d0 0x7f1534146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415a050 0x7f15341469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 --2- 172.21.15.157:0/4176879508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534153a60 0x7f15341f2cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 >> 172.21.15.157:0/4176879508 conn(0x7f153406fa90 msgr2=0x7f15340c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 shutdown_connections 2023-12-16T01:25:24.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.270+0000 7f153bea2640 1 -- 172.21.15.157:0/4176879508 wait complete. 2023-12-16T01:25:24.281 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2 5 2023-12-16T01:25:24.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.422+0000 7fa181ecf640 1 Processor -- start 2023-12-16T01:25:24.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.422+0000 7fa181ecf640 1 -- start start 2023-12-16T01:25:24.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.422+0000 7fa181ecf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa17c151510 0x7fa17c06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.422+0000 7fa181ecf640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c157350 con 0x7fa17c151130 2023-12-16T01:25:24.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.422+0000 7fa181ecf640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0c8a20 con 0x7fa17c0b2060 2023-12-16T01:25:24.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.422+0000 7fa181ecf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c1576a0 con 0x7fa17c151510 2023-12-16T01:25:24.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.423+0000 7fa17bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa17c151510 0x7fa17c06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.423+0000 7fa17b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa17c151130 0x7fa17c157ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.157:57812/0 (socket says 172.21.15.157:57812) 2023-12-16T01:25:24.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.423+0000 7fa17b7fe640 1 -- 172.21.15.157:0/1742022807 learned_addr learned my addr 172.21.15.157:0/1742022807 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-12-16T01:25:24.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.425+0000 7fa17a7fc640 1 -- 172.21.15.157:0/1742022807 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821095049 0 0) 0x7fa17c157350 con 0x7fa17c151130 2023-12-16T01:25:24.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.425+0000 7fa17a7fc640 1 -- 172.21.15.157:0/1742022807 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa168003520 con 0x7fa17c151130 2023-12-16T01:25:24.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.426+0000 7fa17bfff640 1 -- 172.21.15.157:0/1742022807 >> v1:172.21.15.157:6789/0 conn(0x7fa17c0b2060 legacy=0x7fa17c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:24.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.426+0000 7fa17bfff640 1 -- 172.21.15.157:0/1742022807 >> v1:172.21.15.107:6789/0 conn(0x7fa17c151130 legacy=0x7fa17c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.426+0000 7fa17bfff640 1 -- 172.21.15.157:0/1742022807 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0c8ce0 con 0x7fa17c151510 2023-12-16T01:25:24.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.428+0000 7fa17bfff640 1 --2- 172.21.15.157:0/1742022807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151510 0x7fa17c06f4d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa174009d90 tx=0x7fa17402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8128c402b2184040 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:24.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.432+0000 7fa17a7fc640 1 -- 172.21.15.157:0/1742022807 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17402cc60 con 0x7fa17c151510 2023-12-16T01:25:24.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.432+0000 7fa17a7fc640 1 -- 172.21.15.157:0/1742022807 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17402cdc0 con 0x7fa17c151510 2023-12-16T01:25:24.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.432+0000 7fa17a7fc640 1 -- 172.21.15.157:0/1742022807 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174034660 con 0x7fa17c151510 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 -- 172.21.15.157:0/1742022807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151510 msgr2=0x7fa17c06f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 --2- 172.21.15.157:0/1742022807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151510 0x7fa17c06f4d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa174009d90 tx=0x7fa17402beb0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 -- 172.21.15.157:0/1742022807 shutdown_connections 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 --2- 172.21.15.157:0/1742022807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151510 0x7fa17c06f4d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 -- 172.21.15.157:0/1742022807 >> 172.21.15.157:0/1742022807 conn(0x7fa17c061100 msgr2=0x7fa17c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 -- 172.21.15.157:0/1742022807 shutdown_connections 2023-12-16T01:25:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.433+0000 7fa181ecf640 1 -- 172.21.15.157:0/1742022807 wait complete. 2023-12-16T01:25:24.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.434+0000 7fa181ecf640 1 Processor -- start 2023-12-16T01:25:24.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 -- start start 2023-12-16T01:25:24.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 0x7fa17c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151130 0x7fa17c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa17c151510 0x7fa17c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c154200 con 0x7fa17c0b2060 2023-12-16T01:25:24.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1f36e0 con 0x7fa17c151130 2023-12-16T01:25:24.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.435+0000 7fa181ecf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1f2b60 con 0x7fa17c151510 2023-12-16T01:25:24.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.436+0000 7fa17bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa17c151510 0x7fa17c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.436+0000 7fa17affd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151130 0x7fa17c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.436+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 0x7fa17c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.436+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 0x7fa17c15a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.157:45874/0 (socket says 172.21.15.157:45874) 2023-12-16T01:25:24.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.436+0000 7fa17b7fe640 1 -- 172.21.15.157:0/3909921874 learned_addr learned my addr 172.21.15.157:0/3909921874 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:24.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.439+0000 7fa17b7fe640 1 -- 172.21.15.157:0/3909921874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa17c151510 msgr2=0x7fa17c154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.439+0000 7fa17b7fe640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa17c151510 0x7fa17c154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.439+0000 7fa17b7fe640 1 -- 172.21.15.157:0/3909921874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151130 msgr2=0x7fa17c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.439+0000 7fa17b7fe640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151130 0x7fa17c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.439+0000 7fa17b7fe640 1 -- 172.21.15.157:0/3909921874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174009a70 con 0x7fa17c0b2060 2023-12-16T01:25:24.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.441+0000 7fa17b7fe640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 0x7fa17c15a020 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c410 tx=0x7fa16400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.445+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164005ce0 con 0x7fa17c0b2060 2023-12-16T01:25:24.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.445+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164005e40 con 0x7fa17c0b2060 2023-12-16T01:25:24.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.445+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640072f0 con 0x7fa17c0b2060 2023-12-16T01:25:24.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.445+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c1f2e40 con 0x7fa17c0b2060 2023-12-16T01:25:24.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.445+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c1f3400 con 0x7fa17c0b2060 2023-12-16T01:25:24.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.446+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c0b1250 con 0x7fa17c0b2060 2023-12-16T01:25:24.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.448+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa16401c440 con 0x7fa17c0b2060 2023-12-16T01:25:24.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.448+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa16401b930 con 0x7fa17c0b2060 2023-12-16T01:25:24.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.546+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fa164017070 con 0x7fa17c0b2060 2023-12-16T01:25:24.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.618+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2", "id": 5} v 0) v1 -- 0x7fa17c0740e0 con 0x7fa17c0b2060 2023-12-16T01:25:24.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.663+0000 7fa173fff640 1 -- 172.21.15.157:0/3909921874 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa16401bcd0 con 0x7fa17c0b2060 2023-12-16T01:25:24.666 INFO:teuthology.orchestra.run.smithi157.stdout:5 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 msgr2=0x7fa17c15a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 0x7fa17c15a020 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c410 tx=0x7fa16400c8d0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 shutdown_connections 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa17c151510 0x7fa17c154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa17c151130 0x7fa17c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 --2- 172.21.15.157:0/3909921874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa17c0b2060 0x7fa17c15a020 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 >> 172.21.15.157:0/3909921874 conn(0x7fa17c061100 msgr2=0x7fa17c0c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 shutdown_connections 2023-12-16T01:25:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.664+0000 7fa181ecf640 1 -- 172.21.15.157:0/3909921874 wait complete. 2023-12-16T01:25:24.677 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new b7937a61-86f5-44bf-9baf-5481f99b8821 6 2023-12-16T01:25:24.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.780+0000 7f0ec583d640 1 Processor -- start 2023-12-16T01:25:24.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.780+0000 7f0ec583d640 1 -- start start 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.781+0000 7f0ec583d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ec0153890 0x7f0ec015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.781+0000 7f0ec583d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ec0153c70 0x7f0ec00c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.781+0000 7f0ec583d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec015a700 con 0x7f0ec00ceef0 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.781+0000 7f0ec583d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00ca870 con 0x7f0ec0153890 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.781+0000 7f0ec583d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec0159af0 con 0x7f0ec0153c70 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.782+0000 7f0ebe7fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ec0153c70 0x7f0ec00c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.782+0000 7f0ebeffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ec0153890 0x7f0ec015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.782+0000 7f0ebeffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ec0153890 0x7f0ec015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.157:45876/0 (socket says 172.21.15.157:45876) 2023-12-16T01:25:24.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.782+0000 7f0ebeffd640 1 -- 172.21.15.157:0/2629147605 learned_addr learned my addr 172.21.15.157:0/2629147605 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:24.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.784+0000 7f0ebe7fc640 1 -- 172.21.15.157:0/2629147605 >> v2:172.21.15.107:3300/0 conn(0x7f0ec0153890 msgr2=0x7f0ec015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:24.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.784+0000 7f0ebe7fc640 1 --2- 172.21.15.157:0/2629147605 >> v2:172.21.15.107:3300/0 conn(0x7f0ec0153890 0x7f0ec015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.784+0000 7f0ebe7fc640 1 -- 172.21.15.157:0/2629147605 >> v1:172.21.15.107:6789/0 conn(0x7f0ec00ceef0 legacy=0x7f0ec015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.784+0000 7f0ebe7fc640 1 -- 172.21.15.157:0/2629147605 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0159dd0 con 0x7f0ec0153c70 2023-12-16T01:25:24.786 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.786+0000 7f0ebe7fc640 1 --2- 172.21.15.157:0/2629147605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec00c9fe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00c6290 tx=0x7f0eb402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ebab886ce822d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:24.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.788+0000 7f0ebdffb640 1 -- 172.21.15.157:0/2629147605 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4030610 con 0x7f0ec0153c70 2023-12-16T01:25:24.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.789+0000 7f0ebdffb640 1 -- 172.21.15.157:0/2629147605 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4030770 con 0x7f0ec0153c70 2023-12-16T01:25:24.790 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.789+0000 7f0ebdffb640 1 -- 172.21.15.157:0/2629147605 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4030b00 con 0x7f0ec0153c70 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 -- 172.21.15.157:0/2629147605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 msgr2=0x7f0ec00c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 --2- 172.21.15.157:0/2629147605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec00c9fe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00c6290 tx=0x7f0eb402b960 comp rx=0 tx=0).stop 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 -- 172.21.15.157:0/2629147605 shutdown_connections 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 --2- 172.21.15.157:0/2629147605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec00c9fe0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 --2- 172.21.15.157:0/2629147605 >> v2:172.21.15.107:3300/0 conn(0x7f0ec0153890 0x7f0ec015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 -- 172.21.15.157:0/2629147605 >> 172.21.15.157:0/2629147605 conn(0x7f0ec006ba00 msgr2=0x7f0ec006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 -- 172.21.15.157:0/2629147605 shutdown_connections 2023-12-16T01:25:24.791 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.790+0000 7f0ec583d640 1 -- 172.21.15.157:0/2629147605 wait complete. 2023-12-16T01:25:24.792 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.791+0000 7f0ec583d640 1 Processor -- start 2023-12-16T01:25:24.792 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.791+0000 7f0ec583d640 1 -- start start 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ec583d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 0x7f0ec01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ec583d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ec0153890 0x7f0ec0151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ec583d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec0154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ec583d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec014f640 con 0x7f0ec00ceef0 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ec583d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00b4170 con 0x7f0ec0153c70 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ec583d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec014f210 con 0x7f0ec0153890 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ebf7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec0154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.793 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ebeffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 0x7f0ec01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.794 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.792+0000 7f0ebe7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ec0153890 0x7f0ec0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:24.794 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.793+0000 7f0ebeffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 0x7f0ec01f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.157:45892/0 (socket says 172.21.15.157:45892) 2023-12-16T01:25:24.794 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.793+0000 7f0ebeffd640 1 -- 172.21.15.157:0/1852562011 learned_addr learned my addr 172.21.15.157:0/1852562011 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:24.796 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.796+0000 7f0ebeffd640 1 -- 172.21.15.157:0/1852562011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ec0153890 msgr2=0x7f0ec0151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.796 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.796+0000 7f0ebeffd640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ec0153890 0x7f0ec0151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.797 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.796+0000 7f0ebeffd640 1 -- 172.21.15.157:0/1852562011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 msgr2=0x7f0ec0154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:24.797 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.796+0000 7f0ebeffd640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec0154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:24.797 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.796+0000 7f0ebeffd640 1 -- 172.21.15.157:0/1852562011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009400 con 0x7f0ec00ceef0 2023-12-16T01:25:24.798 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.798+0000 7f0ebeffd640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 0x7f0ec01f2b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000efc0 tx=0x7f0eb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:24.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.802+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000cd40 con 0x7f0ec00ceef0 2023-12-16T01:25:24.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.802+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000f040 con 0x7f0ec00ceef0 2023-12-16T01:25:24.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.802+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec014f850 con 0x7f0ec00ceef0 2023-12-16T01:25:24.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.802+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000cea0 con 0x7f0ec00ceef0 2023-12-16T01:25:24.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.802+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec00b4380 con 0x7f0ec00ceef0 2023-12-16T01:25:24.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.803+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec00b4540 con 0x7f0ec00ceef0 2023-12-16T01:25:24.804 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.804+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0eb0014980 con 0x7f0ec00ceef0 2023-12-16T01:25:24.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.805+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0eb0027e30 con 0x7f0ec00ceef0 2023-12-16T01:25:24.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.905+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f0eb0027430 con 0x7f0ec00ceef0 2023-12-16T01:25:24.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:24.976+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7937a61-86f5-44bf-9baf-5481f99b8821", "id": 6} v 0) v1 -- 0x7f0ec0067500 con 0x7f0ec00ceef0 2023-12-16T01:25:25.011 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:25.011+0000 7f05f7a44040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T01:25:25.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.054+0000 7f0ea7fff640 1 -- 172.21.15.157:0/1852562011 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7937a61-86f5-44bf-9baf-5481f99b8821", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0eb0014c30 con 0x7f0ec00ceef0 2023-12-16T01:25:25.055 INFO:teuthology.orchestra.run.smithi157.stdout:6 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 msgr2=0x7f0ec01f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 0x7f0ec01f2b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000efc0 tx=0x7f0eb000c490 comp rx=0 tx=0).stop 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 shutdown_connections 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ec0153c70 0x7f0ec0154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ec0153890 0x7f0ec0151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 --2- 172.21.15.157:0/1852562011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ec00ceef0 0x7f0ec01f2b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 >> 172.21.15.157:0/1852562011 conn(0x7f0ec006ba00 msgr2=0x7f0ec0073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 shutdown_connections 2023-12-16T01:25:25.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.055+0000 7f0ec583d640 1 -- 172.21.15.157:0/1852562011 wait complete. 2023-12-16T01:25:25.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 2d9bda2b-6ae9-4520-b556-ef9009c8da3a 7 2023-12-16T01:25:25.089 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:25.089+0000 7f9e4164c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T01:25:25.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.165+0000 7f3618101640 1 Processor -- start 2023-12-16T01:25:25.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.165+0000 7f3618101640 1 -- start start 2023-12-16T01:25:25.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.166+0000 7f3618101640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f361006f720 0x7f36100c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.166+0000 7f3618101640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3610159ba0 con 0x7f36100c82b0 2023-12-16T01:25:25.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.166+0000 7f3618101640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361015a3e0 con 0x7f361015d600 2023-12-16T01:25:25.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.166+0000 7f3618101640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361015da90 con 0x7f361006f720 2023-12-16T01:25:25.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.166+0000 7f3615e9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f361006f720 0x7f36100c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.166+0000 7f361669e640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f361015d600 0x7f3610163e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:52810/0 (socket says 172.21.15.157:52810) 2023-12-16T01:25:25.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.167+0000 7f361669e640 1 -- 172.21.15.157:0/2594837007 learned_addr learned my addr 172.21.15.157:0/2594837007 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-12-16T01:25:25.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.169+0000 7f3614e9b640 1 -- 172.21.15.157:0/2594837007 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161016448 0 0) 0x7f3610159ba0 con 0x7f36100c82b0 2023-12-16T01:25:25.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.169+0000 7f3614e9b640 1 -- 172.21.15.157:0/2594837007 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35fc003520 con 0x7f36100c82b0 2023-12-16T01:25:25.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.169+0000 7f3615e9d640 1 -- 172.21.15.157:0/2594837007 >> v1:172.21.15.157:6789/0 conn(0x7f361015d600 legacy=0x7f3610163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.169+0000 7f3615e9d640 1 -- 172.21.15.157:0/2594837007 >> v1:172.21.15.107:6789/0 conn(0x7f36100c82b0 legacy=0x7f3610159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.169+0000 7f3614e9b640 1 -- 172.21.15.157:0/2594837007 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495280845 0 0) 0x7f361015a3e0 con 0x7f361015d600 2023-12-16T01:25:25.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.169+0000 7f3615e9d640 1 -- 172.21.15.157:0/2594837007 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610159e20 con 0x7f361006f720 2023-12-16T01:25:25.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.171+0000 7f3615e9d640 1 --2- 172.21.15.157:0/2594837007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f361006f720 0x7f36100c7040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3608009dc0 tx=0x7f360802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513a2b403ef3dc10 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:25.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.175+0000 7f3614e9b640 1 -- 172.21.15.157:0/2594837007 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360802ccd0 con 0x7f361006f720 2023-12-16T01:25:25.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.175+0000 7f3614e9b640 1 -- 172.21.15.157:0/2594837007 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360802ce30 con 0x7f361006f720 2023-12-16T01:25:25.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.175+0000 7f3614e9b640 1 -- 172.21.15.157:0/2594837007 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608034660 con 0x7f361006f720 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 -- 172.21.15.157:0/2594837007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f361006f720 msgr2=0x7f36100c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 --2- 172.21.15.157:0/2594837007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f361006f720 0x7f36100c7040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3608009dc0 tx=0x7f360802bf20 comp rx=0 tx=0).stop 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 -- 172.21.15.157:0/2594837007 shutdown_connections 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 --2- 172.21.15.157:0/2594837007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f361006f720 0x7f36100c7040 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 -- 172.21.15.157:0/2594837007 >> 172.21.15.157:0/2594837007 conn(0x7f36100cbef0 msgr2=0x7f36100cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 -- 172.21.15.157:0/2594837007 shutdown_connections 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.176+0000 7f3618101640 1 -- 172.21.15.157:0/2594837007 wait complete. 2023-12-16T01:25:25.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.177+0000 7f3618101640 1 Processor -- start 2023-12-16T01:25:25.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.177+0000 7f3618101640 1 -- start start 2023-12-16T01:25:25.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3618101640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f361006f720 0x7f361014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3618101640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 0x7f36100cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3618101640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f361015d600 0x7f36100cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3618101640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361014c120 con 0x7f361015d600 2023-12-16T01:25:25.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3618101640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361014c9f0 con 0x7f361006f720 2023-12-16T01:25:25.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3618101640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3610159540 con 0x7f36100c82b0 2023-12-16T01:25:25.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f361569c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 0x7f36100cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f3615e9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f361006f720 0x7f361014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.178+0000 7f361669e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f361015d600 0x7f36100cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.179+0000 7f361569c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 0x7f36100cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:57124/0 (socket says 172.21.15.157:57124) 2023-12-16T01:25:25.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.179+0000 7f361569c640 1 -- 172.21.15.157:0/3063555578 learned_addr learned my addr 172.21.15.157:0/3063555578 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-12-16T01:25:25.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.182+0000 7f361569c640 1 -- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f361006f720 msgr2=0x7f361014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.182+0000 7f361569c640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f361006f720 0x7f361014b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.182+0000 7f361569c640 1 -- 172.21.15.157:0/3063555578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f361015d600 msgr2=0x7f36100cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.182+0000 7f361569c640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f361015d600 0x7f36100cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.182+0000 7f361569c640 1 -- 172.21.15.157:0/3063555578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3608009a70 con 0x7f36100c82b0 2023-12-16T01:25:25.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.185+0000 7f361569c640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 0x7f36100cb390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f360000c430 tx=0x7f360000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:25.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.189+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000052d0 con 0x7f36100c82b0 2023-12-16T01:25:25.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.189+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3600005450 con 0x7f36100c82b0 2023-12-16T01:25:25.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.189+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600003830 con 0x7f36100c82b0 2023-12-16T01:25:25.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.189+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100caf00 con 0x7f36100c82b0 2023-12-16T01:25:25.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.189+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361014d330 con 0x7f36100c82b0 2023-12-16T01:25:25.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.190+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36100cb090 con 0x7f36100c82b0 2023-12-16T01:25:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.287+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3600003c90 con 0x7f36100c82b0 2023-12-16T01:25:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.287+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f360001caa0 con 0x7f36100c82b0 2023-12-16T01:25:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.287+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f3600017070 con 0x7f36100c82b0 2023-12-16T01:25:25.297 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:25.296+0000 7f05f7a44040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T01:25:25.347 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:25.346+0000 7f05f7a44040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T01:25:25.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.358+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d9bda2b-6ae9-4520-b556-ef9009c8da3a", "id": 7} v 0) v1 -- 0x7f36100740e0 con 0x7f36100c82b0 2023-12-16T01:25:25.372 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:25.371+0000 7f9e4164c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T01:25:25.426 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:25.425+0000 7f9e4164c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T01:25:25.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.430+0000 7f36067fc640 1 -- 172.21.15.157:0/3063555578 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d9bda2b-6ae9-4520-b556-ef9009c8da3a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f360001ccb0 con 0x7f36100c82b0 2023-12-16T01:25:25.431 INFO:teuthology.orchestra.run.smithi157.stdout:7 2023-12-16T01:25:25.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 msgr2=0x7f36100cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 0x7f36100cb390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f360000c430 tx=0x7f360000c8f0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 shutdown_connections 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f361015d600 0x7f36100cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36100c82b0 0x7f36100cb390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 --2- 172.21.15.157:0/3063555578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f361006f720 0x7f361014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 >> 172.21.15.157:0/3063555578 conn(0x7f36100cbef0 msgr2=0x7f36100c65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 shutdown_connections 2023-12-16T01:25:25.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-12-16T01:25:25.431+0000 7f3618101640 1 -- 172.21.15.157:0/3063555578 wait complete. 2023-12-16T01:25:25.446 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-16T01:25:25.446 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-12-16T01:25:25.448 INFO:tasks.ceph.osd.0:Started 2023-12-16T01:25:25.448 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-16T01:25:25.448 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-12-16T01:25:25.450 INFO:tasks.ceph.osd.1:Started 2023-12-16T01:25:25.450 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-16T01:25:25.451 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-12-16T01:25:25.453 INFO:tasks.ceph.osd.2:Started 2023-12-16T01:25:25.453 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-16T01:25:25.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-12-16T01:25:25.455 INFO:tasks.ceph.osd.3:Started 2023-12-16T01:25:25.456 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-16T01:25:25.456 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-12-16T01:25:25.458 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:25.458+0000 7f05f7a44040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T01:25:25.488 INFO:tasks.ceph.osd.4:Started 2023-12-16T01:25:25.489 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-16T01:25:25.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-12-16T01:25:25.491 INFO:tasks.ceph.osd.5:Started 2023-12-16T01:25:25.491 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-16T01:25:25.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-12-16T01:25:25.494 INFO:tasks.ceph.osd.6:Started 2023-12-16T01:25:25.494 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-16T01:25:25.494 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-12-16T01:25:25.496 INFO:tasks.ceph.osd.7:Started 2023-12-16T01:25:25.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:25.562 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-12-16T01:25:25.562+0000 7f9e4164c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T01:25:25.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.611+0000 7f67fdc9b640 1 Processor -- start 2023-12-16T01:25:25.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.611+0000 7f67fdc9b640 1 -- start start 2023-12-16T01:25:25.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.612+0000 7f67fdc9b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67f80c82b0 0x7f67f80c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.612+0000 7f67fdc9b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f8159ba0 con 0x7f67f815d600 2023-12-16T01:25:25.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.612+0000 7f67fdc9b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f815a3e0 con 0x7f67f806f720 2023-12-16T01:25:25.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.612+0000 7f67fdc9b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f815da90 con 0x7f67f80c82b0 2023-12-16T01:25:25.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.620+0000 7f67f6ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67f80c82b0 0x7f67f80c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.621+0000 7f67f6ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67f80c82b0 0x7f67f80c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48548/0 (socket says 172.21.15.107:48548) 2023-12-16T01:25:25.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.621+0000 7f67f6ffd640 1 -- 172.21.15.107:0/3605193081 learned_addr learned my addr 172.21.15.107:0/3605193081 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:25.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.625+0000 7f67f6ffd640 1 -- 172.21.15.107:0/3605193081 >> v1:172.21.15.157:6789/0 conn(0x7f67f806f720 legacy=0x7f67f8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:25.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.625+0000 7f67f6ffd640 1 -- 172.21.15.107:0/3605193081 >> v1:172.21.15.107:6789/0 conn(0x7f67f815d600 legacy=0x7f67f8163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.625+0000 7f67f6ffd640 1 -- 172.21.15.107:0/3605193081 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8159e20 con 0x7f67f80c82b0 2023-12-16T01:25:25.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.629+0000 7f67f6ffd640 1 --2- 172.21.15.107:0/3605193081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f80c82b0 0x7f67f80c7040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009870 tx=0x7f67ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767795546ffd29b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:25.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67f67fc640 1 -- 172.21.15.107:0/3605193081 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec030860 con 0x7f67f80c82b0 2023-12-16T01:25:25.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67f67fc640 1 -- 172.21.15.107:0/3605193081 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0309c0 con 0x7f67f80c82b0 2023-12-16T01:25:25.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67f67fc640 1 -- 172.21.15.107:0/3605193081 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec030d50 con 0x7f67f80c82b0 2023-12-16T01:25:25.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3605193081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f80c82b0 msgr2=0x7f67f80c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 --2- 172.21.15.107:0/3605193081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f80c82b0 0x7f67f80c7040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009870 tx=0x7f67ec02b9a0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3605193081 shutdown_connections 2023-12-16T01:25:25.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 --2- 172.21.15.107:0/3605193081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f80c82b0 0x7f67f80c7040 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3605193081 >> 172.21.15.107:0/3605193081 conn(0x7f67f80cbef0 msgr2=0x7f67f80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:25.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3605193081 shutdown_connections 2023-12-16T01:25:25.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.633+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3605193081 wait complete. 2023-12-16T01:25:25.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 Processor -- start 2023-12-16T01:25:25.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 -- start start 2023-12-16T01:25:25.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 0x7f67f81f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67f80c82b0 0x7f67f806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f815d600 0x7f67f80cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:25.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8159200 con 0x7f67f815d600 2023-12-16T01:25:25.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81f06f0 con 0x7f67f80c82b0 2023-12-16T01:25:25.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.635+0000 7f67fdc9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f814f610 con 0x7f67f806f720 2023-12-16T01:25:25.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.636+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 0x7f67f81f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.636+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 0x7f67f81f01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54078/0 (socket says 172.21.15.107:54078) 2023-12-16T01:25:25.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.636+0000 7f67f77fe640 1 -- 172.21.15.107:0/3268230111 learned_addr learned my addr 172.21.15.107:0/3268230111 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:25.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.637+0000 7f67f7fff640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f815d600 0x7f67f80cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:25.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.640+0000 7f67f77fe640 1 -- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67f80c82b0 msgr2=0x7f67f806abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.640+0000 7f67f77fe640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67f80c82b0 0x7f67f806abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.640+0000 7f67f77fe640 1 -- 172.21.15.107:0/3268230111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f815d600 msgr2=0x7f67f80cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:25.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.640+0000 7f67f77fe640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f815d600 0x7f67f80cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:25.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.640+0000 7f67f77fe640 1 -- 172.21.15.107:0/3268230111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0094d0 con 0x7f67f806f720 2023-12-16T01:25:25.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.642+0000 7f67f77fe640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 0x7f67f81f01b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f67e800b3e0 tx=0x7f67e800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:25.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.645+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011830 con 0x7f67f806f720 2023-12-16T01:25:25.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.645+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e80119b0 con 0x7f67f806f720 2023-12-16T01:25:25.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.645+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011d60 con 0x7f67f806f720 2023-12-16T01:25:25.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.645+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f814f8f0 con 0x7f67f806f720 2023-12-16T01:25:25.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.645+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f81e3ab0 con 0x7f67f806f720 2023-12-16T01:25:25.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.646+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f80740e0 con 0x7f67f806f720 2023-12-16T01:25:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.647+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67e8024740 con 0x7f67f806f720 2023-12-16T01:25:25.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.748+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f67e801ad00 con 0x7f67f806f720 2023-12-16T01:25:25.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.753+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f67e8039cf0 con 0x7f67f806f720 2023-12-16T01:25:25.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:25.818+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67f814d620 con 0x7f67f806f720 2023-12-16T01:25:25.908 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:25.907+0000 7f05f22e0640 -1 mgr handle_mgr_map I was active but no longer am 2023-12-16T01:25:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.080+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mgrmap(e 2) v1 ==== 44568+0+0 (secure 0 0 0) 0x7f67e801a630 con 0x7f67f806f720 2023-12-16T01:25:26.082 INFO:tasks.ceph.osd.3.smithi107.stderr:2023-12-16T01:25:26.081+0000 7f5025a10500 -1 Falling back to public interface 2023-12-16T01:25:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.085+0000 7f67dffff640 1 -- 172.21.15.107:0/3268230111 <== mon.2 v2:172.21.15.157:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f67e8021940 con 0x7f67f806f720 2023-12-16T01:25:26.086 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:26.086 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:25.371179+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 msgr2=0x7f67f81f01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 0x7f67f81f01b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f67e800b3e0 tx=0x7f67e800b8a0 comp rx=0 tx=0).stop 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 shutdown_connections 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67f815d600 0x7f67f80cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67f80c82b0 0x7f67f806abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 --2- 172.21.15.107:0/3268230111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67f806f720 0x7f67f81f01b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 >> 172.21.15.107:0/3268230111 conn(0x7f67f80cbef0 msgr2=0x7f67f8152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 shutdown_connections 2023-12-16T01:25:26.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:26.087+0000 7f67fdc9b640 1 -- 172.21.15.107:0/3268230111 wait complete. 2023-12-16T01:25:26.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-12-16T01:25:26.095+0000 7f696bbf7500 -1 Falling back to public interface 2023-12-16T01:25:26.095 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-12-16T01:25:26.095+0000 7fb72cefa500 -1 Falling back to public interface 2023-12-16T01:25:26.102 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-16T01:25:26.102 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-16T01:25:26.125 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-12-16T01:25:26.125+0000 7fd49c41c500 -1 Falling back to public interface 2023-12-16T01:25:26.128 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-12-16T01:25:26.127+0000 7fcbeab0e500 -1 Falling back to public interface 2023-12-16T01:25:26.140 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-12-16T01:25:26.139+0000 7fe71580c500 -1 Falling back to public interface 2023-12-16T01:25:26.140 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-12-16T01:25:26.139+0000 7fcaa10da500 -1 Falling back to public interface 2023-12-16T01:25:26.155 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-12-16T01:25:26.154+0000 7f800ce9c500 -1 Falling back to public interface 2023-12-16T01:25:26.309 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.308+0000 7f1692e4c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T01:25:26.354 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.353+0000 7f1692e4c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T01:25:26.749 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.748+0000 7f1692e4c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T01:25:26.795 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.795+0000 7f1692e4c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T01:25:26.840 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.839+0000 7f1692e4c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T01:25:26.893 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.893+0000 7f1692e4c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T01:25:26.908 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:26.940 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:26.939+0000 7f1692e4c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T01:25:26.999 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.998+0000 7fdc705ea640 1 Processor -- start 2023-12-16T01:25:26.999 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.998+0000 7fdc705ea640 1 -- start start 2023-12-16T01:25:27.000 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.999+0000 7fdc705ea640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc681537c0 0x7fdc6815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:27.000 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.999+0000 7fdc705ea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc680ca9e0 0x7fdc680708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:27.000 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.999+0000 7fdc705ea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680ca460 con 0x7fdc680cadf0 2023-12-16T01:25:27.000 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.999+0000 7fdc705ea640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6815a610 con 0x7fdc681537c0 2023-12-16T01:25:27.001 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:26.999+0000 7fdc705ea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6806b6b0 con 0x7fdc680ca9e0 2023-12-16T01:25:27.001 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.000+0000 7fdc6db85640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc680ca9e0 0x7fdc680708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:27.001 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.000+0000 7fdc6e386640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc681537c0 0x7fdc6815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:27.002 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.000+0000 7fdc6db85640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc680ca9e0 0x7fdc680708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:35128/0 (socket says 172.21.15.107:35128) 2023-12-16T01:25:27.002 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.000+0000 7fdc6db85640 1 -- 172.21.15.107:0/4286509816 learned_addr learned my addr 172.21.15.107:0/4286509816 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:27.003 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.002+0000 7fdc6db85640 1 -- 172.21.15.107:0/4286509816 >> v2:172.21.15.107:3300/0 conn(0x7fdc681537c0 msgr2=0x7fdc6815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:27.003 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.002+0000 7fdc6db85640 1 --2- 172.21.15.107:0/4286509816 >> v2:172.21.15.107:3300/0 conn(0x7fdc681537c0 0x7fdc6815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.003 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.002+0000 7fdc6db85640 1 -- 172.21.15.107:0/4286509816 >> v1:172.21.15.157:6789/0 conn(0x7fdc680cadf0 legacy=0x7fdc680c2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:27.003 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.002+0000 7fdc6db85640 1 -- 172.21.15.107:0/4286509816 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6806b970 con 0x7fdc680ca9e0 2023-12-16T01:25:27.005 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.004+0000 7fdc6db85640 1 --2- 172.21.15.107:0/4286509816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680ca9e0 0x7fdc680708e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc68070540 tx=0x7fdc5802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee21de8a2ac4847 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:27.010 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.009+0000 7fdc6d384640 1 -- 172.21.15.107:0/4286509816 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58030860 con 0x7fdc680ca9e0 2023-12-16T01:25:27.010 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.009+0000 7fdc6d384640 1 -- 172.21.15.107:0/4286509816 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580309c0 con 0x7fdc680ca9e0 2023-12-16T01:25:27.010 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.009+0000 7fdc6d384640 1 -- 172.21.15.107:0/4286509816 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58030d50 con 0x7fdc680ca9e0 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 -- 172.21.15.107:0/4286509816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680ca9e0 msgr2=0x7fdc680708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 --2- 172.21.15.107:0/4286509816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680ca9e0 0x7fdc680708e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc68070540 tx=0x7fdc5802b9a0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 -- 172.21.15.107:0/4286509816 shutdown_connections 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 --2- 172.21.15.107:0/4286509816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680ca9e0 0x7fdc680708e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 --2- 172.21.15.107:0/4286509816 >> v2:172.21.15.107:3300/0 conn(0x7fdc681537c0 0x7fdc6815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 -- 172.21.15.107:0/4286509816 >> 172.21.15.107:0/4286509816 conn(0x7fdc680669f0 msgr2=0x7fdc6806ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 -- 172.21.15.107:0/4286509816 shutdown_connections 2023-12-16T01:25:27.011 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.010+0000 7fdc705ea640 1 -- 172.21.15.107:0/4286509816 wait complete. 2023-12-16T01:25:27.012 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.011+0000 7fdc705ea640 1 Processor -- start 2023-12-16T01:25:27.012 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.011+0000 7fdc705ea640 1 -- start start 2023-12-16T01:25:27.013 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.012+0000 7fdc705ea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc680ca9e0 0x7fdc68149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:27.013 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.012+0000 7fdc705ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 0x7fdc6815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:27.013 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.012+0000 7fdc705ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc681537c0 0x7fdc6815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:27.013 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.012+0000 7fdc705ea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680b2190 con 0x7fdc680ca9e0 2023-12-16T01:25:27.013 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.012+0000 7fdc705ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc681474b0 con 0x7fdc680cadf0 2023-12-16T01:25:27.013 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.012+0000 7fdc705ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815d850 con 0x7fdc681537c0 2023-12-16T01:25:27.014 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.013+0000 7fdc6db85640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 0x7fdc6815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:27.014 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.013+0000 7fdc6e386640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc680ca9e0 0x7fdc68149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:27.014 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.013+0000 7fdc6db85640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 0x7fdc6815ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:35138/0 (socket says 172.21.15.107:35138) 2023-12-16T01:25:27.014 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.013+0000 7fdc6db85640 1 -- 172.21.15.107:0/3362980906 learned_addr learned my addr 172.21.15.107:0/3362980906 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:27.017 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.016+0000 7fdc6db85640 1 -- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc681537c0 msgr2=0x7fdc6815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:27.017 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.016+0000 7fdc6db85640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc681537c0 0x7fdc6815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.017 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.016+0000 7fdc6db85640 1 -- 172.21.15.107:0/3362980906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc680ca9e0 msgr2=0x7fdc68149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:27.017 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.016+0000 7fdc6db85640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc680ca9e0 0x7fdc68149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.017 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.016+0000 7fdc6db85640 1 -- 172.21.15.107:0/3362980906 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580094d0 con 0x7fdc680cadf0 2023-12-16T01:25:27.019 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.019+0000 7fdc6db85640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 0x7fdc6815ab60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc58000c00 tx=0x7fdc58004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:27.023 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.023+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58039c90 con 0x7fdc680cadf0 2023-12-16T01:25:27.024 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.023+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58039df0 con 0x7fdc680cadf0 2023-12-16T01:25:27.024 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.023+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc680b1c60 con 0x7fdc680cadf0 2023-12-16T01:25:27.024 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.023+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58043640 con 0x7fdc680cadf0 2023-12-16T01:25:27.024 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.023+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc68147fc0 con 0x7fdc680cadf0 2023-12-16T01:25:27.024 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.024+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc68067210 con 0x7fdc680cadf0 2023-12-16T01:25:27.047 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.047+0000 7f1692e4c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-16T01:25:27.100 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.100+0000 7f1692e4c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T01:25:27.138 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.137+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 3) v1 ==== 88944+0+0 (secure 0 0 0) 0x7fdc580437a0 con 0x7fdc680cadf0 2023-12-16T01:25:27.143 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.143+0000 7f1692e4c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T01:25:27.143 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.143+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fdc5803e070 con 0x7fdc680cadf0 2023-12-16T01:25:27.144 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.143+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fdc58078040 con 0x7fdc680cadf0 2023-12-16T01:25:27.194 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.193+0000 7f1692e4c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T01:25:27.206 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.205+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc68074140 con 0x7fdc680cadf0 2023-12-16T01:25:27.238 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.237+0000 7f1692e4c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T01:25:27.270 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.269+0000 7fdc5effd640 1 -- 172.21.15.107:0/3362980906 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdc5807b660 con 0x7fdc680cadf0 2023-12-16T01:25:27.270 INFO:teuthology.misc.health.smithi107.stdout: 2023-12-16T01:25:27.270 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":10,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:25.371179+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:27.271 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 msgr2=0x7fdc6815ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:27.271 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 0x7fdc6815ab60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc58000c00 tx=0x7fdc58004730 comp rx=0 tx=0).stop 2023-12-16T01:25:27.271 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 shutdown_connections 2023-12-16T01:25:27.272 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc681537c0 0x7fdc6815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.272 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc680cadf0 0x7fdc6815ab60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.272 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 --2- 172.21.15.107:0/3362980906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc680ca9e0 0x7fdc68149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:27.272 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 >> 172.21.15.107:0/3362980906 conn(0x7fdc680669f0 msgr2=0x7fdc680706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:27.272 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 shutdown_connections 2023-12-16T01:25:27.272 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:27.270+0000 7fdc705ea640 1 -- 172.21.15.107:0/3362980906 wait complete. 2023-12-16T01:25:27.280 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-16T01:25:27.559 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.558+0000 7f1692e4c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-16T01:25:27.699 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.698+0000 7f1692e4c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T01:25:27.793 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.792+0000 7f1692e4c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T01:25:27.836 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.835+0000 7f1692e4c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T01:25:27.931 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:27.930+0000 7f1692e4c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T01:25:28.022 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:28.021+0000 7f1692e4c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T01:25:28.160 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:28.159+0000 7f1692e4c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T01:25:28.204 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:28.204+0000 7f1692e4c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T01:25:28.312 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:28.312+0000 7f1692e4c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T01:25:28.697 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:25:28.699 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:25:28.972 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:28.971+0000 7f1692e4c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T01:25:29.239 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:29.238+0000 7f1692e4c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T01:25:29.286 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:29.286+0000 7f1692e4c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T01:25:29.392 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:29.392+0000 7f1692e4c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T01:25:29.573 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-12-16T01:25:29.571+0000 7fd49c41c500 -1 osd.4 0 log_to_monitors true 2023-12-16T01:25:29.615 INFO:tasks.ceph.osd.3.smithi107.stderr:2023-12-16T01:25:29.615+0000 7f5025a10500 -1 osd.3 0 log_to_monitors true 2023-12-16T01:25:29.629 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-12-16T01:25:29.629+0000 7fe71580c500 -1 osd.6 0 log_to_monitors true 2023-12-16T01:25:29.633 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-12-16T01:25:29.632+0000 7fb72cefa500 -1 osd.2 0 log_to_monitors true 2023-12-16T01:25:29.645 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-12-16T01:25:29.644+0000 7fcbeab0e500 -1 osd.0 0 log_to_monitors true 2023-12-16T01:25:29.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-12-16T01:25:29.654+0000 7f696bbf7500 -1 osd.1 0 log_to_monitors true 2023-12-16T01:25:29.657 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-12-16T01:25:29.657+0000 7f800ce9c500 -1 osd.5 0 log_to_monitors true 2023-12-16T01:25:29.664 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-12-16T01:25:29.664+0000 7fcaa10da500 -1 osd.7 0 log_to_monitors true 2023-12-16T01:25:31.345 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:31.344+0000 7f16341de640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-16T01:25:31.444 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:25:31.443+0000 7f16341de640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-16T01:25:32.610 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-12-16T01:25:32.610+0000 7fd498600640 -1 osd.4 0 waiting for initial osdmap 2023-12-16T01:25:32.679 INFO:tasks.ceph.osd.3.smithi107.stderr:2023-12-16T01:25:32.678+0000 7f5021b48640 -1 osd.3 0 waiting for initial osdmap 2023-12-16T01:25:32.680 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-12-16T01:25:32.680+0000 7fcbe6a9c640 -1 osd.0 0 waiting for initial osdmap 2023-12-16T01:25:32.687 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-12-16T01:25:32.686+0000 7fd48fc13640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-12-16T01:25:32.695+0000 7f6968399640 -1 osd.1 0 waiting for initial osdmap 2023-12-16T01:25:32.704 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-12-16T01:25:32.703+0000 7f8008e2a640 -1 osd.5 0 waiting for initial osdmap 2023-12-16T01:25:32.707 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-12-16T01:25:32.707+0000 7fb728e8a640 -1 osd.2 0 waiting for initial osdmap 2023-12-16T01:25:32.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-12-16T01:25:32.762+0000 7f695f9ac640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.769 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-12-16T01:25:32.769+0000 7f8000c51640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.773 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-12-16T01:25:32.771+0000 7fe711115640 -1 osd.6 0 waiting for initial osdmap 2023-12-16T01:25:32.774 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-12-16T01:25:32.774+0000 7fcbde8c3640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.775 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-12-16T01:25:32.775+0000 7fb720cb1640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.775 INFO:tasks.ceph.osd.3.smithi107.stderr:2023-12-16T01:25:32.775+0000 7f501915b640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.799 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-12-16T01:25:32.798+0000 7fca9d06a640 -1 osd.7 0 waiting for initial osdmap 2023-12-16T01:25:32.805 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-12-16T01:25:32.805+0000 7fe708f3c640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:32.818 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-12-16T01:25:32.818+0000 7fca94e91640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T01:25:34.087 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:34.175 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.174+0000 7fd650489640 1 Processor -- start 2023-12-16T01:25:34.175 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.174+0000 7fd650489640 1 -- start start 2023-12-16T01:25:34.176 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.175+0000 7fd650489640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:34.176 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.175+0000 7fd650489640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd6480c2720 0x7fd6480c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:34.176 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.175+0000 7fd650489640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6481596b0 con 0x7fd6481537f0 2023-12-16T01:25:34.176 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.175+0000 7fd650489640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6480c2b90 con 0x7fd6480c2720 2023-12-16T01:25:34.176 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.175+0000 7fd650489640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64815d2a0 con 0x7fd648070110 2023-12-16T01:25:34.177 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.176+0000 7fd64ea26640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd6480c2720 0x7fd6480c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:34.177 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.176+0000 7fd64e225640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd6481537f0 0x7fd64815cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:50172/0 (socket says 172.21.15.107:50172) 2023-12-16T01:25:34.177 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.176+0000 7fd64e225640 1 -- 172.21.15.107:0/4008957099 learned_addr learned my addr 172.21.15.107:0/4008957099 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:34.177 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.176+0000 7fd64da24640 1 --2- 172.21.15.107:0/4008957099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:34.179 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.178+0000 7fd64ea26640 1 -- 172.21.15.107:0/4008957099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 msgr2=0x7fd6480c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:34.179 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.178+0000 7fd64ea26640 1 --2- 172.21.15.107:0/4008957099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:34.179 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.178+0000 7fd64ea26640 1 -- 172.21.15.107:0/4008957099 >> v1:172.21.15.157:6789/0 conn(0x7fd6481537f0 legacy=0x7fd64815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:34.179 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.178+0000 7fd64ea26640 1 -- 172.21.15.107:0/4008957099 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480c2d90 con 0x7fd6480c2720 2023-12-16T01:25:34.181 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.180+0000 7fd64ea26640 1 --2- 172.21.15.107:0/4008957099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd6480c87f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6400097a0 tx=0x7fd64002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb79853c0056364 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:34.185 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.184+0000 7fd64d223640 1 -- 172.21.15.107:0/4008957099 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640030610 con 0x7fd6480c2720 2023-12-16T01:25:34.185 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.184+0000 7fd64d223640 1 -- 172.21.15.107:0/4008957099 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640030770 con 0x7fd6480c2720 2023-12-16T01:25:34.185 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.184+0000 7fd64d223640 1 -- 172.21.15.107:0/4008957099 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640030b00 con 0x7fd6480c2720 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 -- 172.21.15.107:0/4008957099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 msgr2=0x7fd6480c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 --2- 172.21.15.107:0/4008957099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd6480c87f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6400097a0 tx=0x7fd64002b960 comp rx=0 tx=0).stop 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 -- 172.21.15.107:0/4008957099 shutdown_connections 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 --2- 172.21.15.107:0/4008957099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd6480c87f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 --2- 172.21.15.107:0/4008957099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 -- 172.21.15.107:0/4008957099 >> 172.21.15.107:0/4008957099 conn(0x7fd64806b610 msgr2=0x7fd64806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 -- 172.21.15.107:0/4008957099 shutdown_connections 2023-12-16T01:25:34.186 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.185+0000 7fd650489640 1 -- 172.21.15.107:0/4008957099 wait complete. 2023-12-16T01:25:34.187 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.186+0000 7fd650489640 1 Processor -- start 2023-12-16T01:25:34.187 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.186+0000 7fd650489640 1 -- start start 2023-12-16T01:25:34.187 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd650489640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:34.188 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd650489640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd648156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:34.188 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd650489640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6481537f0 0x7fd6480ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:34.188 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd650489640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481effd0 con 0x7fd6480c2720 2023-12-16T01:25:34.188 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd650489640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6480ad650 con 0x7fd6481537f0 2023-12-16T01:25:34.188 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd650489640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481f0270 con 0x7fd648070110 2023-12-16T01:25:34.189 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.187+0000 7fd64da24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd648156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:34.189 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.188+0000 7fd64e225640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:34.189 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.188+0000 7fd64ea26640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6481537f0 0x7fd6480ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:34.189 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.188+0000 7fd64da24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd648156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38300/0 (socket says 172.21.15.107:38300) 2023-12-16T01:25:34.189 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.188+0000 7fd64da24640 1 -- 172.21.15.107:0/2982203795 learned_addr learned my addr 172.21.15.107:0/2982203795 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:34.192 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.191+0000 7fd64e225640 1 -- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6481537f0 msgr2=0x7fd6480ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:34.192 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.191+0000 7fd64e225640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6481537f0 0x7fd6480ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:34.192 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.191+0000 7fd64e225640 1 -- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 msgr2=0x7fd648156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:34.192 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.191+0000 7fd64e225640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd648156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:34.192 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.191+0000 7fd64e225640 1 -- 172.21.15.107:0/2982203795 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009400 con 0x7fd648070110 2023-12-16T01:25:34.192 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.191+0000 7fd64da24640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd648156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:25:34.194 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.193+0000 7fd64e225640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c42a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd64400ca50 tx=0x7fd64400cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:34.198 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.197+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64400abb0 con 0x7fd648070110 2023-12-16T01:25:34.198 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.197+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64400ad10 con 0x7fd648070110 2023-12-16T01:25:34.198 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.197+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644012620 con 0x7fd648070110 2023-12-16T01:25:34.198 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.197+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6480c6a00 con 0x7fd648070110 2023-12-16T01:25:34.198 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.197+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6480c6fc0 con 0x7fd648070110 2023-12-16T01:25:34.199 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.198+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd648067f30 con 0x7fd648070110 2023-12-16T01:25:34.219 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.218+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 6) v1 ==== 89177+0+0 (secure 0 0 0) 0x7fd644007070 con 0x7fd648070110 2023-12-16T01:25:34.219 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.218+0000 7fd63effd640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd62c06ae00 0x7fd62c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:34.219 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.218+0000 7fd64da24640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd62c06ae00 0x7fd62c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:34.219 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.218+0000 7fd64da24640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd62c06ae00 0x7fd62c06d2c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6480b1d40 tx=0x7fd638009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:34.448 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.448+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd644058710 con 0x7fd648070110 2023-12-16T01:25:34.458 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.458+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd644054a50 con 0x7fd648070110 2023-12-16T01:25:34.638 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:34.637+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd648074140 con 0x7fd648070110 2023-12-16T01:25:35.078 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.077+0000 7fd63effd640 1 -- 172.21.15.107:0/2982203795 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12776 (secure 0 0 0) 0x7fd644017070 con 0x7fd648070110 2023-12-16T01:25:35.078 INFO:teuthology.misc.health.smithi107.stdout: 2023-12-16T01:25:35.078 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":15,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:34.458308+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd62c06ae00 msgr2=0x7fd62c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd62c06ae00 0x7fd62c06d2c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6480b1d40 tx=0x7fd638009190 comp rx=0 tx=0).stop 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 msgr2=0x7fd6480c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c42a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd64400ca50 tx=0x7fd64400cf10 comp rx=0 tx=0).stop 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 shutdown_connections 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd62c06ae00 0x7fd62c06d2c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6481537f0 0x7fd6480ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6480c2720 0x7fd648156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 --2- 172.21.15.107:0/2982203795 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd648070110 0x7fd6480c42a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 >> 172.21.15.107:0/2982203795 conn(0x7fd64806b610 msgr2=0x7fd6480c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:35.081 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 shutdown_connections 2023-12-16T01:25:35.082 INFO:teuthology.misc.health.smithi107.stderr:2023-12-16T01:25:35.080+0000 7fd650489640 1 -- 172.21.15.107:0/2982203795 wait complete. 2023-12-16T01:25:35.094 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-16T01:25:35.094 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-16T01:25:35.094 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T01:25:35.094 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-16T01:25:35.095 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-12-16T01:25:35.097 INFO:tasks.ceph.mds.a:Started 2023-12-16T01:25:35.097 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T01:25:35.097 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-16T01:25:35.097 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-12-16T01:25:35.100 INFO:tasks.ceph.mds.c:Started 2023-12-16T01:25:35.100 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T01:25:35.100 INFO:tasks.ceph.mds.e:Restarting daemon 2023-12-16T01:25:35.100 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-12-16T01:25:35.102 INFO:tasks.ceph.mds.e:Started 2023-12-16T01:25:35.102 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T01:25:35.102 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-16T01:25:35.102 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-12-16T01:25:35.105 INFO:tasks.ceph.mds.b:Started 2023-12-16T01:25:35.105 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T01:25:35.105 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-16T01:25:35.105 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-12-16T01:25:35.108 INFO:tasks.ceph.mds.d:Started 2023-12-16T01:25:35.109 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T01:25:35.109 INFO:tasks.ceph.mds.f:Restarting daemon 2023-12-16T01:25:35.109 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-12-16T01:25:35.111 INFO:tasks.ceph.mds.f:Started 2023-12-16T01:25:35.111 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-16T01:25:35.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:35.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.227+0000 7f6aa415a640 1 Processor -- start 2023-12-16T01:25:35.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.228+0000 7f6aa415a640 1 -- start start 2023-12-16T01:25:35.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.228+0000 7f6aa415a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a9c06ed00 0x7f6a9c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:35.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.228+0000 7f6aa415a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c06b610 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.228+0000 7f6aa415a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0cc450 con 0x7f6a9c06f600 2023-12-16T01:25:35.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.228+0000 7f6aa415a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c15a550 con 0x7f6a9c06ed00 2023-12-16T01:25:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.229+0000 7f6aa26f7640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6a9c06f0e0 0x7f6a9c1533f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35532/0 (socket says 172.21.15.107:35532) 2023-12-16T01:25:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.229+0000 7f6aa26f7640 1 -- 172.21.15.107:0/1863422174 learned_addr learned my addr 172.21.15.107:0/1863422174 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:35.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.232+0000 7f6aa1ef6640 1 --2- 172.21.15.107:0/1863422174 >> v2:172.21.15.157:3300/0 conn(0x7f6a9c06ed00 0x7f6a9c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.232+0000 7f6aa0ef4640 1 -- 172.21.15.107:0/1863422174 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012689556 0 0) 0x7f6a9c06b610 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.232+0000 7f6aa0ef4640 1 -- 172.21.15.107:0/1863422174 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a88003520 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.234+0000 7f6aa1ef6640 1 -- 172.21.15.107:0/1863422174 >> v1:172.21.15.157:6789/0 conn(0x7f6a9c06f600 legacy=0x7f6a9c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.234+0000 7f6aa1ef6640 1 -- 172.21.15.107:0/1863422174 >> v1:172.21.15.107:6789/0 conn(0x7f6a9c06f0e0 legacy=0x7f6a9c1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.234+0000 7f6aa1ef6640 1 -- 172.21.15.107:0/1863422174 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0703c0 con 0x7f6a9c06ed00 2023-12-16T01:25:35.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.238+0000 7f6aa1ef6640 1 --2- 172.21.15.107:0/1863422174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c15a010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a980097d0 tx=0x7f6a9802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f4cba5d4f9d897 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:35.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.242+0000 7f6aa0ef4640 1 -- 172.21.15.107:0/1863422174 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98030610 con 0x7f6a9c06ed00 2023-12-16T01:25:35.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.242+0000 7f6aa0ef4640 1 -- 172.21.15.107:0/1863422174 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98030770 con 0x7f6a9c06ed00 2023-12-16T01:25:35.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.242+0000 7f6aa0ef4640 1 -- 172.21.15.107:0/1863422174 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98030b00 con 0x7f6a9c06ed00 2023-12-16T01:25:35.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 -- 172.21.15.107:0/1863422174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06ed00 msgr2=0x7f6a9c15a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 --2- 172.21.15.107:0/1863422174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c15a010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a980097d0 tx=0x7f6a9802b960 comp rx=0 tx=0).stop 2023-12-16T01:25:35.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 -- 172.21.15.107:0/1863422174 shutdown_connections 2023-12-16T01:25:35.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 --2- 172.21.15.107:0/1863422174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c15a010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 -- 172.21.15.107:0/1863422174 >> 172.21.15.107:0/1863422174 conn(0x7f6a9c061660 msgr2=0x7f6a9c070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:35.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 -- 172.21.15.107:0/1863422174 shutdown_connections 2023-12-16T01:25:35.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.243+0000 7f6aa415a640 1 -- 172.21.15.107:0/1863422174 wait complete. 2023-12-16T01:25:35.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.245+0000 7f6aa415a640 1 Processor -- start 2023-12-16T01:25:35.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.245+0000 7f6aa415a640 1 -- start start 2023-12-16T01:25:35.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.246+0000 7f6aa415a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:35.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.246+0000 7f6aa415a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 0x7f6a9c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:35.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.246+0000 7f6aa415a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a9c06f600 0x7f6a9c0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:35.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.246+0000 7f6aa415a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1f2980 con 0x7f6a9c06ed00 2023-12-16T01:25:35.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.246+0000 7f6aa415a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c150240 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.246+0000 7f6aa415a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c9a30 con 0x7f6a9c06f600 2023-12-16T01:25:35.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.247+0000 7f6aa16f5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 0x7f6a9c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:35.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.247+0000 7f6aa1ef6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:35.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.247+0000 7f6aa16f5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 0x7f6a9c14fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:59648/0 (socket says 172.21.15.107:59648) 2023-12-16T01:25:35.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.247+0000 7f6aa16f5640 1 -- 172.21.15.107:0/779039986 learned_addr learned my addr 172.21.15.107:0/779039986 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:35.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.247+0000 7f6aa26f7640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a9c06f600 0x7f6a9c0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:35.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.251+0000 7f6aa16f5640 1 -- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a9c06f600 msgr2=0x7f6a9c0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.251+0000 7f6aa16f5640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a9c06f600 0x7f6a9c0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.251+0000 7f6aa16f5640 1 -- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a9c06ed00 msgr2=0x7f6a9c0c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:35.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.251+0000 7f6aa16f5640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c0c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:35.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.251+0000 7f6aa16f5640 1 -- 172.21.15.107:0/779039986 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98009400 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.254+0000 7f6aa16f5640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 0x7f6a9c14fd00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00c3c0 tx=0x7f6a8c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.258+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0052d0 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.258+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c005450 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.258+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c006a60 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.258+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c0c9d10 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.259+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c1f2eb0 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.260+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c06b1a0 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.524+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 6) v1 ==== 89177+0+0 (secure 0 0 0) 0x7f6a8c003640 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.525+0000 7f6a927fc640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f6a8006ae00 0x7f6a8006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:35.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.525+0000 7f6aa1ef6640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f6a8006ae00 0x7f6a8006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:35.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.525+0000 7f6aa1ef6640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f6a8006ae00 0x7f6a8006d2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a98036000 tx=0x7f6a98008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:35.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.529+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f6a8c057f40 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.547+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f6a8c054280 con 0x7f6a9c06f0e0 2023-12-16T01:25:35.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:35.749+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a9c067500 con 0x7f6a9c06f0e0 2023-12-16T01:25:36.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.025+0000 7f6a927fc640 1 -- 172.21.15.107:0/779039986 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12776 (secure 0 0 0) 0x7f6a8c020090 con 0x7f6a9c06f0e0 2023-12-16T01:25:36.026 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:36.026 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":15,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:34.458308+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f6a8006ae00 msgr2=0x7f6a8006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f6a8006ae00 0x7f6a8006d2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a98036000 tx=0x7f6a98008030 comp rx=0 tx=0).stop 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 msgr2=0x7f6a9c14fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 0x7f6a9c14fd00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00c3c0 tx=0x7f6a8c00c880 comp rx=0 tx=0).stop 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 shutdown_connections 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a9c06f600 0x7f6a9c0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f6a8006ae00 0x7f6a8006d2c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9c06f0e0 0x7f6a9c14fd00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 --2- 172.21.15.107:0/779039986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a9c06ed00 0x7f6a9c0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 >> 172.21.15.107:0/779039986 conn(0x7f6a9c061660 msgr2=0x7f6a9c0cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:36.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 shutdown_connections 2023-12-16T01:25:36.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.027+0000 7f6aa415a640 1 -- 172.21.15.107:0/779039986 wait complete. 2023-12-16T01:25:36.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T01:25:36.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:25:36.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.181+0000 7f68d48fc640 1 Processor -- start 2023-12-16T01:25:36.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.181+0000 7f68d48fc640 1 -- start start 2023-12-16T01:25:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.183+0000 7f68d48fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d00c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.183+0000 7f68d48fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68d015d600 0x7f68d006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.183+0000 7f68d48fc640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d0159ba0 con 0x7f68d00c82b0 2023-12-16T01:25:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.183+0000 7f68d48fc640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d015da90 con 0x7f68d015d600 2023-12-16T01:25:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.183+0000 7f68d48fc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0070040 con 0x7f68d006f720 2023-12-16T01:25:36.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.259+0000 7f68ced9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68d015d600 0x7f68d006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.260+0000 7f68ced9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68d015d600 0x7f68d006fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38324/0 (socket says 172.21.15.107:38324) 2023-12-16T01:25:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.260+0000 7f68ced9d640 1 -- 172.21.15.107:0/1713349134 learned_addr learned my addr 172.21.15.107:0/1713349134 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.265+0000 7f68ced9d640 1 -- 172.21.15.107:0/1713349134 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 msgr2=0x7f68d00c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.265+0000 7f68ced9d640 1 --2- 172.21.15.107:0/1713349134 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d00c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.265+0000 7f68ced9d640 1 -- 172.21.15.107:0/1713349134 >> v1:172.21.15.107:6789/0 conn(0x7f68d00c82b0 legacy=0x7f68d0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.265+0000 7f68ced9d640 1 -- 172.21.15.107:0/1713349134 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d015a3e0 con 0x7f68d015d600 2023-12-16T01:25:36.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.270+0000 7f68ced9d640 1 --2- 172.21.15.107:0/1713349134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006fb00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009e50 tx=0x7f68c802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77b169ee62a9ff2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:36.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.276+0000 7f68cd59a640 1 -- 172.21.15.107:0/1713349134 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c802cb00 con 0x7f68d015d600 2023-12-16T01:25:36.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.276+0000 7f68cd59a640 1 -- 172.21.15.107:0/1713349134 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c802cc60 con 0x7f68d015d600 2023-12-16T01:25:36.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.276+0000 7f68cd59a640 1 -- 172.21.15.107:0/1713349134 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c80343f0 con 0x7f68d015d600 2023-12-16T01:25:36.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 -- 172.21.15.107:0/1713349134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 msgr2=0x7f68d006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 --2- 172.21.15.107:0/1713349134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006fb00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009e50 tx=0x7f68c802bf60 comp rx=0 tx=0).stop 2023-12-16T01:25:36.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 -- 172.21.15.107:0/1713349134 shutdown_connections 2023-12-16T01:25:36.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 --2- 172.21.15.107:0/1713349134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006fb00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 --2- 172.21.15.107:0/1713349134 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d00c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 -- 172.21.15.107:0/1713349134 >> 172.21.15.107:0/1713349134 conn(0x7f68d00cbef0 msgr2=0x7f68d00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:36.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 -- 172.21.15.107:0/1713349134 shutdown_connections 2023-12-16T01:25:36.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.277+0000 7f68d48fc640 1 -- 172.21.15.107:0/1713349134 wait complete. 2023-12-16T01:25:36.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.279+0000 7f68d48fc640 1 Processor -- start 2023-12-16T01:25:36.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.279+0000 7f68d48fc640 1 -- start start 2023-12-16T01:25:36.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.280+0000 7f68d48fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:36.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.280+0000 7f68d48fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d00c82b0 0x7f68d014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:36.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.280+0000 7f68d48fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:36.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68d48fc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0157300 con 0x7f68d015d600 2023-12-16T01:25:36.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68d48fc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0157860 con 0x7f68d00c82b0 2023-12-16T01:25:36.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68d48fc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d01efa70 con 0x7f68d006f720 2023-12-16T01:25:36.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68ce59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:36.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68cdd9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d00c82b0 0x7f68d014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:36.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68ced9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:36.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68ce59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d0157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:57002/0 (socket says 172.21.15.107:57002) 2023-12-16T01:25:36.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.281+0000 7f68ce59c640 1 -- 172.21.15.107:0/4069522812 learned_addr learned my addr 172.21.15.107:0/4069522812 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:36.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.286+0000 7f68ce59c640 1 -- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d00c82b0 msgr2=0x7f68d014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.286+0000 7f68ce59c640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d00c82b0 0x7f68d014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.286+0000 7f68ce59c640 1 -- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 msgr2=0x7f68d006ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.286+0000 7f68ce59c640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.286+0000 7f68ce59c640 1 -- 172.21.15.107:0/4069522812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8009b30 con 0x7f68d006f720 2023-12-16T01:25:36.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.290+0000 7f68ce59c640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d0157f50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68c000b410 tx=0x7f68c000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.294+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0011830 con 0x7f68d006f720 2023-12-16T01:25:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.295+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00119b0 con 0x7f68d006f720 2023-12-16T01:25:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.295+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d0157580 con 0x7f68d006f720 2023-12-16T01:25:36.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.295+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0011d60 con 0x7f68d006f720 2023-12-16T01:25:36.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.295+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d01efff0 con 0x7f68d006f720 2023-12-16T01:25:36.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.296+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d01ef8d0 con 0x7f68d006f720 2023-12-16T01:25:36.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.328+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 6) v1 ==== 89177+0+0 (secure 0 0 0) 0x7f68c001a400 con 0x7f68d006f720 2023-12-16T01:25:36.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.328+0000 7f68beffd640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68b006ae00 0x7f68b006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:36.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.328+0000 7f68cdd9b640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68b006ae00 0x7f68b006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:36.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.329+0000 7f68cdd9b640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68b006ae00 0x7f68b006d2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f68d0157040 tx=0x7f68c4009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:36.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.606+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68c00588f0 con 0x7f68d006f720 2023-12-16T01:25:36.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.627+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f68c0054c30 con 0x7f68d006f720 2023-12-16T01:25:36.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.832+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68d01ef8d0 con 0x7f68d006f720 2023-12-16T01:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.950+0000 7f68beffd640 1 -- 172.21.15.107:0/4069522812 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68d01ef8d0 con 0x7f68d006f720 2023-12-16T01:25:36.951 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:25:36.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68b006ae00 msgr2=0x7f68b006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68b006ae00 0x7f68b006d2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f68d0157040 tx=0x7f68c4009040 comp rx=0 tx=0).stop 2023-12-16T01:25:36.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 msgr2=0x7f68d0157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:36.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d0157f50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68c000b410 tx=0x7f68c000b8d0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 shutdown_connections 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015d600 0x7f68d006ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68b006ae00 0x7f68b006d2c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d00c82b0 0x7f68d014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 --2- 172.21.15.107:0/4069522812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d006f720 0x7f68d0157f50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 >> 172.21.15.107:0/4069522812 conn(0x7f68d00cbef0 msgr2=0x7f68d0149aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 shutdown_connections 2023-12-16T01:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:36.953+0000 7f68d48fc640 1 -- 172.21.15.107:0/4069522812 wait complete. 2023-12-16T01:25:36.968 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:25:37.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.072+0000 7fa94ed68640 1 Processor -- start 2023-12-16T01:25:37.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.072+0000 7fa94ed68640 1 -- start start 2023-12-16T01:25:37.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.073+0000 7fa94ed68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cced0 0x7fa948070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:37.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.073+0000 7fa94ed68640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa9480cd2b0 0x7fa9480cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:37.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.073+0000 7fa94ed68640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa948070540 con 0x7fa9480cab10 2023-12-16T01:25:37.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.073+0000 7fa94ed68640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa948158400 con 0x7fa9480cd2b0 2023-12-16T01:25:37.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.073+0000 7fa94ed68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815ad60 con 0x7fa9480cced0 2023-12-16T01:25:37.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.074+0000 7fa947fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa9480cd2b0 0x7fa9480cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:37.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.074+0000 7fa947fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa9480cd2b0 0x7fa9480cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38364/0 (socket says 172.21.15.107:38364) 2023-12-16T01:25:37.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.074+0000 7fa947fff640 1 -- 172.21.15.107:0/3637754682 learned_addr learned my addr 172.21.15.107:0/3637754682 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:37.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.077+0000 7fa947fff640 1 -- 172.21.15.107:0/3637754682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cced0 msgr2=0x7fa948070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:37.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.077+0000 7fa947fff640 1 --2- 172.21.15.107:0/3637754682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cced0 0x7fa948070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.077+0000 7fa947fff640 1 -- 172.21.15.107:0/3637754682 >> v1:172.21.15.107:6789/0 conn(0x7fa9480cab10 legacy=0x7fa9481510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:37.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.077+0000 7fa947fff640 1 -- 172.21.15.107:0/3637754682 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94815b040 con 0x7fa9480cd2b0 2023-12-16T01:25:37.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.083+0000 7fa947fff640 1 --2- 172.21.15.107:0/3637754682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cd2b0 0x7fa9480cbf40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa934009850 tx=0x7fa93402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0d04c85938691f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:37.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.086+0000 7fa9477fe640 1 -- 172.21.15.107:0/3637754682 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934004230 con 0x7fa9480cd2b0 2023-12-16T01:25:37.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa9477fe640 1 -- 172.21.15.107:0/3637754682 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934004390 con 0x7fa9480cd2b0 2023-12-16T01:25:37.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa9477fe640 1 -- 172.21.15.107:0/3637754682 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934003810 con 0x7fa9480cd2b0 2023-12-16T01:25:37.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 -- 172.21.15.107:0/3637754682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cd2b0 msgr2=0x7fa9480cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:37.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 --2- 172.21.15.107:0/3637754682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cd2b0 0x7fa9480cbf40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa934009850 tx=0x7fa93402b9f0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 -- 172.21.15.107:0/3637754682 shutdown_connections 2023-12-16T01:25:37.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 --2- 172.21.15.107:0/3637754682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cd2b0 0x7fa9480cbf40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 --2- 172.21.15.107:0/3637754682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cced0 0x7fa948070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 -- 172.21.15.107:0/3637754682 >> 172.21.15.107:0/3637754682 conn(0x7fa948061660 msgr2=0x7fa948070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:37.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 -- 172.21.15.107:0/3637754682 shutdown_connections 2023-12-16T01:25:37.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.087+0000 7fa94ed68640 1 -- 172.21.15.107:0/3637754682 wait complete. 2023-12-16T01:25:37.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.089+0000 7fa94ed68640 1 Processor -- start 2023-12-16T01:25:37.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.089+0000 7fa94ed68640 1 -- start start 2023-12-16T01:25:37.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa94ed68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cab10 0x7fa948156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:37.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa94ed68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 0x7fa9481596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa94ed68640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9480cd2b0 0x7fa948159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa94ed68640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481ee080 con 0x7fa9480cced0 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa94ed68640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481e4450 con 0x7fa9480cd2b0 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa94ed68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481e4710 con 0x7fa9480cab10 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.091+0000 7fa947fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 0x7fa9481596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.092+0000 7fa947fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 0x7fa9481596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38368/0 (socket says 172.21.15.107:38368) 2023-12-16T01:25:37.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.092+0000 7fa947fff640 1 -- 172.21.15.107:0/1152510135 learned_addr learned my addr 172.21.15.107:0/1152510135 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:37.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.097+0000 7fa947fff640 1 -- 172.21.15.107:0/1152510135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cab10 msgr2=0x7fa948156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:37.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.097+0000 7fa947fff640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cab10 0x7fa948156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.097+0000 7fa947fff640 1 -- 172.21.15.107:0/1152510135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9480cd2b0 msgr2=0x7fa948159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:37.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.097+0000 7fa947fff640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9480cd2b0 0x7fa948159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.097+0000 7fa947fff640 1 -- 172.21.15.107:0/1152510135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934009460 con 0x7fa9480cced0 2023-12-16T01:25:37.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.100+0000 7fa947fff640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 0x7fa9481596a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9340090b0 tx=0x7fa9340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:37.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.105+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93403d070 con 0x7fa9480cced0 2023-12-16T01:25:37.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.105+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934003820 con 0x7fa9480cced0 2023-12-16T01:25:37.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.105+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9481ed470 con 0x7fa9480cced0 2023-12-16T01:25:37.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.105+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9481eda30 con 0x7fa9480cced0 2023-12-16T01:25:37.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.105+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934003bb0 con 0x7fa9480cced0 2023-12-16T01:25:37.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.106+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa948067500 con 0x7fa9480cced0 2023-12-16T01:25:37.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.140+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 6) v1 ==== 89177+0+0 (secure 0 0 0) 0x7fa934003d10 con 0x7fa9480cced0 2023-12-16T01:25:37.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.141+0000 7fa9457fa640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa92c06ae00 0x7fa92c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:37.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.141+0000 7fa94cb04640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa92c06ae00 0x7fa92c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:37.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.141+0000 7fa94cb04640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa92c06ae00 0x7fa92c06d2c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009710 tx=0x7fa93c006c90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:37.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.144+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa93407a930 con 0x7fa9480cced0 2023-12-16T01:25:37.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.408+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa934076570 con 0x7fa9480cced0 2023-12-16T01:25:37.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.861+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa948157c90 con 0x7fa9480cced0 2023-12-16T01:25:37.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.900+0000 7fa9457fa640 1 -- 172.21.15.107:0/1152510135 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fa934047020 con 0x7fa9480cced0 2023-12-16T01:25:37.902 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:37.902 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-16T01:25:37.902 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 1 2023-12-16T01:25:37.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa92c06ae00 msgr2=0x7fa92c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa92c06ae00 0x7fa92c06d2c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009710 tx=0x7fa93c006c90 comp rx=0 tx=0).stop 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 msgr2=0x7fa9481596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 0x7fa9481596a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9340090b0 tx=0x7fa9340046c0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 shutdown_connections 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa92c06ae00 0x7fa92c06d2c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9480cd2b0 0x7fa948159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480cced0 0x7fa9481596a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 --2- 172.21.15.107:0/1152510135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9480cab10 0x7fa948156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.903+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 >> 172.21.15.107:0/1152510135 conn(0x7fa948061660 msgr2=0x7fa9480cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.904+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 shutdown_connections 2023-12-16T01:25:37.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:37.904+0000 7fa94ed68640 1 -- 172.21.15.107:0/1152510135 wait complete. 2023-12-16T01:25:39.920 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:25:40.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.020+0000 7fdbb5248640 1 Processor -- start 2023-12-16T01:25:40.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.020+0000 7fdbb5248640 1 -- start start 2023-12-16T01:25:40.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.021+0000 7fdbb5248640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb015d950 0x7fdbb015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:40.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.021+0000 7fdbb5248640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb015a700 con 0x7fdbb0153c70 2023-12-16T01:25:40.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.021+0000 7fdbb5248640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb00ca870 con 0x7fdbb0153890 2023-12-16T01:25:40.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.021+0000 7fdbb5248640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb015dd80 con 0x7fdbb015d950 2023-12-16T01:25:40.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.022+0000 7fdbae59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fdbb0153c70 0x7fdbb00ceef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:53400/0 (socket says 172.21.15.107:53400) 2023-12-16T01:25:40.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.022+0000 7fdbae59c640 1 -- 172.21.15.107:0/1280410429 learned_addr learned my addr 172.21.15.107:0/1280410429 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:40.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.022+0000 7fdbaf59e640 1 --2- 172.21.15.107:0/1280410429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb015d950 0x7fdbb015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:40.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.025+0000 7fdbaf59e640 1 -- 172.21.15.107:0/1280410429 >> v1:172.21.15.157:6789/0 conn(0x7fdbb0153890 legacy=0x7fdbb00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.025+0000 7fdbaf59e640 1 -- 172.21.15.107:0/1280410429 >> v1:172.21.15.107:6789/0 conn(0x7fdbb0153c70 legacy=0x7fdbb00ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.025+0000 7fdbaf59e640 1 -- 172.21.15.107:0/1280410429 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0159af0 con 0x7fdbb015d950 2023-12-16T01:25:40.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.027+0000 7fdbaf59e640 1 --2- 172.21.15.107:0/1280410429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb015d950 0x7fdbb015aed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009dc0 tx=0x7fdba802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a5c7b9cb205416 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:40.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbadd9b640 1 -- 172.21.15.107:0/1280410429 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba802cd50 con 0x7fdbb015d950 2023-12-16T01:25:40.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbadd9b640 1 -- 172.21.15.107:0/1280410429 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8034440 con 0x7fdbb015d950 2023-12-16T01:25:40.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbadd9b640 1 -- 172.21.15.107:0/1280410429 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba80347d0 con 0x7fdbb015d950 2023-12-16T01:25:40.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 -- 172.21.15.107:0/1280410429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb015d950 msgr2=0x7fdbb015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1280410429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb015d950 0x7fdbb015aed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009dc0 tx=0x7fdba802bfa0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 -- 172.21.15.107:0/1280410429 shutdown_connections 2023-12-16T01:25:40.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1280410429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb015d950 0x7fdbb015aed0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 -- 172.21.15.107:0/1280410429 >> 172.21.15.107:0/1280410429 conn(0x7fdbb006ba00 msgr2=0x7fdbb006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:40.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 -- 172.21.15.107:0/1280410429 shutdown_connections 2023-12-16T01:25:40.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.033+0000 7fdbb5248640 1 -- 172.21.15.107:0/1280410429 wait complete. 2023-12-16T01:25:40.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.035+0000 7fdbb5248640 1 Processor -- start 2023-12-16T01:25:40.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.035+0000 7fdbb5248640 1 -- start start 2023-12-16T01:25:40.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.035+0000 7fdbb5248640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb0153890 0x7fdbb01efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:40.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.035+0000 7fdbb5248640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb0153c70 0x7fdbb00c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:40.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbb5248640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb015d950 0x7fdbb0151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:40.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbb5248640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00c68a0 con 0x7fdbb015d950 2023-12-16T01:25:40.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbb5248640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0154090 con 0x7fdbb0153890 2023-12-16T01:25:40.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbb5248640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0150e40 con 0x7fdbb0153c70 2023-12-16T01:25:40.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbae59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb0153c70 0x7fdbb00c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:40.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbaed9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb0153890 0x7fdbb01efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:40.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.036+0000 7fdbaf59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb015d950 0x7fdbb0151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:40.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.037+0000 7fdbae59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb0153c70 0x7fdbb00c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:45710/0 (socket says 172.21.15.107:45710) 2023-12-16T01:25:40.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.037+0000 7fdbae59c640 1 -- 172.21.15.107:0/1124554066 learned_addr learned my addr 172.21.15.107:0/1124554066 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:40.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.040+0000 7fdbaf59e640 1 -- 172.21.15.107:0/1124554066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb0153c70 msgr2=0x7fdbb00c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.040+0000 7fdbaf59e640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb0153c70 0x7fdbb00c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.040+0000 7fdbaf59e640 1 -- 172.21.15.107:0/1124554066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb0153890 msgr2=0x7fdbb01efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.040+0000 7fdbaf59e640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb0153890 0x7fdbb01efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.040+0000 7fdbaf59e640 1 -- 172.21.15.107:0/1124554066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8009a70 con 0x7fdbb015d950 2023-12-16T01:25:40.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.043+0000 7fdbaf59e640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb015d950 0x7fdbb0151890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdba8033000 tx=0x7fdba8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:40.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.048+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8040650 con 0x7fdbb015d950 2023-12-16T01:25:40.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.048+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba80407b0 con 0x7fdbb015d950 2023-12-16T01:25:40.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.048+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb00c79f0 con 0x7fdbb015d950 2023-12-16T01:25:40.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.048+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8040b60 con 0x7fdbb015d950 2023-12-16T01:25:40.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.049+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb01545c0 con 0x7fdbb015d950 2023-12-16T01:25:40.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.050+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb0154750 con 0x7fdbb015d950 2023-12-16T01:25:40.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.074+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fdba8040cc0 con 0x7fdbb015d950 2023-12-16T01:25:40.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.075+0000 7fdb977fe640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb9c06ae40 0x7fdb9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:40.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.075+0000 7fdbaed9d640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb9c06ae40 0x7fdb9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:40.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.075+0000 7fdbaed9d640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb9c06ae40 0x7fdb9c06d300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdba0000f60 tx=0x7fdba0009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:40.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.079+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdba807b5b0 con 0x7fdbb015d950 2023-12-16T01:25:40.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.346+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fdba80778f0 con 0x7fdbb015d950 2023-12-16T01:25:40.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.613+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbb0067500 con 0x7fdbb015d950 2023-12-16T01:25:40.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.620+0000 7fdb977fe640 1 -- 172.21.15.107:0/1124554066 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fdba8039230 con 0x7fdbb015d950 2023-12-16T01:25:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:40.621 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-16T01:25:40.621 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 1 2023-12-16T01:25:40.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb9c06ae40 msgr2=0x7fdb9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb9c06ae40 0x7fdb9c06d300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdba0000f60 tx=0x7fdba0009040 comp rx=0 tx=0).stop 2023-12-16T01:25:40.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb015d950 msgr2=0x7fdbb0151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:40.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb015d950 0x7fdbb0151890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdba8033000 tx=0x7fdba8004a40 comp rx=0 tx=0).stop 2023-12-16T01:25:40.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 shutdown_connections 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb015d950 0x7fdbb0151890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbb0153c70 0x7fdbb00c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb9c06ae40 0x7fdb9c06d300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 --2- 172.21.15.107:0/1124554066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb0153890 0x7fdbb01efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.622+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 >> 172.21.15.107:0/1124554066 conn(0x7fdbb006ba00 msgr2=0x7fdbb015bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.623+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 shutdown_connections 2023-12-16T01:25:40.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:40.623+0000 7fdbb5248640 1 -- 172.21.15.107:0/1124554066 wait complete. 2023-12-16T01:25:41.478 INFO:tasks.ceph.mds.a.smithi107.stdout:starting mds.a at 2023-12-16T01:25:41.498 INFO:tasks.ceph.mds.e.smithi107.stdout:starting mds.e at 2023-12-16T01:25:41.532 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2023-12-16T01:25:41.657 INFO:tasks.ceph.mds.c.smithi107.stdout:starting mds.c at 2023-12-16T01:25:41.677 INFO:tasks.ceph.mds.f.smithi157.stdout:starting mds.f at 2023-12-16T01:25:41.902 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2023-12-16T01:25:42.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:25:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.735+0000 7f2c2eb7c640 1 Processor -- start 2023-12-16T01:25:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.735+0000 7f2c2eb7c640 1 -- start start 2023-12-16T01:25:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.736+0000 7f2c2eb7c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c2806b840 0x7f2c2806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.736+0000 7f2c2eb7c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c28151b00 con 0x7f2c28151720 2023-12-16T01:25:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.736+0000 7f2c2eb7c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c281582b0 con 0x7f2c2806fc60 2023-12-16T01:25:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.736+0000 7f2c2eb7c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28157730 con 0x7f2c2806b840 2023-12-16T01:25:42.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.737+0000 7f2c2d119640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2c2806fc60 0x7f2c2815af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:50238/0 (socket says 172.21.15.107:50238) 2023-12-16T01:25:42.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.737+0000 7f2c2d119640 1 -- 172.21.15.107:0/752095990 learned_addr learned my addr 172.21.15.107:0/752095990 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:42.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.737+0000 7f2c27fff640 1 --2- 172.21.15.107:0/752095990 >> v2:172.21.15.107:3300/0 conn(0x7f2c2806b840 0x7f2c2806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.739+0000 7f2c277fe640 1 -- 172.21.15.107:0/752095990 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642613841 0 0) 0x7f2c281582b0 con 0x7f2c2806fc60 2023-12-16T01:25:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.739+0000 7f2c277fe640 1 -- 172.21.15.107:0/752095990 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c10003520 con 0x7f2c2806fc60 2023-12-16T01:25:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.740+0000 7f2c27fff640 1 -- 172.21.15.107:0/752095990 >> v1:172.21.15.157:6789/0 conn(0x7f2c2806fc60 legacy=0x7f2c2815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.740+0000 7f2c27fff640 1 -- 172.21.15.107:0/752095990 >> v1:172.21.15.107:6789/0 conn(0x7f2c28151720 legacy=0x7f2c280c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.740+0000 7f2c27fff640 1 -- 172.21.15.107:0/752095990 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28157a10 con 0x7f2c2806b840 2023-12-16T01:25:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.747+0000 7f2c27fff640 1 --2- 172.21.15.107:0/752095990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806b840 0x7f2c2806f720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0097d0 tx=0x7f2c1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e4589cc55aaadc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:42.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.750+0000 7f2c277fe640 1 -- 172.21.15.107:0/752095990 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c031830 con 0x7f2c2806b840 2023-12-16T01:25:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.751+0000 7f2c277fe640 1 -- 172.21.15.107:0/752095990 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c031990 con 0x7f2c2806b840 2023-12-16T01:25:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.751+0000 7f2c277fe640 1 -- 172.21.15.107:0/752095990 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c031d00 con 0x7f2c2806b840 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/752095990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806b840 msgr2=0x7f2c2806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/752095990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806b840 0x7f2c2806f720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0097d0 tx=0x7f2c1c02b8d0 comp rx=0 tx=0).stop 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/752095990 shutdown_connections 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/752095990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806b840 0x7f2c2806f720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/752095990 >> 172.21.15.107:0/752095990 conn(0x7f2c280cbef0 msgr2=0x7f2c280cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/752095990 shutdown_connections 2023-12-16T01:25:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.752+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/752095990 wait complete. 2023-12-16T01:25:42.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.753+0000 7f2c2eb7c640 1 Processor -- start 2023-12-16T01:25:42.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.753+0000 7f2c2eb7c640 1 -- start start 2023-12-16T01:25:42.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2eb7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c2806b840 0x7f2c280c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:42.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2eb7c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806fc60 0x7f2c280c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2eb7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 0x7f2c280c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2eb7c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280c8e20 con 0x7f2c2806fc60 2023-12-16T01:25:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2eb7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281edca0 con 0x7f2c2806b840 2023-12-16T01:25:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2eb7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281edf80 con 0x7f2c28151720 2023-12-16T01:25:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.754+0000 7f2c2d119640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 0x7f2c280c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.755+0000 7f2c2d119640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 0x7f2c280c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:45768/0 (socket says 172.21.15.107:45768) 2023-12-16T01:25:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.755+0000 7f2c2d119640 1 -- 172.21.15.107:0/423557352 learned_addr learned my addr 172.21.15.107:0/423557352 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.756+0000 7f2c27fff640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806fc60 0x7f2c280c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.756+0000 7f2c2c918640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c2806b840 0x7f2c280c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:42.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.758+0000 7f2c2d119640 1 -- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c2806b840 msgr2=0x7f2c280c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:42.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.758+0000 7f2c2d119640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c2806b840 0x7f2c280c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:42.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.758+0000 7f2c2d119640 1 -- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806fc60 msgr2=0x7f2c280c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:42.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.758+0000 7f2c2d119640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806fc60 0x7f2c280c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:42.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.758+0000 7f2c2d119640 1 -- 172.21.15.107:0/423557352 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c009400 con 0x7f2c28151720 2023-12-16T01:25:42.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.761+0000 7f2c2d119640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 0x7f2c280c7ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000cb40 tx=0x7f2c2000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:42.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.766+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000aca0 con 0x7f2c28151720 2023-12-16T01:25:42.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.766+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000ae00 con 0x7f2c28151720 2023-12-16T01:25:42.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.766+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c280c9070 con 0x7f2c28151720 2023-12-16T01:25:42.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.766+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20012620 con 0x7f2c28151720 2023-12-16T01:25:42.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.766+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c280c6190 con 0x7f2c28151720 2023-12-16T01:25:42.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:42.767+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c280cce50 con 0x7f2c28151720 2023-12-16T01:25:43.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.013+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2c20007070 con 0x7f2c28151720 2023-12-16T01:25:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.014+0000 7f2c257fa640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2c1406ae90 0x7f2c1406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.014+0000 7f2c2c918640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2c1406ae90 0x7f2c1406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.014+0000 7f2c2c918640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2c1406ae90 0x7f2c1406d350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000f60 tx=0x7f2c18009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.016+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c200588a0 con 0x7f2c28151720 2023-12-16T01:25:43.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.027+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2c20054be0 con 0x7f2c28151720 2023-12-16T01:25:43.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.287+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c280c63e0 con 0x7f2c28151720 2023-12-16T01:25:43.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.310+0000 7f2c257fa640 1 -- 172.21.15.107:0/423557352 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5289 (secure 0 0 0) 0x7f2c20017070 con 0x7f2c28151720 2023-12-16T01:25:43.311 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:43.311 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-16T01:25:43.311 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 3 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.312+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2c1406ae90 msgr2=0x7f2c1406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.312+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2c1406ae90 0x7f2c1406d350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000f60 tx=0x7f2c18009040 comp rx=0 tx=0).stop 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 msgr2=0x7f2c280c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 0x7f2c280c7ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000cb40 tx=0x7f2c2000a060 comp rx=0 tx=0).stop 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 shutdown_connections 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c28151720 0x7f2c280c7ca0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2806fc60 0x7f2c280c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2c1406ae90 0x7f2c1406d350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 --2- 172.21.15.107:0/423557352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c2806b840 0x7f2c280c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 >> 172.21.15.107:0/423557352 conn(0x7f2c280cbef0 msgr2=0x7f2c2814ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 shutdown_connections 2023-12-16T01:25:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.313+0000 7f2c2eb7c640 1 -- 172.21.15.107:0/423557352 wait complete. 2023-12-16T01:25:43.326 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:43.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.441+0000 7f2720432640 1 Processor -- start 2023-12-16T01:25:43.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.441+0000 7f2720432640 1 -- start start 2023-12-16T01:25:43.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.442+0000 7f2720432640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f27181501c0 0x7f2718159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.442+0000 7f2720432640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2718156e60 0x7f2718071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.442+0000 7f2720432640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2718072b60 con 0x7f27180bff00 2023-12-16T01:25:43.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.442+0000 7f2720432640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27181572d0 con 0x7f2718156e60 2023-12-16T01:25:43.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.442+0000 7f2720432640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180c1a90 con 0x7f27181501c0 2023-12-16T01:25:43.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.443+0000 7f271e9cf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2718156e60 0x7f2718071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.443+0000 7f271e1ce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f27181501c0 0x7f2718159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.443+0000 7f271e9cf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2718156e60 0x7f2718071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55846/0 (socket says 172.21.15.107:55846) 2023-12-16T01:25:43.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.443+0000 7f271e9cf640 1 -- 172.21.15.107:0/2041490571 learned_addr learned my addr 172.21.15.107:0/2041490571 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:43.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.446+0000 7f271e9cf640 1 -- 172.21.15.107:0/2041490571 >> v2:172.21.15.157:3300/0 conn(0x7f27181501c0 msgr2=0x7f2718159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:43.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.446+0000 7f271e9cf640 1 --2- 172.21.15.107:0/2041490571 >> v2:172.21.15.157:3300/0 conn(0x7f27181501c0 0x7f2718159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.446+0000 7f271e9cf640 1 -- 172.21.15.107:0/2041490571 >> v1:172.21.15.157:6789/0 conn(0x7f27180bff00 legacy=0x7f2718072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:43.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.446+0000 7f271e9cf640 1 -- 172.21.15.107:0/2041490571 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180c1d30 con 0x7f2718156e60 2023-12-16T01:25:43.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.449+0000 7f271e9cf640 1 --2- 172.21.15.107:0/2041490571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2718156e60 0x7f2718071710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27180cbad0 tx=0x7f271002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6408cc936b696e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:43.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.453+0000 7f271d1cc640 1 -- 172.21.15.107:0/2041490571 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271002cbb0 con 0x7f2718156e60 2023-12-16T01:25:43.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.453+0000 7f271d1cc640 1 -- 172.21.15.107:0/2041490571 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271002cd10 con 0x7f2718156e60 2023-12-16T01:25:43.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.453+0000 7f271d1cc640 1 -- 172.21.15.107:0/2041490571 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710034610 con 0x7f2718156e60 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 -- 172.21.15.107:0/2041490571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2718156e60 msgr2=0x7f2718071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 --2- 172.21.15.107:0/2041490571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2718156e60 0x7f2718071710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27180cbad0 tx=0x7f271002c010 comp rx=0 tx=0).stop 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 -- 172.21.15.107:0/2041490571 shutdown_connections 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 --2- 172.21.15.107:0/2041490571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2718156e60 0x7f2718071710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 --2- 172.21.15.107:0/2041490571 >> v2:172.21.15.157:3300/0 conn(0x7f27181501c0 0x7f2718159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 -- 172.21.15.107:0/2041490571 >> 172.21.15.107:0/2041490571 conn(0x7f271806cd60 msgr2=0x7f271806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 -- 172.21.15.107:0/2041490571 shutdown_connections 2023-12-16T01:25:43.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.454+0000 7f2720432640 1 -- 172.21.15.107:0/2041490571 wait complete. 2023-12-16T01:25:43.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.455+0000 7f2720432640 1 Processor -- start 2023-12-16T01:25:43.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.455+0000 7f2720432640 1 -- start start 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f2720432640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27180bff00 0x7f27181eb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f2720432640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 0x7f27181ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f2720432640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718156e60 0x7f2718150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f2720432640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c94f0 con 0x7f27181501c0 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f2720432640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c8ce0 con 0x7f2718156e60 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f2720432640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27181edfd0 con 0x7f27180bff00 2023-12-16T01:25:43.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.456+0000 7f271d9cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 0x7f27181ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.457+0000 7f271e9cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718156e60 0x7f2718150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.457+0000 7f271d9cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 0x7f27181ee790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55862/0 (socket says 172.21.15.107:55862) 2023-12-16T01:25:43.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.457+0000 7f271d9cd640 1 -- 172.21.15.107:0/2844336787 learned_addr learned my addr 172.21.15.107:0/2844336787 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:43.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.457+0000 7f271e1ce640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27180bff00 0x7f27181eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.460+0000 7f271d9cd640 1 -- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27180bff00 msgr2=0x7f27181eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:43.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.460+0000 7f271d9cd640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27180bff00 0x7f27181eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.460+0000 7f271d9cd640 1 -- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718156e60 msgr2=0x7f2718150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:43.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.460+0000 7f271d9cd640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718156e60 0x7f2718150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:43.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.460+0000 7f271d9cd640 1 -- 172.21.15.107:0/2844336787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009b30 con 0x7f27181501c0 2023-12-16T01:25:43.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.462+0000 7f271d9cd640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 0x7f27181ee790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f270800c450 tx=0x7f270800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:43.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.466+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080052d0 con 0x7f27181501c0 2023-12-16T01:25:43.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.466+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708005430 con 0x7f27181501c0 2023-12-16T01:25:43.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.466+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708012870 con 0x7f27181501c0 2023-12-16T01:25:43.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.466+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180c8f30 con 0x7f27181501c0 2023-12-16T01:25:43.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.466+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27181ee270 con 0x7f27181501c0 2023-12-16T01:25:43.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.467+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180c7fa0 con 0x7f27181501c0 2023-12-16T01:25:43.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.711+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f27080129d0 con 0x7f27181501c0 2023-12-16T01:25:43.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.711+0000 7f270effd640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f26fc06ae90 0x7f26fc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:43.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.712+0000 7f271e1ce640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f26fc06ae90 0x7f26fc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:43.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.712+0000 7f271e1ce640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f26fc06ae90 0x7f26fc06d350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f271400bde0 tx=0x7f271400b3a0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:43.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.724+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2708058880 con 0x7f27181501c0 2023-12-16T01:25:43.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.724+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2708054bc0 con 0x7f27181501c0 2023-12-16T01:25:43.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:43.895+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27181ede30 con 0x7f27181501c0 2023-12-16T01:25:44.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.001+0000 7f270effd640 1 -- 172.21.15.107:0/2844336787 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12910 (secure 0 0 0) 0x7f27181ede30 con 0x7f27181501c0 2023-12-16T01:25:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:44.002 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:37.386338+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:44.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f26fc06ae90 msgr2=0x7f26fc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f26fc06ae90 0x7f26fc06d350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f271400bde0 tx=0x7f271400b3a0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 msgr2=0x7f27181ee790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 0x7f27181ee790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f270800c450 tx=0x7f270800c910 comp rx=0 tx=0).stop 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 shutdown_connections 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f26fc06ae90 0x7f26fc06d350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2718156e60 0x7f2718150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27181501c0 0x7f27181ee790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 --2- 172.21.15.107:0/2844336787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27180bff00 0x7f27181eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 >> 172.21.15.107:0/2844336787 conn(0x7f271806cd60 msgr2=0x7f271806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 shutdown_connections 2023-12-16T01:25:44.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.003+0000 7f2720432640 1 -- 172.21.15.107:0/2844336787 wait complete. 2023-12-16T01:25:44.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T01:25:44.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:25:44.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.116+0000 7fef4ca15640 1 Processor -- start 2023-12-16T01:25:44.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.116+0000 7fef4ca15640 1 -- start start 2023-12-16T01:25:44.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.117+0000 7fef4ca15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef48153910 0x7fef4806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.117+0000 7fef4ca15640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fef4815d580 0x7fef4806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.117+0000 7fef4ca15640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4815dac0 con 0x7fef4806a500 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.117+0000 7fef4ca15640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef48159600 con 0x7fef4815d580 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.117+0000 7fef4ca15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4815a420 con 0x7fef48153910 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.118+0000 7fef4659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef48153910 0x7fef4806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.118+0000 7fef46d9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fef4806a500 0x7fef480c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:50246/0 (socket says 172.21.15.107:50246) 2023-12-16T01:25:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.118+0000 7fef46d9d640 1 -- 172.21.15.107:0/1415634717 learned_addr learned my addr 172.21.15.107:0/1415634717 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:44.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.120+0000 7fef4559a640 1 -- 172.21.15.107:0/1415634717 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815351825 0 0) 0x7fef40001110 con 0x7fef4806a500 2023-12-16T01:25:44.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.121+0000 7fef4559a640 1 -- 172.21.15.107:0/1415634717 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef30003520 con 0x7fef4806a500 2023-12-16T01:25:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.121+0000 7fef4659c640 1 -- 172.21.15.107:0/1415634717 >> v2:172.21.15.107:3300/0 conn(0x7fef4815d580 msgr2=0x7fef4806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.121+0000 7fef4659c640 1 --2- 172.21.15.107:0/1415634717 >> v2:172.21.15.107:3300/0 conn(0x7fef4815d580 0x7fef4806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.121+0000 7fef4659c640 1 -- 172.21.15.107:0/1415634717 >> v1:172.21.15.157:6789/0 conn(0x7fef4806a500 legacy=0x7fef480c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.121+0000 7fef4659c640 1 -- 172.21.15.107:0/1415634717 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48159810 con 0x7fef48153910 2023-12-16T01:25:44.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.123+0000 7fef4659c640 1 --2- 172.21.15.107:0/1415634717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef48153910 0x7fef4806edd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef38009d90 tx=0x7fef3802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27006d4dfe0f2dda server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:44.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.129+0000 7fef4559a640 1 -- 172.21.15.107:0/1415634717 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3802cc50 con 0x7fef48153910 2023-12-16T01:25:44.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.129+0000 7fef4559a640 1 -- 172.21.15.107:0/1415634717 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3802cdb0 con 0x7fef48153910 2023-12-16T01:25:44.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.129+0000 7fef4559a640 1 -- 172.21.15.107:0/1415634717 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38034660 con 0x7fef48153910 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 -- 172.21.15.107:0/1415634717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef48153910 msgr2=0x7fef4806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 --2- 172.21.15.107:0/1415634717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef48153910 0x7fef4806edd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef38009d90 tx=0x7fef3802bea0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 -- 172.21.15.107:0/1415634717 shutdown_connections 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 --2- 172.21.15.107:0/1415634717 >> v2:172.21.15.107:3300/0 conn(0x7fef4815d580 0x7fef4806dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 --2- 172.21.15.107:0/1415634717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef48153910 0x7fef4806edd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 -- 172.21.15.107:0/1415634717 >> 172.21.15.107:0/1415634717 conn(0x7fef480c89f0 msgr2=0x7fef480c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 -- 172.21.15.107:0/1415634717 shutdown_connections 2023-12-16T01:25:44.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.130+0000 7fef4ca15640 1 -- 172.21.15.107:0/1415634717 wait complete. 2023-12-16T01:25:44.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.131+0000 7fef4ca15640 1 Processor -- start 2023-12-16T01:25:44.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.131+0000 7fef4ca15640 1 -- start start 2023-12-16T01:25:44.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.132+0000 7fef4ca15640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 0x7fef4814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.132+0000 7fef4ca15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef48153910 0x7fef48155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.132+0000 7fef4ca15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef4815d580 0x7fef481564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.132+0000 7fef4ca15640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4814e8a0 con 0x7fef48153910 2023-12-16T01:25:44.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.132+0000 7fef4ca15640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4815d400 con 0x7fef4806a500 2023-12-16T01:25:44.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.132+0000 7fef4ca15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef48153f70 con 0x7fef4815d580 2023-12-16T01:25:44.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.133+0000 7fef46d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef4815d580 0x7fef481564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.133+0000 7fef4659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 0x7fef4814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.133+0000 7fef4659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 0x7fef4814dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47508/0 (socket says 172.21.15.107:47508) 2023-12-16T01:25:44.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.133+0000 7fef4659c640 1 -- 172.21.15.107:0/352712513 learned_addr learned my addr 172.21.15.107:0/352712513 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:44.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.135+0000 7fef45d9b640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef48153910 0x7fef48155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.137+0000 7fef46d9d640 1 -- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 msgr2=0x7fef4814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.137+0000 7fef46d9d640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 0x7fef4814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.137+0000 7fef46d9d640 1 -- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef48153910 msgr2=0x7fef48155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.137+0000 7fef46d9d640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef48153910 0x7fef48155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.137+0000 7fef46d9d640 1 -- 172.21.15.107:0/352712513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38009a70 con 0x7fef4815d580 2023-12-16T01:25:44.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.137+0000 7fef4659c640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 0x7fef4814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:25:44.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.139+0000 7fef46d9d640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef4815d580 0x7fef481564f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c760 tx=0x7fef4000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:44.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.144+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40005ab0 con 0x7fef4815d580 2023-12-16T01:25:44.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.144+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef40005c10 con 0x7fef4815d580 2023-12-16T01:25:44.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.144+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef48154210 con 0x7fef4815d580 2023-12-16T01:25:44.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.144+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000ce10 con 0x7fef4815d580 2023-12-16T01:25:44.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.144+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4815cb60 con 0x7fef4815d580 2023-12-16T01:25:44.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.145+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4806f1e0 con 0x7fef4815d580 2023-12-16T01:25:44.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.413+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fef40007070 con 0x7fef4815d580 2023-12-16T01:25:44.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.413+0000 7fef36ffd640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fef2806ae70 0x7fef2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.413+0000 7fef4659c640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fef2806ae70 0x7fef2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.414+0000 7fef4659c640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fef2806ae70 0x7fef2806d330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef38000f80 tx=0x7fef38030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:44.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.421+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fef40057940 con 0x7fef4815d580 2023-12-16T01:25:44.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.432+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fef40053c80 con 0x7fef4815d580 2023-12-16T01:25:44.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.601+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef4815dac0 con 0x7fef4815d580 2023-12-16T01:25:44.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.606+0000 7fef36ffd640 1 -- 172.21.15.107:0/352712513 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef4815dac0 con 0x7fef4815d580 2023-12-16T01:25:44.607 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fef2806ae70 msgr2=0x7fef2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fef2806ae70 0x7fef2806d330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef38000f80 tx=0x7fef38030000 comp rx=0 tx=0).stop 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef4815d580 msgr2=0x7fef481564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef4815d580 0x7fef481564f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c760 tx=0x7fef4000cc20 comp rx=0 tx=0).stop 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 shutdown_connections 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef4815d580 0x7fef481564f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef48153910 0x7fef48155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fef2806ae70 0x7fef2806d330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 --2- 172.21.15.107:0/352712513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef4806a500 0x7fef4814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 >> 172.21.15.107:0/352712513 conn(0x7fef480c89f0 msgr2=0x7fef4806b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:44.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 shutdown_connections 2023-12-16T01:25:44.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.608+0000 7fef4ca15640 1 -- 172.21.15.107:0/352712513 wait complete. 2023-12-16T01:25:44.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T01:25:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.717+0000 7f21c5f90640 1 Processor -- start 2023-12-16T01:25:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.717+0000 7f21c5f90640 1 -- start start 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.718+0000 7f21c5f90640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21c0151720 0x7f21c006b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.718+0000 7f21c5f90640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c00c68f0 0x7f21c006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.718+0000 7f21c5f90640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c0151b00 con 0x7f21c006fc60 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.718+0000 7f21c5f90640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c01582b0 con 0x7f21c0151720 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.718+0000 7f21c5f90640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0157730 con 0x7f21c00c68f0 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.719+0000 7f21bf7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21c0151720 0x7f21c006b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.719+0000 7f21beffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c00c68f0 0x7f21c006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.719+0000 7f21bffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f21c006fc60 0x7f21c015af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:50248/0 (socket says 172.21.15.107:50248) 2023-12-16T01:25:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.719+0000 7f21bffff640 1 -- 172.21.15.107:0/701027433 learned_addr learned my addr 172.21.15.107:0/701027433 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:44.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.721+0000 7f21bf7fe640 1 -- 172.21.15.107:0/701027433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c00c68f0 msgr2=0x7f21c006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:44.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.721+0000 7f21bf7fe640 1 --2- 172.21.15.107:0/701027433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c00c68f0 0x7f21c006f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.721+0000 7f21bf7fe640 1 -- 172.21.15.107:0/701027433 >> v1:172.21.15.157:6789/0 conn(0x7f21c006fc60 legacy=0x7f21c015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.721+0000 7f21bf7fe640 1 -- 172.21.15.107:0/701027433 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0157a10 con 0x7f21c0151720 2023-12-16T01:25:44.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.723+0000 7f21bf7fe640 1 --2- 172.21.15.107:0/701027433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c0151720 0x7f21c006b840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097a0 tx=0x7f21b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb7570954896354 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:44.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21be7fc640 1 -- 172.21.15.107:0/701027433 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b002e070 con 0x7f21c0151720 2023-12-16T01:25:44.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21be7fc640 1 -- 172.21.15.107:0/701027433 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b00315a0 con 0x7f21c0151720 2023-12-16T01:25:44.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21be7fc640 1 -- 172.21.15.107:0/701027433 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0031930 con 0x7f21c0151720 2023-12-16T01:25:44.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 -- 172.21.15.107:0/701027433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c0151720 msgr2=0x7f21c006b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 --2- 172.21.15.107:0/701027433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c0151720 0x7f21c006b840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097a0 tx=0x7f21b002b840 comp rx=0 tx=0).stop 2023-12-16T01:25:44.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 -- 172.21.15.107:0/701027433 shutdown_connections 2023-12-16T01:25:44.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 --2- 172.21.15.107:0/701027433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c00c68f0 0x7f21c006f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 --2- 172.21.15.107:0/701027433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c0151720 0x7f21c006b840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 -- 172.21.15.107:0/701027433 >> 172.21.15.107:0/701027433 conn(0x7f21c00cbef0 msgr2=0x7f21c00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:44.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 -- 172.21.15.107:0/701027433 shutdown_connections 2023-12-16T01:25:44.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.727+0000 7f21c5f90640 1 -- 172.21.15.107:0/701027433 wait complete. 2023-12-16T01:25:44.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.729+0000 7f21c5f90640 1 Processor -- start 2023-12-16T01:25:44.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.729+0000 7f21c5f90640 1 -- start start 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21c5f90640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c006fc60 0x7f21c0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21c5f90640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21c00c68f0 0x7f21c00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21c5f90640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c0151720 0x7f21c0158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21c5f90640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c006bb60 con 0x7f21c006fc60 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21c5f90640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c015a080 con 0x7f21c00c68f0 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21c5f90640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c015a360 con 0x7f21c0151720 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21bf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c006fc60 0x7f21c0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21bffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c0151720 0x7f21c0158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21beffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21c00c68f0 0x7f21c00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21bf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c006fc60 0x7f21c0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55888/0 (socket says 172.21.15.107:55888) 2023-12-16T01:25:44.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.730+0000 7f21bf7fe640 1 -- 172.21.15.107:0/3391035962 learned_addr learned my addr 172.21.15.107:0/3391035962 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:44.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.734+0000 7f21bffff640 1 -- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21c00c68f0 msgr2=0x7f21c00c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.734+0000 7f21bffff640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21c00c68f0 0x7f21c00c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.734+0000 7f21bffff640 1 -- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c006fc60 msgr2=0x7f21c0159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:44.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.734+0000 7f21bffff640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c006fc60 0x7f21c0159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:44.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.734+0000 7f21bffff640 1 -- 172.21.15.107:0/3391035962 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009400 con 0x7f21c0151720 2023-12-16T01:25:44.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.736+0000 7f21bffff640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c0151720 0x7f21c0158690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21b800cad0 tx=0x7f21b800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:44.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.739+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800ac30 con 0x7f21c0151720 2023-12-16T01:25:44.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.740+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800ad90 con 0x7f21c0151720 2023-12-16T01:25:44.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.740+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c01594e0 con 0x7f21c0151720 2023-12-16T01:25:44.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.740+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8012600 con 0x7f21c0151720 2023-12-16T01:25:44.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.740+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c0158bd0 con 0x7f21c0151720 2023-12-16T01:25:44.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.740+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c00cce50 con 0x7f21c0151720 2023-12-16T01:25:44.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.987+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f21b8007070 con 0x7f21c0151720 2023-12-16T01:25:44.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.987+0000 7f21b7fff640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f21a006ae90 0x7f21a006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:44.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.987+0000 7f21bf7fe640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f21a006ae90 0x7f21a006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:44.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.988+0000 7f21bf7fe640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f21a006ae90 0x7f21a006d350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f21b0000c00 tx=0x7f21b003d040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:44.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:44.990+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f21b8058720 con 0x7f21c0151720 2023-12-16T01:25:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.000+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f21b8054a60 con 0x7f21c0151720 2023-12-16T01:25:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.169+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f21c015a4a0 con 0x7f21c0151720 2023-12-16T01:25:45.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.175+0000 7f21b7fff640 1 -- 172.21.15.107:0/3391035962 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f21c015a4a0 con 0x7f21c0151720 2023-12-16T01:25:45.175 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:45.176 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2023-12-16T01:25:45.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-12-16T01:25:45.176 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2023-12-16T01:25:45.176 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2023-12-16T01:25:45.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-12-16T01:25:45.176 INFO:teuthology.orchestra.run.smithi107.stdout:] 2023-12-16T01:25:45.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f21a006ae90 msgr2=0x7f21a006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:45.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f21a006ae90 0x7f21a006d350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f21b0000c00 tx=0x7f21b003d040 comp rx=0 tx=0).stop 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c0151720 msgr2=0x7f21c0158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c0151720 0x7f21c0158690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21b800cad0 tx=0x7f21b800cf90 comp rx=0 tx=0).stop 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 shutdown_connections 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21c0151720 0x7f21c0158690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f21a006ae90 0x7f21a006d350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21c00c68f0 0x7f21c00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 --2- 172.21.15.107:0/3391035962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21c006fc60 0x7f21c0159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.176+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 >> 172.21.15.107:0/3391035962 conn(0x7f21c00cbef0 msgr2=0x7f21c01551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.177+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 shutdown_connections 2023-12-16T01:25:45.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.177+0000 7f21c5f90640 1 -- 172.21.15.107:0/3391035962 wait complete. 2023-12-16T01:25:45.188 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-16T01:25:45.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-16T01:25:45.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.291+0000 7f8df524f640 1 Processor -- start 2023-12-16T01:25:45.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.291+0000 7f8df524f640 1 -- start start 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8df524f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8df0150610 0x7f8df00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8df524f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8df0072530 0x7f8df0159930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8df524f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df00bff00 0x7f8df00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8df524f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df0072a30 con 0x7f8df0150610 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8df524f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00c6ec0 con 0x7f8df0072530 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8df524f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df01509f0 con 0x7f8df00bff00 2023-12-16T01:25:45.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.292+0000 7f8deed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8df0150610 0x7f8df00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.293+0000 7f8def59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df00bff00 0x7f8df00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.293+0000 7f8de7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8df0072530 0x7f8df0159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.293+0000 7f8deed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8df0150610 0x7f8df00c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55890/0 (socket says 172.21.15.107:55890) 2023-12-16T01:25:45.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.293+0000 7f8deed9d640 1 -- 172.21.15.107:0/1644191979 learned_addr learned my addr 172.21.15.107:0/1644191979 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:45.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.295+0000 7f8deed9d640 1 -- 172.21.15.107:0/1644191979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df00bff00 msgr2=0x7f8df00c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:45.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.295+0000 7f8deed9d640 1 --2- 172.21.15.107:0/1644191979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df00bff00 0x7f8df00c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.295+0000 7f8deed9d640 1 -- 172.21.15.107:0/1644191979 >> v2:172.21.15.157:3300/0 conn(0x7f8df0072530 msgr2=0x7f8df0159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:45.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.295+0000 7f8deed9d640 1 --2- 172.21.15.107:0/1644191979 >> v2:172.21.15.157:3300/0 conn(0x7f8df0072530 0x7f8df0159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.295+0000 7f8deed9d640 1 -- 172.21.15.107:0/1644191979 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0071df0 con 0x7f8df0150610 2023-12-16T01:25:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.297+0000 7f8deed9d640 1 --2- 172.21.15.107:0/1644191979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df0150610 0x7f8df00c7350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8df00c22b0 tx=0x7f8de002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81322bfb8504b944 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.299+0000 7f8dee59c640 1 -- 172.21.15.107:0/1644191979 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0030850 con 0x7f8df0150610 2023-12-16T01:25:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.300+0000 7f8dee59c640 1 -- 172.21.15.107:0/1644191979 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00309b0 con 0x7f8df0150610 2023-12-16T01:25:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.300+0000 7f8dee59c640 1 -- 172.21.15.107:0/1644191979 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0030d40 con 0x7f8df0150610 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 -- 172.21.15.107:0/1644191979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df0150610 msgr2=0x7f8df00c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 --2- 172.21.15.107:0/1644191979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df0150610 0x7f8df00c7350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8df00c22b0 tx=0x7f8de002b990 comp rx=0 tx=0).stop 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 -- 172.21.15.107:0/1644191979 shutdown_connections 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 --2- 172.21.15.107:0/1644191979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df00bff00 0x7f8df00c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 --2- 172.21.15.107:0/1644191979 >> v2:172.21.15.157:3300/0 conn(0x7f8df0072530 0x7f8df0159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 --2- 172.21.15.107:0/1644191979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df0150610 0x7f8df00c7350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 -- 172.21.15.107:0/1644191979 >> 172.21.15.107:0/1644191979 conn(0x7f8df006cd60 msgr2=0x7f8df006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 -- 172.21.15.107:0/1644191979 shutdown_connections 2023-12-16T01:25:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.301+0000 7f8df524f640 1 -- 172.21.15.107:0/1644191979 wait complete. 2023-12-16T01:25:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.302+0000 7f8df524f640 1 Processor -- start 2023-12-16T01:25:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.302+0000 7f8df524f640 1 -- start start 2023-12-16T01:25:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8df524f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df0072530 0x7f8df00c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8df524f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 0x7f8df01f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8df524f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8df0150610 0x7f8df014c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8df524f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00c9b60 con 0x7f8df00bff00 2023-12-16T01:25:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8df524f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00c9300 con 0x7f8df0150610 2023-12-16T01:25:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8df524f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00c95a0 con 0x7f8df0072530 2023-12-16T01:25:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.303+0000 7f8de7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 0x7f8df01f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.304+0000 7f8de7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 0x7f8df01f0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55894/0 (socket says 172.21.15.107:55894) 2023-12-16T01:25:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.304+0000 7f8de7fff640 1 -- 172.21.15.107:0/1141545756 learned_addr learned my addr 172.21.15.107:0/1141545756 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.304+0000 7f8deed9d640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df0072530 0x7f8df00c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.304+0000 7f8def59e640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8df0150610 0x7f8df014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.307+0000 7f8de7fff640 1 -- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df0072530 msgr2=0x7f8df00c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.307+0000 7f8de7fff640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df0072530 0x7f8df00c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.307+0000 7f8de7fff640 1 -- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8df0150610 msgr2=0x7f8df014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.307+0000 7f8de7fff640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8df0150610 0x7f8df014c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.307+0000 7f8de7fff640 1 -- 172.21.15.107:0/1141545756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00094d0 con 0x7f8df00bff00 2023-12-16T01:25:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.309+0000 7f8de7fff640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 0x7f8df01f0050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e980 tx=0x7f8dd800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:45.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.313+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8009670 con 0x7f8df00bff00 2023-12-16T01:25:45.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.313+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd800ca00 con 0x7f8df00bff00 2023-12-16T01:25:45.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.313+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800cd90 con 0x7f8df00bff00 2023-12-16T01:25:45.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.313+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df00c9880 con 0x7f8df00bff00 2023-12-16T01:25:45.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.313+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df01efb30 con 0x7f8df00bff00 2023-12-16T01:25:45.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.314+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0067570 con 0x7f8df00bff00 2023-12-16T01:25:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.559+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8dd8013470 con 0x7f8df00bff00 2023-12-16T01:25:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.559+0000 7f8de77fe640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8dd006ae90 0x7f8dd006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.560+0000 7f8deed9d640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8dd006ae90 0x7f8dd006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.560+0000 7f8deed9d640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8dd006ae90 0x7f8dd006d350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8de0036000 tx=0x7f8de0008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:45.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.577+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8dd8058dc0 con 0x7f8df00bff00 2023-12-16T01:25:45.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.577+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8dd8055100 con 0x7f8df00bff00 2023-12-16T01:25:45.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:45.750+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8df006d4d0 con 0x7f8df00bff00 2023-12-16T01:25:46.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.776+0000 7f8de77fe640 1 -- 172.21.15.107:0/1141545756 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8dd80170b0 con 0x7f8df00bff00 2023-12-16T01:25:46.777 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' created 2023-12-16T01:25:46.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8dd006ae90 msgr2=0x7f8dd006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:46.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8dd006ae90 0x7f8dd006d350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8de0036000 tx=0x7f8de0008030 comp rx=0 tx=0).stop 2023-12-16T01:25:46.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 msgr2=0x7f8df01f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:46.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 0x7f8df01f0050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e980 tx=0x7f8dd800ee40 comp rx=0 tx=0).stop 2023-12-16T01:25:46.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 shutdown_connections 2023-12-16T01:25:46.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8dd006ae90 0x7f8dd006d350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8df0150610 0x7f8df014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8df00bff00 0x7f8df01f0050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 --2- 172.21.15.107:0/1141545756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8df0072530 0x7f8df00c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 >> 172.21.15.107:0/1141545756 conn(0x7f8df006cd60 msgr2=0x7f8df014f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:46.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 shutdown_connections 2023-12-16T01:25:46.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.778+0000 7f8df524f640 1 -- 172.21.15.107:0/1141545756 wait complete. 2023-12-16T01:25:46.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-16T01:25:46.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.898+0000 7fa4885b0640 1 Processor -- start 2023-12-16T01:25:46.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.898+0000 7fa4885b0640 1 -- start start 2023-12-16T01:25:46.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.899+0000 7fa4885b0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4800c9dd0 0x7fa4800c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:46.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.899+0000 7fa4885b0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa4800ca1b0 0x7fa48015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:46.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.899+0000 7fa4885b0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa48006f590 0x7fa48015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:46.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.899+0000 7fa4885b0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4801596a0 con 0x7fa4800c9dd0 2023-12-16T01:25:46.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.899+0000 7fa4885b0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48015cc90 con 0x7fa4800ca1b0 2023-12-16T01:25:46.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.899+0000 7fa4885b0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c7c40 con 0x7fa48006f590 2023-12-16T01:25:46.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.900+0000 7fa48634c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4800c9dd0 0x7fa4800c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:46.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.900+0000 7fa486b4d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa48006f590 0x7fa48015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:46.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.900+0000 7fa485b4b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa4800ca1b0 0x7fa48015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:46.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.900+0000 7fa48634c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4800c9dd0 0x7fa4800c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55898/0 (socket says 172.21.15.107:55898) 2023-12-16T01:25:46.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.900+0000 7fa48634c640 1 -- 172.21.15.107:0/2359866405 learned_addr learned my addr 172.21.15.107:0/2359866405 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:46.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.902+0000 7fa48634c640 1 -- 172.21.15.107:0/2359866405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa48006f590 msgr2=0x7fa48015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:46.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.902+0000 7fa48634c640 1 --2- 172.21.15.107:0/2359866405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa48006f590 0x7fa48015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.902+0000 7fa48634c640 1 -- 172.21.15.107:0/2359866405 >> v2:172.21.15.157:3300/0 conn(0x7fa4800ca1b0 msgr2=0x7fa48015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:46.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.902+0000 7fa48634c640 1 --2- 172.21.15.107:0/2359866405 >> v2:172.21.15.157:3300/0 conn(0x7fa4800ca1b0 0x7fa48015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.902+0000 7fa48634c640 1 -- 172.21.15.107:0/2359866405 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4801598b0 con 0x7fa4800c9dd0 2023-12-16T01:25:46.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.904+0000 7fa48634c640 1 --2- 172.21.15.107:0/2359866405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800c9dd0 0x7fa4800c7700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4800ca700 tx=0x7fa47002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fa58e695dc5062 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:46.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.908+0000 7fa48534a640 1 -- 172.21.15.107:0/2359866405 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470030860 con 0x7fa4800c9dd0 2023-12-16T01:25:46.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.908+0000 7fa48534a640 1 -- 172.21.15.107:0/2359866405 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700309c0 con 0x7fa4800c9dd0 2023-12-16T01:25:46.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.908+0000 7fa48534a640 1 -- 172.21.15.107:0/2359866405 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470030d50 con 0x7fa4800c9dd0 2023-12-16T01:25:46.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 -- 172.21.15.107:0/2359866405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800c9dd0 msgr2=0x7fa4800c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 --2- 172.21.15.107:0/2359866405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800c9dd0 0x7fa4800c7700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4800ca700 tx=0x7fa47002b9a0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 -- 172.21.15.107:0/2359866405 shutdown_connections 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 --2- 172.21.15.107:0/2359866405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa48006f590 0x7fa48015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 --2- 172.21.15.107:0/2359866405 >> v2:172.21.15.157:3300/0 conn(0x7fa4800ca1b0 0x7fa48015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 --2- 172.21.15.107:0/2359866405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800c9dd0 0x7fa4800c7700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 -- 172.21.15.107:0/2359866405 >> 172.21.15.107:0/2359866405 conn(0x7fa480061100 msgr2=0x7fa4800614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 -- 172.21.15.107:0/2359866405 shutdown_connections 2023-12-16T01:25:46.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.909+0000 7fa4885b0640 1 -- 172.21.15.107:0/2359866405 wait complete. 2023-12-16T01:25:46.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.910+0000 7fa4885b0640 1 Processor -- start 2023-12-16T01:25:46.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.910+0000 7fa4885b0640 1 -- start start 2023-12-16T01:25:46.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.910+0000 7fa4885b0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48006f590 0x7fa4800ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:46.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa4885b0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4800c9dd0 0x7fa4800c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:46.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa4885b0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 0x7fa4801f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:46.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa4885b0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800ae1e0 con 0x7fa4800ca1b0 2023-12-16T01:25:46.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa4885b0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c5d30 con 0x7fa48006f590 2023-12-16T01:25:46.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa4885b0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801eef20 con 0x7fa4800c9dd0 2023-12-16T01:25:46.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa486b4d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 0x7fa4801f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:46.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa486b4d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 0x7fa4801f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55908/0 (socket says 172.21.15.107:55908) 2023-12-16T01:25:46.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa486b4d640 1 -- 172.21.15.107:0/3814036470 learned_addr learned my addr 172.21.15.107:0/3814036470 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:46.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa48634c640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48006f590 0x7fa4800ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:46.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.911+0000 7fa485b4b640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4800c9dd0 0x7fa4800c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:46.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.915+0000 7fa486b4d640 1 -- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4800c9dd0 msgr2=0x7fa4800c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:46.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.915+0000 7fa486b4d640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4800c9dd0 0x7fa4800c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.915+0000 7fa486b4d640 1 -- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48006f590 msgr2=0x7fa4800ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:46.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.915+0000 7fa486b4d640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48006f590 0x7fa4800ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:46.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.915+0000 7fa486b4d640 1 -- 172.21.15.107:0/3814036470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700094d0 con 0x7fa4800ca1b0 2023-12-16T01:25:46.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.917+0000 7fa486b4d640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 0x7fa4801f2510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa47800eed0 tx=0x7fa47800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:46.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.920+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478010040 con 0x7fa4800ca1b0 2023-12-16T01:25:46.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.920+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa478014400 con 0x7fa4800ca1b0 2023-12-16T01:25:46.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.920+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800c5a50 con 0x7fa4800ca1b0 2023-12-16T01:25:46.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.920+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478009ea0 con 0x7fa4800ca1b0 2023-12-16T01:25:46.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.920+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801ef410 con 0x7fa4800ca1b0 2023-12-16T01:25:46.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:46.921+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48015bcf0 con 0x7fa4800ca1b0 2023-12-16T01:25:47.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.162+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa4780147b0 con 0x7fa4800ca1b0 2023-12-16T01:25:47.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.162+0000 7fa476ffd640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa46406ae90 0x7fa46406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:47.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.162+0000 7fa48634c640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa46406ae90 0x7fa46406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:47.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.163+0000 7fa48634c640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa46406ae90 0x7fa46406d350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa470036000 tx=0x7fa470008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.180+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa4780592a0 con 0x7fa4800ca1b0 2023-12-16T01:25:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.180+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa4780555e0 con 0x7fa4800ca1b0 2023-12-16T01:25:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.355+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fa4800740e0 con 0x7fa4800ca1b0 2023-12-16T01:25:47.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.788+0000 7fa476ffd640 1 -- 172.21.15.107:0/3814036470 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fa478018020 con 0x7fa4800ca1b0 2023-12-16T01:25:47.789 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' created 2023-12-16T01:25:47.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa46406ae90 msgr2=0x7fa46406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:47.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa46406ae90 0x7fa46406d350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa470036000 tx=0x7fa470008030 comp rx=0 tx=0).stop 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 msgr2=0x7fa4801f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 0x7fa4801f2510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa47800eed0 tx=0x7fa47800b480 comp rx=0 tx=0).stop 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 shutdown_connections 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4800ca1b0 0x7fa4801f2510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4800c9dd0 0x7fa4800c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa46406ae90 0x7fa46406d350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 --2- 172.21.15.107:0/3814036470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48006f590 0x7fa4800ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 >> 172.21.15.107:0/3814036470 conn(0x7fa480061100 msgr2=0x7fa480158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 shutdown_connections 2023-12-16T01:25:47.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.790+0000 7fa4885b0640 1 -- 172.21.15.107:0/3814036470 wait complete. 2023-12-16T01:25:47.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-16T01:25:47.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 Processor -- start 2023-12-16T01:25:47.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 -- start start 2023-12-16T01:25:47.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68f406f590 0x7f68f4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:47.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f40c2000 0x7f68f40c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:47.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f406fa00 con 0x7f68f4151630 2023-12-16T01:25:47.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f4158490 con 0x7f68f406f590 2023-12-16T01:25:47.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.923+0000 7f68fb07c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40c29b0 con 0x7f68f40c2000 2023-12-16T01:25:47.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.924+0000 7f68f3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68f406f590 0x7f68f4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:47.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.924+0000 7f68f8e18640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f68f4151630 0x7f68f40c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:50254/0 (socket says 172.21.15.107:50254) 2023-12-16T01:25:47.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.924+0000 7f68f8e18640 1 -- 172.21.15.107:0/2956952369 learned_addr learned my addr 172.21.15.107:0/2956952369 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:47.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.926+0000 7f68f3fff640 1 -- 172.21.15.107:0/2956952369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f40c2000 msgr2=0x7f68f40c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:47.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.926+0000 7f68f3fff640 1 --2- 172.21.15.107:0/2956952369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f40c2000 0x7f68f40c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.926+0000 7f68f3fff640 1 -- 172.21.15.107:0/2956952369 >> v1:172.21.15.157:6789/0 conn(0x7f68f4151630 legacy=0x7f68f40c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:47.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.926+0000 7f68f3fff640 1 -- 172.21.15.107:0/2956952369 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f415b9c0 con 0x7f68f406f590 2023-12-16T01:25:47.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.928+0000 7f68f3fff640 1 --2- 172.21.15.107:0/2956952369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f406f590 0x7f68f4157f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68e00097a0 tx=0x7f68e002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b1c4beff135049 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:47.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.932+0000 7f68f37fe640 1 -- 172.21.15.107:0/2956952369 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0030610 con 0x7f68f406f590 2023-12-16T01:25:47.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.932+0000 7f68f37fe640 1 -- 172.21.15.107:0/2956952369 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0030770 con 0x7f68f406f590 2023-12-16T01:25:47.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.932+0000 7f68f37fe640 1 -- 172.21.15.107:0/2956952369 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0030b00 con 0x7f68f406f590 2023-12-16T01:25:47.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 -- 172.21.15.107:0/2956952369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f406f590 msgr2=0x7f68f4157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:47.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 --2- 172.21.15.107:0/2956952369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f406f590 0x7f68f4157f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68e00097a0 tx=0x7f68e002b960 comp rx=0 tx=0).stop 2023-12-16T01:25:47.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 -- 172.21.15.107:0/2956952369 shutdown_connections 2023-12-16T01:25:47.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 --2- 172.21.15.107:0/2956952369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f40c2000 0x7f68f40c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 --2- 172.21.15.107:0/2956952369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f406f590 0x7f68f4157f50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 -- 172.21.15.107:0/2956952369 >> 172.21.15.107:0/2956952369 conn(0x7f68f4061100 msgr2=0x7f68f40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 -- 172.21.15.107:0/2956952369 shutdown_connections 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.933+0000 7f68fb07c640 1 -- 172.21.15.107:0/2956952369 wait complete. 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.934+0000 7f68fb07c640 1 Processor -- start 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.934+0000 7f68fb07c640 1 -- start start 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68fb07c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f406f590 0x7f68f41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:47.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68fb07c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 0x7f68f414a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:47.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68fb07c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68f4151630 0x7f68f414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:47.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68fb07c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f415a7e0 con 0x7f68f40c2000 2023-12-16T01:25:47.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68fb07c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f414dca0 con 0x7f68f4151630 2023-12-16T01:25:47.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68fb07c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f414e410 con 0x7f68f406f590 2023-12-16T01:25:47.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 0x7f68f414a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:47.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68f9619640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68f4151630 0x7f68f414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:47.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 0x7f68f414a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55928/0 (socket says 172.21.15.107:55928) 2023-12-16T01:25:47.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.935+0000 7f68f3fff640 1 -- 172.21.15.107:0/487040306 learned_addr learned my addr 172.21.15.107:0/487040306 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:47.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.939+0000 7f68f3fff640 1 -- 172.21.15.107:0/487040306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f406f590 msgr2=0x7f68f41598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:47.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.939+0000 7f68f3fff640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f406f590 0x7f68f41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.939+0000 7f68f3fff640 1 -- 172.21.15.107:0/487040306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68f4151630 msgr2=0x7f68f414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:47.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.939+0000 7f68f3fff640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68f4151630 0x7f68f414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:47.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.939+0000 7f68f3fff640 1 -- 172.21.15.107:0/487040306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009400 con 0x7f68f40c2000 2023-12-16T01:25:47.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.941+0000 7f68f3fff640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 0x7f68f414a5c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098c0 tx=0x7f68e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:47.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.945+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e003e070 con 0x7f68f40c2000 2023-12-16T01:25:47.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.945+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00399d0 con 0x7f68f40c2000 2023-12-16T01:25:47.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.945+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0039d60 con 0x7f68f40c2000 2023-12-16T01:25:47.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.945+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f415a520 con 0x7f68f40c2000 2023-12-16T01:25:47.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.945+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f414d640 con 0x7f68f40c2000 2023-12-16T01:25:47.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:47.946+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f40740e0 con 0x7f68f40c2000 2023-12-16T01:25:48.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.238+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f68e00423f0 con 0x7f68f40c2000 2023-12-16T01:25:48.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.238+0000 7f68f17fa640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68d806ae40 0x7f68d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:48.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.239+0000 7f68f8e18640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68d806ae40 0x7f68d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:48.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.239+0000 7f68f8e18640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68d806ae40 0x7f68d806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68e8000f60 tx=0x7f68e8007a80 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:48.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.255+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f68e007a670 con 0x7f68f40c2000 2023-12-16T01:25:48.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.255+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f68e00769b0 con 0x7f68f40c2000 2023-12-16T01:25:48.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:48.467+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68f4061650 con 0x7f68f40c2000 2023-12-16T01:25:49.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.469+0000 7f68f17fa640 1 -- 172.21.15.107:0/487040306 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f68e0048020 con 0x7f68f40c2000 2023-12-16T01:25:49.470 INFO:teuthology.orchestra.run.smithi107.stderr:new fs with metadata pool 2 and data pool 3 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.471+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68d806ae40 msgr2=0x7f68d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.471+0000 7f68fb07c640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68d806ae40 0x7f68d806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68e8000f60 tx=0x7f68e8007a80 comp rx=0 tx=0).stop 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.471+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 msgr2=0x7f68f414a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.471+0000 7f68fb07c640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 0x7f68f414a5c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098c0 tx=0x7f68e00046c0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 shutdown_connections 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68d806ae40 0x7f68d806d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68f4151630 0x7f68f414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f40c2000 0x7f68f414a5c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 --2- 172.21.15.107:0/487040306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68f406f590 0x7f68f41598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 >> 172.21.15.107:0/487040306 conn(0x7f68f4061100 msgr2=0x7f68f40cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:49.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 shutdown_connections 2023-12-16T01:25:49.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.472+0000 7f68fb07c640 1 -- 172.21.15.107:0/487040306 wait complete. 2023-12-16T01:25:49.483 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-16T01:25:49.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-16T01:25:49.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.588+0000 7fe9f754c640 1 Processor -- start 2023-12-16T01:25:49.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.588+0000 7fe9f754c640 1 -- start start 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f754c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9f00ccef0 0x7fe9f00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f754c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00c9510 con 0x7fe9f00cd2d0 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f754c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f0159ad0 con 0x7fe9f015da20 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f754c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f0159db0 con 0x7fe9f00ccef0 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f5ae9640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe9f00cd2d0 0x7fe9f0153490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54586/0 (socket says 172.21.15.107:54586) 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f5ae9640 1 -- 172.21.15.107:0/169784543 learned_addr learned my addr 172.21.15.107:0/169784543 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.589+0000 7fe9f52e8640 1 --2- 172.21.15.107:0/169784543 >> v2:172.21.15.157:3300/0 conn(0x7fe9f00ccef0 0x7fe9f00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:49.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.591+0000 7fe9e7fff640 1 -- 172.21.15.107:0/169784543 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927378767 0 0) 0x7fe9f00c9510 con 0x7fe9f00cd2d0 2023-12-16T01:25:49.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.591+0000 7fe9e7fff640 1 -- 172.21.15.107:0/169784543 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9dc003520 con 0x7fe9f00cd2d0 2023-12-16T01:25:49.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.592+0000 7fe9f52e8640 1 -- 172.21.15.107:0/169784543 >> v1:172.21.15.157:6789/0 conn(0x7fe9f015da20 legacy=0x7fe9f00c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.592+0000 7fe9f52e8640 1 -- 172.21.15.107:0/169784543 >> v1:172.21.15.107:6789/0 conn(0x7fe9f00cd2d0 legacy=0x7fe9f0153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.592+0000 7fe9f52e8640 1 -- 172.21.15.107:0/169784543 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f015a090 con 0x7fe9f00ccef0 2023-12-16T01:25:49.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.597+0000 7fe9f52e8640 1 --2- 172.21.15.107:0/169784543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00ccef0 0x7fe9f00c7e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0097d0 tx=0x7fe9ec02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b797205de7423eae server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.601+0000 7fe9e7fff640 1 -- 172.21.15.107:0/169784543 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec030610 con 0x7fe9f00ccef0 2023-12-16T01:25:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.601+0000 7fe9e7fff640 1 -- 172.21.15.107:0/169784543 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec030770 con 0x7fe9f00ccef0 2023-12-16T01:25:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.601+0000 7fe9e7fff640 1 -- 172.21.15.107:0/169784543 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec030b00 con 0x7fe9f00ccef0 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 -- 172.21.15.107:0/169784543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00ccef0 msgr2=0x7fe9f00c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 --2- 172.21.15.107:0/169784543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00ccef0 0x7fe9f00c7e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0097d0 tx=0x7fe9ec02b960 comp rx=0 tx=0).stop 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 -- 172.21.15.107:0/169784543 shutdown_connections 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 --2- 172.21.15.107:0/169784543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00ccef0 0x7fe9f00c7e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 -- 172.21.15.107:0/169784543 >> 172.21.15.107:0/169784543 conn(0x7fe9f0060f20 msgr2=0x7fe9f0061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 -- 172.21.15.107:0/169784543 shutdown_connections 2023-12-16T01:25:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.602+0000 7fe9f754c640 1 -- 172.21.15.107:0/169784543 wait complete. 2023-12-16T01:25:49.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.603+0000 7fe9f754c640 1 Processor -- start 2023-12-16T01:25:49.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.603+0000 7fe9f754c640 1 -- start start 2023-12-16T01:25:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f754c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9f00ccef0 0x7fe9f014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f754c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00cd2d0 0x7fe9f01519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f754c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 0x7fe9f014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f754c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00c7460 con 0x7fe9f015da20 2023-12-16T01:25:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f754c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f01f2ef0 con 0x7fe9f00cd2d0 2023-12-16T01:25:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f754c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00c7180 con 0x7fe9f00ccef0 2023-12-16T01:25:49.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.604+0000 7fe9f5ae9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 0x7fe9f014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:49.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.605+0000 7fe9f5ae9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 0x7fe9f014c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47194/0 (socket says 172.21.15.107:47194) 2023-12-16T01:25:49.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.605+0000 7fe9f4ae7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00cd2d0 0x7fe9f01519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:49.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.605+0000 7fe9f5ae9640 1 -- 172.21.15.107:0/3782144451 learned_addr learned my addr 172.21.15.107:0/3782144451 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:49.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.605+0000 7fe9f52e8640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9f00ccef0 0x7fe9f014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.608+0000 7fe9f5ae9640 1 -- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9f00ccef0 msgr2=0x7fe9f014dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.608+0000 7fe9f5ae9640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9f00ccef0 0x7fe9f014dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.608+0000 7fe9f5ae9640 1 -- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00cd2d0 msgr2=0x7fe9f01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.608+0000 7fe9f5ae9640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00cd2d0 0x7fe9f01519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.608+0000 7fe9f5ae9640 1 -- 172.21.15.107:0/3782144451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec009400 con 0x7fe9f015da20 2023-12-16T01:25:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.611+0000 7fe9f5ae9640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 0x7fe9f014c5b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800cae0 tx=0x7fe9e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.614+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800ac40 con 0x7fe9f015da20 2023-12-16T01:25:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.614+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e800ada0 con 0x7fe9f015da20 2023-12-16T01:25:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.614+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8012640 con 0x7fe9f015da20 2023-12-16T01:25:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.614+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f014d3a0 con 0x7fe9f015da20 2023-12-16T01:25:49.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.614+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f014e0e0 con 0x7fe9f015da20 2023-12-16T01:25:49.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.615+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f014d200 con 0x7fe9f015da20 2023-12-16T01:25:49.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.856+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe9e8007070 con 0x7fe9f015da20 2023-12-16T01:25:49.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.857+0000 7fe9e5ffb640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9d406ae90 0x7fe9d406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:49.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.857+0000 7fe9f52e8640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9d406ae90 0x7fe9d406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:49.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.857+0000 7fe9f52e8640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9d406ae90 0x7fe9d406d350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec036000 tx=0x7fe9ec008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:49.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.869+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9e8013e50 con 0x7fe9f015da20 2023-12-16T01:25:49.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:49.869+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe9e8054990 con 0x7fe9f015da20 2023-12-16T01:25:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:50.054+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe9f014d8c0 con 0x7fe9f015da20 2023-12-16T01:25:51.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.142+0000 7fe9e5ffb640 1 -- 172.21.15.107:0/3782144451 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe9f014d8c0 con 0x7fe9f015da20 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9d406ae90 msgr2=0x7fe9d406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9d406ae90 0x7fe9d406d350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec036000 tx=0x7fe9ec008030 comp rx=0 tx=0).stop 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 msgr2=0x7fe9f014c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 0x7fe9f014c5b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800cae0 tx=0x7fe9e800a060 comp rx=0 tx=0).stop 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 shutdown_connections 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9f015da20 0x7fe9f014c5b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9d406ae90 0x7fe9d406d350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f00cd2d0 0x7fe9f01519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 --2- 172.21.15.107:0/3782144451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9f00ccef0 0x7fe9f014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 >> 172.21.15.107:0/3782144451 conn(0x7fe9f0060f20 msgr2=0x7fe9f0158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:51.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 shutdown_connections 2023-12-16T01:25:51.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.146+0000 7fe9f754c640 1 -- 172.21.15.107:0/3782144451 wait complete. 2023-12-16T01:25:51.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T01:25:51.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 Processor -- start 2023-12-16T01:25:51.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 -- start start 2023-12-16T01:25:51.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1d50151530 0x7f1d500c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:51.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1d500ca160 0x7f1d5015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:51.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d50158300 con 0x7f1d50157e90 2023-12-16T01:25:51.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500c84d0 con 0x7f1d500ca160 2023-12-16T01:25:51.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.266+0000 7f1d568b4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500c8de0 con 0x7f1d50151530 2023-12-16T01:25:51.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.267+0000 7f1d4ffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1d50151530 0x7f1d500c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:51.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.267+0000 7f1d54e51640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1d50157e90 0x7f1d50070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54596/0 (socket says 172.21.15.107:54596) 2023-12-16T01:25:51.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.267+0000 7f1d54e51640 1 -- 172.21.15.107:0/3379095264 learned_addr learned my addr 172.21.15.107:0/3379095264 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:51.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.267+0000 7f1d4f7fe640 1 --2- 172.21.15.107:0/3379095264 >> v2:172.21.15.107:3300/0 conn(0x7f1d500ca160 0x7f1d5015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:51.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.269+0000 7f1d4ffff640 1 -- 172.21.15.107:0/3379095264 >> v2:172.21.15.107:3300/0 conn(0x7f1d500ca160 msgr2=0x7f1d5015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:51.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.269+0000 7f1d4ffff640 1 --2- 172.21.15.107:0/3379095264 >> v2:172.21.15.107:3300/0 conn(0x7f1d500ca160 0x7f1d5015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.269+0000 7f1d4ffff640 1 -- 172.21.15.107:0/3379095264 >> v1:172.21.15.107:6789/0 conn(0x7f1d50157e90 legacy=0x7f1d50070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:51.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.269+0000 7f1d4ffff640 1 -- 172.21.15.107:0/3379095264 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500c90c0 con 0x7f1d50151530 2023-12-16T01:25:51.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.272+0000 7f1d4ffff640 1 --2- 172.21.15.107:0/3379095264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d50151530 0x7f1d500c8750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d50071740 tx=0x7f1d4002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bfdcfbc98ad3901 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:51.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.275+0000 7f1d4effd640 1 -- 172.21.15.107:0/3379095264 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40030610 con 0x7f1d50151530 2023-12-16T01:25:51.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.275+0000 7f1d4effd640 1 -- 172.21.15.107:0/3379095264 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d40030770 con 0x7f1d50151530 2023-12-16T01:25:51.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.275+0000 7f1d4effd640 1 -- 172.21.15.107:0/3379095264 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40030b00 con 0x7f1d50151530 2023-12-16T01:25:51.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 -- 172.21.15.107:0/3379095264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d50151530 msgr2=0x7f1d500c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:51.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 --2- 172.21.15.107:0/3379095264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d50151530 0x7f1d500c8750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d50071740 tx=0x7f1d4002b960 comp rx=0 tx=0).stop 2023-12-16T01:25:51.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 -- 172.21.15.107:0/3379095264 shutdown_connections 2023-12-16T01:25:51.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 --2- 172.21.15.107:0/3379095264 >> v2:172.21.15.107:3300/0 conn(0x7f1d500ca160 0x7f1d5015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 --2- 172.21.15.107:0/3379095264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d50151530 0x7f1d500c8750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 -- 172.21.15.107:0/3379095264 >> 172.21.15.107:0/3379095264 conn(0x7f1d5006ab30 msgr2=0x7f1d5006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:51.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 -- 172.21.15.107:0/3379095264 shutdown_connections 2023-12-16T01:25:51.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.276+0000 7f1d568b4640 1 -- 172.21.15.107:0/3379095264 wait complete. 2023-12-16T01:25:51.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.277+0000 7f1d568b4640 1 Processor -- start 2023-12-16T01:25:51.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.277+0000 7f1d568b4640 1 -- start start 2023-12-16T01:25:51.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.278+0000 7f1d568b4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d500ca160 0x7f1d501ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.278+0000 7f1d568b4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d50151530 0x7f1d5014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.278+0000 7f1d568b4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 0x7f1d500caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.278+0000 7f1d568b4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c57f0 con 0x7f1d50157e90 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.278+0000 7f1d568b4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501eddb0 con 0x7f1d500ca160 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.278+0000 7f1d568b4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c4e10 con 0x7f1d50151530 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.279+0000 7f1d54e51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 0x7f1d500caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.279+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d500ca160 0x7f1d501ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.279+0000 7f1d4f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d50151530 0x7f1d5014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.279+0000 7f1d54e51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 0x7f1d500caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47210/0 (socket says 172.21.15.107:47210) 2023-12-16T01:25:51.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.279+0000 7f1d54e51640 1 -- 172.21.15.107:0/2895561788 learned_addr learned my addr 172.21.15.107:0/2895561788 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:51.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.282+0000 7f1d54e51640 1 -- 172.21.15.107:0/2895561788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d50151530 msgr2=0x7f1d5014fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:51.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.282+0000 7f1d54e51640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d50151530 0x7f1d5014fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.282+0000 7f1d54e51640 1 -- 172.21.15.107:0/2895561788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d500ca160 msgr2=0x7f1d501ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:51.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.282+0000 7f1d54e51640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d500ca160 0x7f1d501ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:51.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.282+0000 7f1d54e51640 1 -- 172.21.15.107:0/2895561788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40009400 con 0x7f1d50157e90 2023-12-16T01:25:51.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.284+0000 7f1d54e51640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 0x7f1d500caa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800cbf0 tx=0x7f1d4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:51.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.288+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800ace0 con 0x7f1d50157e90 2023-12-16T01:25:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.288+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4800ae40 con 0x7f1d50157e90 2023-12-16T01:25:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.288+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48012600 con 0x7f1d50157e90 2023-12-16T01:25:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.288+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d50158900 con 0x7f1d50157e90 2023-12-16T01:25:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.288+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d500c44e0 con 0x7f1d50157e90 2023-12-16T01:25:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.289+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d500c4fc0 con 0x7f1d50157e90 2023-12-16T01:25:51.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.306+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1d48007070 con 0x7f1d50157e90 2023-12-16T01:25:51.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.306+0000 7f1d4cff9640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1d3c06ae90 0x7f1d3c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:51.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.307+0000 7f1d4ffff640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1d3c06ae90 0x7f1d3c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:51.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.307+0000 7f1d4ffff640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1d3c06ae90 0x7f1d3c06d350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1d40036000 tx=0x7f1d4003b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:51.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.541+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1d48058490 con 0x7f1d50157e90 2023-12-16T01:25:51.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.541+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1d480547d0 con 0x7f1d50157e90 2023-12-16T01:25:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:51.717+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1d50158300 con 0x7f1d50157e90 2023-12-16T01:25:53.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.901+0000 7f1d4cff9640 1 -- 172.21.15.107:0/2895561788 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f1d50158300 con 0x7f1d50157e90 2023-12-16T01:25:53.902 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data_ec' created 2023-12-16T01:25:53.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1d3c06ae90 msgr2=0x7f1d3c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:53.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1d3c06ae90 0x7f1d3c06d350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1d40036000 tx=0x7f1d4003b040 comp rx=0 tx=0).stop 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 msgr2=0x7f1d500caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 0x7f1d500caa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800cbf0 tx=0x7f1d4800a430 comp rx=0 tx=0).stop 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 shutdown_connections 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d50157e90 0x7f1d500caa60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d50151530 0x7f1d5014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1d3c06ae90 0x7f1d3c06d350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 --2- 172.21.15.107:0/2895561788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d500ca160 0x7f1d501ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 >> 172.21.15.107:0/2895561788 conn(0x7f1d5006ab30 msgr2=0x7f1d500c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.903+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 shutdown_connections 2023-12-16T01:25:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:53.904+0000 7f1d568b4640 1 -- 172.21.15.107:0/2895561788 wait complete. 2023-12-16T01:25:53.916 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-16T01:25:54.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.025+0000 7ff72b207640 1 Processor -- start 2023-12-16T01:25:54.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.025+0000 7ff72b207640 1 -- start start 2023-12-16T01:25:54.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.026+0000 7ff72b207640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff724153ba0 0x7ff72415a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:54.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.026+0000 7ff72b207640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406c7f0 0x7ff72406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:54.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.026+0000 7ff72b207640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72415a640 con 0x7ff72406bef0 2023-12-16T01:25:54.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.026+0000 7ff72b207640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240b2a60 con 0x7ff724153ba0 2023-12-16T01:25:54.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.026+0000 7ff72b207640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72415cdb0 con 0x7ff72406c7f0 2023-12-16T01:25:54.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.027+0000 7ff728fa3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff724153ba0 0x7ff72415a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:54.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.027+0000 7ff7297a4640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff72406bef0 0x7ff7240c4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54602/0 (socket says 172.21.15.107:54602) 2023-12-16T01:25:54.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.027+0000 7ff7297a4640 1 -- 172.21.15.107:0/3377592041 learned_addr learned my addr 172.21.15.107:0/3377592041 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:54.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.031+0000 7ff728fa3640 1 -- 172.21.15.107:0/3377592041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406c7f0 msgr2=0x7ff72406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:54.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.031+0000 7ff728fa3640 1 --2- 172.21.15.107:0/3377592041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406c7f0 0x7ff72406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.031+0000 7ff728fa3640 1 -- 172.21.15.107:0/3377592041 >> v1:172.21.15.107:6789/0 conn(0x7ff72406bef0 legacy=0x7ff7240c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:54.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.031+0000 7ff728fa3640 1 -- 172.21.15.107:0/3377592041 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72415d090 con 0x7ff724153ba0 2023-12-16T01:25:54.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.036+0000 7ff728fa3640 1 --2- 172.21.15.107:0/3377592041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff724153ba0 0x7ff72415a100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097a0 tx=0x7ff70c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b33d623e3cf423 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:54.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.039+0000 7ff7237fe640 1 -- 172.21.15.107:0/3377592041 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c02f050 con 0x7ff724153ba0 2023-12-16T01:25:54.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.039+0000 7ff7237fe640 1 -- 172.21.15.107:0/3377592041 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c031700 con 0x7ff724153ba0 2023-12-16T01:25:54.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.039+0000 7ff7237fe640 1 -- 172.21.15.107:0/3377592041 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c031a90 con 0x7ff724153ba0 2023-12-16T01:25:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 -- 172.21.15.107:0/3377592041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff724153ba0 msgr2=0x7ff72415a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 --2- 172.21.15.107:0/3377592041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff724153ba0 0x7ff72415a100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097a0 tx=0x7ff70c02b7a0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 -- 172.21.15.107:0/3377592041 shutdown_connections 2023-12-16T01:25:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 --2- 172.21.15.107:0/3377592041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406c7f0 0x7ff72406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 --2- 172.21.15.107:0/3377592041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff724153ba0 0x7ff72415a100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 -- 172.21.15.107:0/3377592041 >> 172.21.15.107:0/3377592041 conn(0x7ff7240cee20 msgr2=0x7ff7240cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 -- 172.21.15.107:0/3377592041 shutdown_connections 2023-12-16T01:25:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.040+0000 7ff72b207640 1 -- 172.21.15.107:0/3377592041 wait complete. 2023-12-16T01:25:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.041+0000 7ff72b207640 1 Processor -- start 2023-12-16T01:25:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 -- start start 2023-12-16T01:25:54.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406bef0 0x7ff72414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:54.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 0x7ff72414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff724153ba0 0x7ff7240c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c8090 con 0x7ff72406c7f0 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c7cd0 con 0x7ff724153ba0 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.042+0000 7ff72b207640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c7450 con 0x7ff72406bef0 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.043+0000 7ff723fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 0x7ff72414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.043+0000 7ff723fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 0x7ff72414c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47226/0 (socket says 172.21.15.107:47226) 2023-12-16T01:25:54.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.043+0000 7ff723fff640 1 -- 172.21.15.107:0/2825918855 learned_addr learned my addr 172.21.15.107:0/2825918855 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:54.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.046+0000 7ff723fff640 1 -- 172.21.15.107:0/2825918855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406bef0 msgr2=0x7ff72414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:54.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.046+0000 7ff723fff640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406bef0 0x7ff72414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.046+0000 7ff723fff640 1 -- 172.21.15.107:0/2825918855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff724153ba0 msgr2=0x7ff7240c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:54.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.046+0000 7ff723fff640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff724153ba0 0x7ff7240c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.046+0000 7ff723fff640 1 -- 172.21.15.107:0/2825918855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009400 con 0x7ff72406c7f0 2023-12-16T01:25:54.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.048+0000 7ff723fff640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 0x7ff72414c780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff71400b4a0 tx=0x7ff71400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:54.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.052+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714010610 con 0x7ff72406c7f0 2023-12-16T01:25:54.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.052+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714010770 con 0x7ff72406c7f0 2023-12-16T01:25:54.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.052+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714010b20 con 0x7ff72406c7f0 2023-12-16T01:25:54.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.052+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7240c7710 con 0x7ff72406c7f0 2023-12-16T01:25:54.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.052+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7240c41b0 con 0x7ff72406c7f0 2023-12-16T01:25:54.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.053+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7240c3ff0 con 0x7ff72406c7f0 2023-12-16T01:25:54.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.071+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff714010c80 con 0x7ff72406c7f0 2023-12-16T01:25:54.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.072+0000 7ff7217fa640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff70406aec0 0x7ff70406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:54.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.072+0000 7ff728fa3640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff70406aec0 0x7ff70406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:54.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.072+0000 7ff728fa3640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff70406aec0 0x7ff70406d380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff70c035000 tx=0x7ff70c030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:54.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.308+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff714058af0 con 0x7ff72406c7f0 2023-12-16T01:25:54.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.309+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff714054730 con 0x7ff72406c7f0 2023-12-16T01:25:54.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.475+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff724067570 con 0x7ff72406c7f0 2023-12-16T01:25:54.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.877+0000 7ff7217fa640 1 -- 172.21.15.107:0/2825918855 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff71401e020 con 0x7ff72406c7f0 2023-12-16T01:25:54.878 INFO:teuthology.orchestra.run.smithi107.stderr:set pool 4 allow_ec_overwrites to true 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff70406aec0 msgr2=0x7ff70406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff70406aec0 0x7ff70406d380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff70c035000 tx=0x7ff70c030000 comp rx=0 tx=0).stop 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 msgr2=0x7ff72414c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 0x7ff72414c780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff71400b4a0 tx=0x7ff71400b960 comp rx=0 tx=0).stop 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 shutdown_connections 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff70406aec0 0x7ff70406d380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.879+0000 7ff72b207640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff724153ba0 0x7ff7240c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.880+0000 7ff72b207640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff72406c7f0 0x7ff72414c780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.880+0000 7ff72b207640 1 --2- 172.21.15.107:0/2825918855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff72406bef0 0x7ff72414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:54.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.880+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 >> 172.21.15.107:0/2825918855 conn(0x7ff7240cee20 msgr2=0x7ff7241e29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:54.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.880+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 shutdown_connections 2023-12-16T01:25:54.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:54.880+0000 7ff72b207640 1 -- 172.21.15.107:0/2825918855 wait complete. 2023-12-16T01:25:54.891 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-16T01:25:55.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.009+0000 7fbd31c6e640 1 Processor -- start 2023-12-16T01:25:55.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.010+0000 7fbd31c6e640 1 -- start start 2023-12-16T01:25:55.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.010+0000 7fbd31c6e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbd2c1514f0 0x7fbd2c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:55.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.010+0000 7fbd31c6e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd2c1518d0 0x7fbd2c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:55.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.010+0000 7fbd31c6e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c15b8f0 con 0x7fbd2c0709c0 2023-12-16T01:25:55.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.010+0000 7fbd31c6e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c158320 con 0x7fbd2c1518d0 2023-12-16T01:25:55.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.010+0000 7fbd31c6e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c1574c0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.053+0000 7fbd2affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd2c1518d0 0x7fbd2c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:55.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.053+0000 7fbd2affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd2c1518d0 0x7fbd2c15b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47230/0 (socket says 172.21.15.107:47230) 2023-12-16T01:25:55.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.053+0000 7fbd2affd640 1 -- 172.21.15.107:0/525316532 learned_addr learned my addr 172.21.15.107:0/525316532 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:55.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.055+0000 7fbd2affd640 1 -- 172.21.15.107:0/525316532 >> v2:172.21.15.157:3300/0 conn(0x7fbd2c1514f0 msgr2=0x7fbd2c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:55.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.055+0000 7fbd2affd640 1 --2- 172.21.15.107:0/525316532 >> v2:172.21.15.157:3300/0 conn(0x7fbd2c1514f0 0x7fbd2c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:55.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.055+0000 7fbd2affd640 1 -- 172.21.15.107:0/525316532 >> v1:172.21.15.157:6789/0 conn(0x7fbd2c0709c0 legacy=0x7fbd2c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:55.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.055+0000 7fbd2affd640 1 -- 172.21.15.107:0/525316532 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c1577a0 con 0x7fbd2c1518d0 2023-12-16T01:25:55.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.057+0000 7fbd2affd640 1 --2- 172.21.15.107:0/525316532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c15b3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0cdeb0 tx=0x7fbd1c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3748b9a132040931 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:55.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.061+0000 7fbd2a7fc640 1 -- 172.21.15.107:0/525316532 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c030860 con 0x7fbd2c1518d0 2023-12-16T01:25:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.061+0000 7fbd2a7fc640 1 -- 172.21.15.107:0/525316532 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0309c0 con 0x7fbd2c1518d0 2023-12-16T01:25:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.061+0000 7fbd2a7fc640 1 -- 172.21.15.107:0/525316532 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c030d50 con 0x7fbd2c1518d0 2023-12-16T01:25:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.061+0000 7fbd31c6e640 1 -- 172.21.15.107:0/525316532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1518d0 msgr2=0x7fbd2c15b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.061+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/525316532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c15b3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0cdeb0 tx=0x7fbd1c02b9a0 comp rx=0 tx=0).stop 2023-12-16T01:25:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.062+0000 7fbd31c6e640 1 -- 172.21.15.107:0/525316532 shutdown_connections 2023-12-16T01:25:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.062+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/525316532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c15b3b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.062+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/525316532 >> v2:172.21.15.157:3300/0 conn(0x7fbd2c1514f0 0x7fbd2c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.062+0000 7fbd31c6e640 1 -- 172.21.15.107:0/525316532 >> 172.21.15.107:0/525316532 conn(0x7fbd2c070020 msgr2=0x7fbd2c06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.062+0000 7fbd31c6e640 1 -- 172.21.15.107:0/525316532 shutdown_connections 2023-12-16T01:25:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.062+0000 7fbd31c6e640 1 -- 172.21.15.107:0/525316532 wait complete. 2023-12-16T01:25:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.063+0000 7fbd31c6e640 1 Processor -- start 2023-12-16T01:25:55.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.063+0000 7fbd31c6e640 1 -- start start 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd31c6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd2c0709c0 0x7fbd2c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd31c6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 0x7fbd2c146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd31c6e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c1f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd31c6e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c158ff0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd31c6e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c147a30 con 0x7fbd2c1518d0 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd31c6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c15a0c0 con 0x7fbd2c0709c0 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.064+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 0x7fbd2c146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.065+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 0x7fbd2c146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47234/0 (socket says 172.21.15.107:47234) 2023-12-16T01:25:55.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.065+0000 7fbd2affd640 1 -- 172.21.15.107:0/3946565932 learned_addr learned my addr 172.21.15.107:0/3946565932 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:55.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.066+0000 7fbd2bfff640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c1f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:55.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.068+0000 7fbd2affd640 1 -- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd2c0709c0 msgr2=0x7fbd2c159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:55.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.068+0000 7fbd2affd640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd2c0709c0 0x7fbd2c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:55.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.068+0000 7fbd2affd640 1 -- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2c1518d0 msgr2=0x7fbd2c1f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:55.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.068+0000 7fbd2affd640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c1f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:55.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.068+0000 7fbd2affd640 1 -- 172.21.15.107:0/3946565932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0094d0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.071+0000 7fbd2affd640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 0x7fbd2c146e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c000c00 tx=0x7fbd1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.075+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c039c20 con 0x7fbd2c1514f0 2023-12-16T01:25:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.076+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c039da0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.076+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c06d0b0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.076+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c043630 con 0x7fbd2c1514f0 2023-12-16T01:25:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.076+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c15a5a0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.077+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c067d40 con 0x7fbd2c1514f0 2023-12-16T01:25:55.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.096+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fbd1c04c3b0 con 0x7fbd2c1514f0 2023-12-16T01:25:55.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.096+0000 7fbd13fff640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd1806aec0 0x7fbd1806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:55.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.097+0000 7fbd2b7fe640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd1806aec0 0x7fbd1806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:55.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.097+0000 7fbd2b7fe640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd1806aec0 0x7fbd1806d380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c145720 tx=0x7fbd20006c90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:55.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.100+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fbd1c07b100 con 0x7fbd2c1514f0 2023-12-16T01:25:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.332+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fbd1c077440 con 0x7fbd2c1514f0 2023-12-16T01:25:55.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:55.542+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fbd2c06d240 con 0x7fbd2c1514f0 2023-12-16T01:25:56.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.151+0000 7fbd13fff640 1 -- 172.21.15.107:0/3946565932 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fbd1c048020 con 0x7fbd2c1514f0 2023-12-16T01:25:56.152 INFO:teuthology.orchestra.run.smithi107.stderr:added data pool 4 to fsmap 2023-12-16T01:25:56.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd1806aec0 msgr2=0x7fbd1806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd1806aec0 0x7fbd1806d380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c145720 tx=0x7fbd20006c90 comp rx=0 tx=0).stop 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 msgr2=0x7fbd2c146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 0x7fbd2c146e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c000c00 tx=0x7fbd1c004730 comp rx=0 tx=0).stop 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 shutdown_connections 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd1806aec0 0x7fbd1806d380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2c1518d0 0x7fbd2c1f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2c1514f0 0x7fbd2c146e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 --2- 172.21.15.107:0/3946565932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd2c0709c0 0x7fbd2c159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.153+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 >> 172.21.15.107:0/3946565932 conn(0x7fbd2c070020 msgr2=0x7fbd2c0c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.154+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 shutdown_connections 2023-12-16T01:25:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.154+0000 7fbd31c6e640 1 -- 172.21.15.107:0/3946565932 wait complete. 2023-12-16T01:25:56.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:25:56.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.264+0000 7f1871b9e640 1 Processor -- start 2023-12-16T01:25:56.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.264+0000 7f1871b9e640 1 -- start start 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.265+0000 7f1871b9e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f186c153c70 0x7f186c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.265+0000 7f1871b9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.265+0000 7f1871b9e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c15a700 con 0x7f186c153890 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.265+0000 7f1871b9e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c0ca870 con 0x7f186c153c70 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.265+0000 7f1871b9e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c159af0 con 0x7f186c0ceef0 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.266+0000 7f186b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f186c153890 0x7f186c0c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54608/0 (socket says 172.21.15.107:54608) 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.266+0000 7f186b7fe640 1 -- 172.21.15.107:0/3360472949 learned_addr learned my addr 172.21.15.107:0/3360472949 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.266+0000 7f186affd640 1 --2- 172.21.15.107:0/3360472949 >> v2:172.21.15.157:3300/0 conn(0x7f186c153c70 0x7f186c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.266+0000 7f186bfff640 1 --2- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.268+0000 7f186a7fc640 1 -- 172.21.15.107:0/3360472949 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000160510 0 0) 0x7f186c15a700 con 0x7f186c153890 2023-12-16T01:25:56.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.268+0000 7f186a7fc640 1 -- 172.21.15.107:0/3360472949 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854003520 con 0x7f186c153890 2023-12-16T01:25:56.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.269+0000 7f186affd640 1 -- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 msgr2=0x7f186c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:56.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.269+0000 7f186affd640 1 --2- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.269+0000 7f186affd640 1 -- 172.21.15.107:0/3360472949 >> v1:172.21.15.107:6789/0 conn(0x7f186c153890 legacy=0x7f186c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.269+0000 7f186affd640 1 -- 172.21.15.107:0/3360472949 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c159dd0 con 0x7f186c153c70 2023-12-16T01:25:56.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.271+0000 7f186affd640 1 --2- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153c70 0x7f186c15d950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18600097a0 tx=0x7f186002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4be030d427cbedb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:56.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.274+0000 7f186a7fc640 1 -- 172.21.15.107:0/3360472949 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860030610 con 0x7f186c153c70 2023-12-16T01:25:56.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.274+0000 7f186a7fc640 1 -- 172.21.15.107:0/3360472949 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860030770 con 0x7f186c153c70 2023-12-16T01:25:56.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.274+0000 7f186a7fc640 1 -- 172.21.15.107:0/3360472949 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860030b00 con 0x7f186c153c70 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 -- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153c70 msgr2=0x7f186c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 --2- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153c70 0x7f186c15d950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18600097a0 tx=0x7f186002b960 comp rx=0 tx=0).stop 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 -- 172.21.15.107:0/3360472949 shutdown_connections 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 --2- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 --2- 172.21.15.107:0/3360472949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153c70 0x7f186c15d950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 -- 172.21.15.107:0/3360472949 >> 172.21.15.107:0/3360472949 conn(0x7f186c06ba00 msgr2=0x7f186c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 -- 172.21.15.107:0/3360472949 shutdown_connections 2023-12-16T01:25:56.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.275+0000 7f1871b9e640 1 -- 172.21.15.107:0/3360472949 wait complete. 2023-12-16T01:25:56.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.276+0000 7f1871b9e640 1 Processor -- start 2023-12-16T01:25:56.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 -- start start 2023-12-16T01:25:56.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153890 0x7f186c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 0x7f186c13f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0cd4e0 con 0x7f186c153c70 2023-12-16T01:25:56.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0cec70 con 0x7f186c153890 2023-12-16T01:25:56.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.277+0000 7f1871b9e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0cd6d0 con 0x7f186c0ceef0 2023-12-16T01:25:56.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.278+0000 7f186bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 0x7f186c13f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.278+0000 7f186affd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153890 0x7f186c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.278+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.278+0000 7f186bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 0x7f186c13f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47238/0 (socket says 172.21.15.107:47238) 2023-12-16T01:25:56.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.278+0000 7f186bfff640 1 -- 172.21.15.107:0/2523116198 learned_addr learned my addr 172.21.15.107:0/2523116198 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:56.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.281+0000 7f186bfff640 1 -- 172.21.15.107:0/2523116198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 msgr2=0x7f186c0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.281+0000 7f186bfff640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.281+0000 7f186bfff640 1 -- 172.21.15.107:0/2523116198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153890 msgr2=0x7f186c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.281+0000 7f186bfff640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153890 0x7f186c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.281+0000 7f186bfff640 1 -- 172.21.15.107:0/2523116198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860009400 con 0x7f186c153c70 2023-12-16T01:25:56.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.283+0000 7f186bfff640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 0x7f186c13f9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f186400efc0 tx=0x7f186400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:56.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.287+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864014480 con 0x7f186c153c70 2023-12-16T01:25:56.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.287+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400f040 con 0x7f186c153c70 2023-12-16T01:25:56.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.287+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c0ce640 con 0x7f186c153c70 2023-12-16T01:25:56.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.287+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864014820 con 0x7f186c153c70 2023-12-16T01:25:56.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.287+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c1efbd0 con 0x7f186c153c70 2023-12-16T01:25:56.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.288+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c067500 con 0x7f186c153c70 2023-12-16T01:25:56.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.531+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1864014980 con 0x7f186c153c70 2023-12-16T01:25:56.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.531+0000 7f1853fff640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f185806ae90 0x7f185806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.531+0000 7f186b7fe640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f185806ae90 0x7f185806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.532+0000 7f186b7fe640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f185806ae90 0x7f185806d350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f185c005880 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:56.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.544+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1864059770 con 0x7f186c153c70 2023-12-16T01:25:56.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.544+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1864055ab0 con 0x7f186c153c70 2023-12-16T01:25:56.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.745+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f186c0cb6d0 con 0x7f186c153c70 2023-12-16T01:25:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.770+0000 7f1853fff640 1 -- 172.21.15.107:0/2523116198 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6529 (secure 0 0 0) 0x7f1864018070 con 0x7f186c153c70 2023-12-16T01:25:56.771 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:56.771 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:25:55.558353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-16T01:25:56.772 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 7 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f185806ae90 msgr2=0x7f185806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f185806ae90 0x7f185806d350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f185c005880 tx=0x7f185c009040 comp rx=0 tx=0).stop 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 msgr2=0x7f186c13f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 0x7f186c13f9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f186400efc0 tx=0x7f186400c490 comp rx=0 tx=0).stop 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 shutdown_connections 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c153c70 0x7f186c13f9e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f185806ae90 0x7f185806d350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f186c153890 0x7f186c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 --2- 172.21.15.107:0/2523116198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f186c0ceef0 0x7f186c0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 >> 172.21.15.107:0/2523116198 conn(0x7f186c06ba00 msgr2=0x7f186c15c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 shutdown_connections 2023-12-16T01:25:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.773+0000 7f1871b9e640 1 -- 172.21.15.107:0/2523116198 wait complete. 2023-12-16T01:25:56.784 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:56.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.884+0000 7f0af3831640 1 Processor -- start 2023-12-16T01:25:56.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.884+0000 7f0af3831640 1 -- start start 2023-12-16T01:25:56.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.885+0000 7f0af3831640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.885+0000 7f0af3831640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0aec0c6280 0x7f0aec0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.885+0000 7f0af3831640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0ca460 con 0x7f0aec0caea0 2023-12-16T01:25:56.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.885+0000 7f0af3831640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec0c8960 con 0x7f0aec0c6280 2023-12-16T01:25:56.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.885+0000 7f0af3831640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec159a40 con 0x7f0aec153900 2023-12-16T01:25:56.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.886+0000 7f0af15cd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.886+0000 7f0af0dcc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0aec0c6280 0x7f0aec0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.886+0000 7f0af15cd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:60238/0 (socket says 172.21.15.107:60238) 2023-12-16T01:25:56.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.886+0000 7f0af15cd640 1 -- 172.21.15.107:0/3606472097 learned_addr learned my addr 172.21.15.107:0/3606472097 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:56.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.889+0000 7f0af15cd640 1 -- 172.21.15.107:0/3606472097 >> v2:172.21.15.157:3300/0 conn(0x7f0aec0c6280 msgr2=0x7f0aec0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:56.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.889+0000 7f0af15cd640 1 --2- 172.21.15.107:0/3606472097 >> v2:172.21.15.157:3300/0 conn(0x7f0aec0c6280 0x7f0aec0ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.889+0000 7f0af15cd640 1 -- 172.21.15.107:0/3606472097 >> v1:172.21.15.157:6789/0 conn(0x7f0aec0caea0 legacy=0x7f0aec0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.889+0000 7f0af15cd640 1 -- 172.21.15.107:0/3606472097 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec159d20 con 0x7f0aec153900 2023-12-16T01:25:56.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.891+0000 7f0af15cd640 1 --2- 172.21.15.107:0/3606472097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec0c9e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009870 tx=0x7f0ae802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9598d2d3f211d246 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:56.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0ae3fff640 1 -- 172.21.15.107:0/3606472097 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8031640 con 0x7f0aec153900 2023-12-16T01:25:56.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0ae3fff640 1 -- 172.21.15.107:0/3606472097 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80317a0 con 0x7f0aec153900 2023-12-16T01:25:56.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0ae3fff640 1 -- 172.21.15.107:0/3606472097 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8031b30 con 0x7f0aec153900 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0af3831640 1 -- 172.21.15.107:0/3606472097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 msgr2=0x7f0aec0c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0af3831640 1 --2- 172.21.15.107:0/3606472097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec0c9e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009870 tx=0x7f0ae802b8f0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0af3831640 1 -- 172.21.15.107:0/3606472097 shutdown_connections 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0af3831640 1 --2- 172.21.15.107:0/3606472097 >> v2:172.21.15.157:3300/0 conn(0x7f0aec0c6280 0x7f0aec0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0af3831640 1 --2- 172.21.15.107:0/3606472097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec0c9e20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.895+0000 7f0af3831640 1 -- 172.21.15.107:0/3606472097 >> 172.21.15.107:0/3606472097 conn(0x7f0aec08afb0 msgr2=0x7f0aec08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.896+0000 7f0af3831640 1 -- 172.21.15.107:0/3606472097 shutdown_connections 2023-12-16T01:25:56.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.896+0000 7f0af3831640 1 -- 172.21.15.107:0/3606472097 wait complete. 2023-12-16T01:25:56.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 Processor -- start 2023-12-16T01:25:56.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 -- start start 2023-12-16T01:25:56.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 0x7f0aec0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec0caea0 0x7f0aec0c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec152a00 con 0x7f0aec0c6280 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec152570 con 0x7f0aec0caea0 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.897+0000 7f0af3831640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1516c0 con 0x7f0aec153900 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.898+0000 7f0af15cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 0x7f0aec0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.898+0000 7f0af0dcc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec0caea0 0x7f0aec0c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.898+0000 7f0af15cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 0x7f0aec0cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47244/0 (socket says 172.21.15.107:47244) 2023-12-16T01:25:56.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.898+0000 7f0af15cd640 1 -- 172.21.15.107:0/1185077848 learned_addr learned my addr 172.21.15.107:0/1185077848 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:56.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.898+0000 7f0af1dce640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:56.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.902+0000 7f0af15cd640 1 -- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 msgr2=0x7f0aec14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.902+0000 7f0af15cd640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.902+0000 7f0af15cd640 1 -- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec0caea0 msgr2=0x7f0aec0c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.902+0000 7f0af15cd640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec0caea0 0x7f0aec0c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.902+0000 7f0af15cd640 1 -- 172.21.15.107:0/1185077848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80094d0 con 0x7f0aec0c6280 2023-12-16T01:25:56.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.904+0000 7f0af15cd640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 0x7f0aec0cdfd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ae802b930 tx=0x7f0ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:56.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.907+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae803a930 con 0x7f0aec0c6280 2023-12-16T01:25:56.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.907+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae803aab0 con 0x7f0aec0c6280 2023-12-16T01:25:56.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.907+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae803ae60 con 0x7f0aec0c6280 2023-12-16T01:25:56.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.908+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec1540d0 con 0x7f0aec0c6280 2023-12-16T01:25:56.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.908+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec151c40 con 0x7f0aec0c6280 2023-12-16T01:25:56.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:56.909+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec067500 con 0x7f0aec0c6280 2023-12-16T01:25:57.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.151+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0ae802f050 con 0x7f0aec0c6280 2023-12-16T01:25:57.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.151+0000 7f0ae1ffb640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ad006ae90 0x7f0ad006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.152+0000 7f0af0dcc640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ad006ae90 0x7f0ad006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.152+0000 7f0af0dcc640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ad006ae90 0x7f0ad006d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0c5440 tx=0x7f0adc009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:57.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.163+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ae807a5a0 con 0x7f0aec0c6280 2023-12-16T01:25:57.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.164+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0ae80768e0 con 0x7f0aec0c6280 2023-12-16T01:25:57.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.346+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aec0ca740 con 0x7f0aec0c6280 2023-12-16T01:25:57.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.391+0000 7f0ae1ffb640 1 -- 172.21.15.107:0/1185077848 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f0ae8035020 con 0x7f0aec0c6280 2023-12-16T01:25:57.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:57.392 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ad006ae90 msgr2=0x7f0ad006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ad006ae90 0x7f0ad006d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0c5440 tx=0x7f0adc009190 comp rx=0 tx=0).stop 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 msgr2=0x7f0aec0cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 0x7f0aec0cdfd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ae802b930 tx=0x7f0ae80046c0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 shutdown_connections 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0aec153900 0x7f0aec14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ad006ae90 0x7f0ad006d350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec0caea0 0x7f0aec0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 --2- 172.21.15.107:0/1185077848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec0c6280 0x7f0aec0cdfd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 >> 172.21.15.107:0/1185077848 conn(0x7f0aec08afb0 msgr2=0x7f0aec061670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:57.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 shutdown_connections 2023-12-16T01:25:57.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.393+0000 7f0af3831640 1 -- 172.21.15.107:0/1185077848 wait complete. 2023-12-16T01:25:57.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.503+0000 7f0ddc705640 1 Processor -- start 2023-12-16T01:25:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.503+0000 7f0ddc705640 1 -- start start 2023-12-16T01:25:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.504+0000 7f0ddc705640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0dd4153900 0x7f0dd40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.504+0000 7f0ddc705640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0dd40c6280 0x7f0dd40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.504+0000 7f0ddc705640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd40ca460 con 0x7f0dd40caea0 2023-12-16T01:25:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.504+0000 7f0ddc705640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd40c8960 con 0x7f0dd4153900 2023-12-16T01:25:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.504+0000 7f0ddc705640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd4159a40 con 0x7f0dd40c6280 2023-12-16T01:25:57.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.505+0000 7f0dda4a1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0dd4153900 0x7f0dd40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.505+0000 7f0dda4a1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0dd4153900 0x7f0dd40c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47248/0 (socket says 172.21.15.107:47248) 2023-12-16T01:25:57.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.505+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2959722808 learned_addr learned my addr 172.21.15.107:0/2959722808 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:57.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.505+0000 7f0dd9ca0640 1 --2- 172.21.15.107:0/2959722808 >> v2:172.21.15.157:3300/0 conn(0x7f0dd40c6280 0x7f0dd40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.507+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2959722808 >> v2:172.21.15.157:3300/0 conn(0x7f0dd40c6280 msgr2=0x7f0dd40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:57.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.507+0000 7f0dda4a1640 1 --2- 172.21.15.107:0/2959722808 >> v2:172.21.15.157:3300/0 conn(0x7f0dd40c6280 0x7f0dd40ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.507+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2959722808 >> v1:172.21.15.157:6789/0 conn(0x7f0dd40caea0 legacy=0x7f0dd40cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:57.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.507+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2959722808 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4159d20 con 0x7f0dd4153900 2023-12-16T01:25:57.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.509+0000 7f0dda4a1640 1 --2- 172.21.15.107:0/2959722808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd4153900 0x7f0dd40c9e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0dd406a780 tx=0x7f0dd002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351b1699b666104a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:57.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.513+0000 7f0dd949f640 1 -- 172.21.15.107:0/2959722808 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd002ca80 con 0x7f0dd4153900 2023-12-16T01:25:57.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.513+0000 7f0dd949f640 1 -- 172.21.15.107:0/2959722808 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd002cbe0 con 0x7f0dd4153900 2023-12-16T01:25:57.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.513+0000 7f0dd949f640 1 -- 172.21.15.107:0/2959722808 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00343f0 con 0x7f0dd4153900 2023-12-16T01:25:57.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.513+0000 7f0ddc705640 1 -- 172.21.15.107:0/2959722808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd4153900 msgr2=0x7f0dd40c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.513+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2959722808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd4153900 0x7f0dd40c9e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0dd406a780 tx=0x7f0dd002bee0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.514+0000 7f0ddc705640 1 -- 172.21.15.107:0/2959722808 shutdown_connections 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.514+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2959722808 >> v2:172.21.15.157:3300/0 conn(0x7f0dd40c6280 0x7f0dd40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.514+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2959722808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd4153900 0x7f0dd40c9e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.514+0000 7f0ddc705640 1 -- 172.21.15.107:0/2959722808 >> 172.21.15.107:0/2959722808 conn(0x7f0dd408afb0 msgr2=0x7f0dd408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.514+0000 7f0ddc705640 1 -- 172.21.15.107:0/2959722808 shutdown_connections 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.514+0000 7f0ddc705640 1 -- 172.21.15.107:0/2959722808 wait complete. 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 Processor -- start 2023-12-16T01:25:57.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 -- start start 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd40c6280 0x7f0dd40c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40caea0 0x7f0dd40c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd4153900 0x7f0dd40c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40c3490 con 0x7f0dd40caea0 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd4156aa0 con 0x7f0dd40c6280 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.515+0000 7f0ddc705640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40c2e80 con 0x7f0dd4153900 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.516+0000 7f0dd9ca0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40caea0 0x7f0dd40c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.516+0000 7f0ddaca2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd4153900 0x7f0dd40c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.516+0000 7f0dda4a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd40c6280 0x7f0dd40c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.516+0000 7f0dd9ca0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40caea0 0x7f0dd40c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47262/0 (socket says 172.21.15.107:47262) 2023-12-16T01:25:57.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.516+0000 7f0dd9ca0640 1 -- 172.21.15.107:0/2332447337 learned_addr learned my addr 172.21.15.107:0/2332447337 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:57.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.520+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd4153900 msgr2=0x7f0dd40c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:57.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.520+0000 7f0dda4a1640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd4153900 0x7f0dd40c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.520+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40caea0 msgr2=0x7f0dd40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:57.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.520+0000 7f0dda4a1640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40caea0 0x7f0dd40c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:57.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.520+0000 7f0dda4a1640 1 -- 172.21.15.107:0/2332447337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009b30 con 0x7f0dd40c6280 2023-12-16T01:25:57.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.522+0000 7f0dda4a1640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd40c6280 0x7f0dd40c21e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0dd408c340 tx=0x7f0dd0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:57.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.526+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0009510 con 0x7f0dd40c6280 2023-12-16T01:25:57.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.526+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd003e450 con 0x7f0dd40c6280 2023-12-16T01:25:57.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.526+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd003e600 con 0x7f0dd40c6280 2023-12-16T01:25:57.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.526+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd4156d40 con 0x7f0dd40c6280 2023-12-16T01:25:57.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.526+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd4152e20 con 0x7f0dd40c6280 2023-12-16T01:25:57.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.527+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd4067500 con 0x7f0dd40c6280 2023-12-16T01:25:57.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.545+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0dd002cd50 con 0x7f0dd40c6280 2023-12-16T01:25:57.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.546+0000 7f0dcaffd640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0db806ae40 0x7f0db806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:57.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.546+0000 7f0dd9ca0640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0db806ae40 0x7f0db806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:57.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.546+0000 7f0dd9ca0640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0db806ae40 0x7f0db806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4159580 tx=0x7f0dc4009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:57.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.549+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0dd007b260 con 0x7f0dd40c6280 2023-12-16T01:25:57.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.806+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0dd00775a0 con 0x7f0dd40c6280 2023-12-16T01:25:57.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:57.976+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dd40ca740 con 0x7f0dd40c6280 2023-12-16T01:25:58.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.026+0000 7f0dcaffd640 1 -- 172.21.15.107:0/2332447337 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f0dd0043090 con 0x7f0dd40c6280 2023-12-16T01:25:58.027 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:58.027 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:58.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0db806ae40 msgr2=0x7f0db806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0db806ae40 0x7f0db806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4159580 tx=0x7f0dc4009190 comp rx=0 tx=0).stop 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd40c6280 msgr2=0x7f0dd40c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd40c6280 0x7f0dd40c21e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0dd408c340 tx=0x7f0dd0004a40 comp rx=0 tx=0).stop 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 shutdown_connections 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd4153900 0x7f0dd40c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40caea0 0x7f0dd40c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0db806ae40 0x7f0db806d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 --2- 172.21.15.107:0/2332447337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd40c6280 0x7f0dd40c21e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 >> 172.21.15.107:0/2332447337 conn(0x7f0dd408afb0 msgr2=0x7f0dd40c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 shutdown_connections 2023-12-16T01:25:58.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.027+0000 7f0ddc705640 1 -- 172.21.15.107:0/2332447337 wait complete. 2023-12-16T01:25:58.054 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:25:58.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.155+0000 7f254edd5640 1 Processor -- start 2023-12-16T01:25:58.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.155+0000 7f254edd5640 1 -- start start 2023-12-16T01:25:58.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254edd5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f25480710e0 0x7f25480ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254edd5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480ccc50 con 0x7f2548153a90 2023-12-16T01:25:58.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254edd5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480ccf10 con 0x7f2548070d00 2023-12-16T01:25:58.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254edd5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25480cdb90 con 0x7f25480710e0 2023-12-16T01:25:58.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254cb71640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2548070d00 0x7f2548153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:49968/0 (socket says 172.21.15.107:49968) 2023-12-16T01:25:58.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254cb71640 1 -- 172.21.15.107:0/537388672 learned_addr learned my addr 172.21.15.107:0/537388672 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:58.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.156+0000 7f254d372640 1 --2- 172.21.15.107:0/537388672 >> v2:172.21.15.107:3300/0 conn(0x7f25480710e0 0x7f25480ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.159+0000 7f25477fe640 1 -- 172.21.15.107:0/537388672 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214044199 0 0) 0x7f25480ccf10 con 0x7f2548070d00 2023-12-16T01:25:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.159+0000 7f25477fe640 1 -- 172.21.15.107:0/537388672 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2538003520 con 0x7f2548070d00 2023-12-16T01:25:58.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.160+0000 7f254d372640 1 -- 172.21.15.107:0/537388672 >> v1:172.21.15.157:6789/0 conn(0x7f2548070d00 legacy=0x7f2548153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.160+0000 7f254d372640 1 -- 172.21.15.107:0/537388672 >> v1:172.21.15.107:6789/0 conn(0x7f2548153a90 legacy=0x7f25480c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.160+0000 7f254d372640 1 -- 172.21.15.107:0/537388672 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480cd1f0 con 0x7f25480710e0 2023-12-16T01:25:58.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.164+0000 7f254d372640 1 --2- 172.21.15.107:0/537388672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f25480ca1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2540009d90 tx=0x7f254002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77d002ee13d9886 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:58.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.168+0000 7f25477fe640 1 -- 172.21.15.107:0/537388672 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254002cd80 con 0x7f25480710e0 2023-12-16T01:25:58.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.168+0000 7f25477fe640 1 -- 172.21.15.107:0/537388672 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2540034440 con 0x7f25480710e0 2023-12-16T01:25:58.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.168+0000 7f25477fe640 1 -- 172.21.15.107:0/537388672 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400347d0 con 0x7f25480710e0 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 -- 172.21.15.107:0/537388672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 msgr2=0x7f25480ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 --2- 172.21.15.107:0/537388672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f25480ca1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2540009d90 tx=0x7f254002bfd0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 -- 172.21.15.107:0/537388672 shutdown_connections 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 --2- 172.21.15.107:0/537388672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f25480ca1c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 -- 172.21.15.107:0/537388672 >> 172.21.15.107:0/537388672 conn(0x7f254806ab30 msgr2=0x7f254806ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 -- 172.21.15.107:0/537388672 shutdown_connections 2023-12-16T01:25:58.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.169+0000 7f254edd5640 1 -- 172.21.15.107:0/537388672 wait complete. 2023-12-16T01:25:58.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.170+0000 7f254edd5640 1 Processor -- start 2023-12-16T01:25:58.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.170+0000 7f254edd5640 1 -- start start 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f254edd5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2548070d00 0x7f25481efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f254edd5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f2548159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f254edd5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2548153a90 0x7f25481584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f254edd5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548158030 con 0x7f25480710e0 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f254edd5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481f02d0 con 0x7f2548070d00 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f254edd5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548154450 con 0x7f2548153a90 2023-12-16T01:25:58.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f2547fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f2548159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f2547fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f2548159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47272/0 (socket says 172.21.15.107:47272) 2023-12-16T01:25:58.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.171+0000 7f2547fff640 1 -- 172.21.15.107:0/1777368808 learned_addr learned my addr 172.21.15.107:0/1777368808 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:58.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.172+0000 7f254cb71640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2548070d00 0x7f25481efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.172+0000 7f254d372640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2548153a90 0x7f25481584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.175+0000 7f2547fff640 1 -- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2548153a90 msgr2=0x7f25481584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.175+0000 7f2547fff640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2548153a90 0x7f25481584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.175+0000 7f2547fff640 1 -- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2548070d00 msgr2=0x7f25481efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.175+0000 7f2547fff640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2548070d00 0x7f25481efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.175+0000 7f2547fff640 1 -- 172.21.15.107:0/1777368808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540009a70 con 0x7f25480710e0 2023-12-16T01:25:58.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.177+0000 7f2547fff640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f2548159730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f253400c440 tx=0x7f253400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:58.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.180+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340052d0 con 0x7f25480710e0 2023-12-16T01:25:58.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.180+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534005430 con 0x7f25480710e0 2023-12-16T01:25:58.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.180+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2548154710 con 0x7f25480710e0 2023-12-16T01:25:58.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.181+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534007260 con 0x7f25480710e0 2023-12-16T01:25:58.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.181+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2548157700 con 0x7f25480710e0 2023-12-16T01:25:58.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.182+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25481581e0 con 0x7f25480710e0 2023-12-16T01:25:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.425+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f25340073c0 con 0x7f25480710e0 2023-12-16T01:25:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.425+0000 7f25457fa640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f252c06aec0 0x7f252c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.426+0000 7f254cb71640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f252c06aec0 0x7f252c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.426+0000 7f254cb71640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f252c06aec0 0x7f252c06d380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f253c0011e0 tx=0x7f253c007d30 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:58.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.439+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2534057d90 con 0x7f25480710e0 2023-12-16T01:25:58.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.439+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f25340540d0 con 0x7f25480710e0 2023-12-16T01:25:58.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.649+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2548067500 con 0x7f25480710e0 2023-12-16T01:25:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.661+0000 7f25457fa640 1 -- 172.21.15.107:0/1777368808 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6529 (secure 0 0 0) 0x7f2534020070 con 0x7f25480710e0 2023-12-16T01:25:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:58.663 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:25:55.558353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-16T01:25:58.663 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 7 2023-12-16T01:25:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f252c06aec0 msgr2=0x7f252c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f252c06aec0 0x7f252c06d380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f253c0011e0 tx=0x7f253c007d30 comp rx=0 tx=0).stop 2023-12-16T01:25:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 msgr2=0x7f2548159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f2548159730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f253400c440 tx=0x7f253400c900 comp rx=0 tx=0).stop 2023-12-16T01:25:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 shutdown_connections 2023-12-16T01:25:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2548153a90 0x7f25481584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480710e0 0x7f2548159730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f252c06aec0 0x7f252c06d380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 --2- 172.21.15.107:0/1777368808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2548070d00 0x7f25481efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 >> 172.21.15.107:0/1777368808 conn(0x7f254806ab30 msgr2=0x7f25480c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 shutdown_connections 2023-12-16T01:25:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.664+0000 7f254edd5640 1 -- 172.21.15.107:0/1777368808 wait complete. 2023-12-16T01:25:58.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:25:58.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.775+0000 7f5e8258e640 1 Processor -- start 2023-12-16T01:25:58.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.775+0000 7f5e8258e640 1 -- start start 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e8258e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e7c1514d0 0x7f5e7c06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e8258e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e7c1579b0 0x7f5e7c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e8258e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c158340 con 0x7f5e7c0c87d0 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e8258e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c06e670 con 0x7f5e7c1514d0 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e8258e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c15ace0 con 0x7f5e7c1579b0 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e80b2b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e7c1579b0 0x7f5e7c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e7bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e7c1514d0 0x7f5e7c06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e7b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5e7c0c87d0 0x7f5e7c0c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54632/0 (socket says 172.21.15.107:54632) 2023-12-16T01:25:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.776+0000 7f5e7b7fe640 1 -- 172.21.15.107:0/2245106531 learned_addr learned my addr 172.21.15.107:0/2245106531 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.779+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2245106531 >> v2:172.21.15.107:3300/0 conn(0x7f5e7c1514d0 msgr2=0x7f5e7c06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.779+0000 7f5e80b2b640 1 --2- 172.21.15.107:0/2245106531 >> v2:172.21.15.107:3300/0 conn(0x7f5e7c1514d0 0x7f5e7c06d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.779+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2245106531 >> v1:172.21.15.107:6789/0 conn(0x7f5e7c0c87d0 legacy=0x7f5e7c0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.779+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2245106531 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c15af80 con 0x7f5e7c1579b0 2023-12-16T01:25:58.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.781+0000 7f5e80b2b640 1 --2- 172.21.15.107:0/2245106531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c157e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c06dae0 tx=0x7f5e7402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd2febc735851403 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:58.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e7affd640 1 -- 172.21.15.107:0/2245106531 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7402cd00 con 0x7f5e7c1579b0 2023-12-16T01:25:58.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e7affd640 1 -- 172.21.15.107:0/2245106531 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7402ce60 con 0x7f5e7c1579b0 2023-12-16T01:25:58.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e7affd640 1 -- 172.21.15.107:0/2245106531 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74034660 con 0x7f5e7c1579b0 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e8258e640 1 -- 172.21.15.107:0/2245106531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1579b0 msgr2=0x7f5e7c157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2245106531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c157e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c06dae0 tx=0x7f5e7402bf50 comp rx=0 tx=0).stop 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e8258e640 1 -- 172.21.15.107:0/2245106531 shutdown_connections 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2245106531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c157e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2245106531 >> v2:172.21.15.107:3300/0 conn(0x7f5e7c1514d0 0x7f5e7c06d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.785+0000 7f5e8258e640 1 -- 172.21.15.107:0/2245106531 >> 172.21.15.107:0/2245106531 conn(0x7f5e7c071410 msgr2=0x7f5e7c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.786+0000 7f5e8258e640 1 -- 172.21.15.107:0/2245106531 shutdown_connections 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.786+0000 7f5e8258e640 1 -- 172.21.15.107:0/2245106531 wait complete. 2023-12-16T01:25:58.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 Processor -- start 2023-12-16T01:25:58.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 -- start start 2023-12-16T01:25:58.788 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e7c0c87d0 0x7f5e7c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1514d0 0x7f5e7c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c1f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1f1c60 con 0x7f5e7c1579b0 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.787+0000 7f5e8258e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1590f0 con 0x7f5e7c1514d0 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.788+0000 7f5e8258e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1593d0 con 0x7f5e7c0c87d0 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.788+0000 7f5e80b2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c1f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.788+0000 7f5e80b2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c1f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47282/0 (socket says 172.21.15.107:47282) 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.788+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2592480292 learned_addr learned my addr 172.21.15.107:0/2592480292 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.788+0000 7f5e7bfff640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e7c0c87d0 0x7f5e7c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.788+0000 7f5e7b7fe640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1514d0 0x7f5e7c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:25:58.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.792+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e7c0c87d0 msgr2=0x7f5e7c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.792+0000 7f5e80b2b640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e7c0c87d0 0x7f5e7c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.792+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1514d0 msgr2=0x7f5e7c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:58.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.792+0000 7f5e80b2b640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1514d0 0x7f5e7c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:58.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.792+0000 7f5e80b2b640 1 -- 172.21.15.107:0/2592480292 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74009a70 con 0x7f5e7c1579b0 2023-12-16T01:25:58.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.794+0000 7f5e80b2b640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c1f0f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402c560 tx=0x7f5e74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:58.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.798+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7403e610 con 0x7f5e7c1579b0 2023-12-16T01:25:58.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.798+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7403e770 con 0x7f5e7c1579b0 2023-12-16T01:25:58.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.798+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7403eb20 con 0x7f5e7c1579b0 2023-12-16T01:25:58.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.798+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c1596b0 con 0x7f5e7c1579b0 2023-12-16T01:25:58.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.798+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c159990 con 0x7f5e7c1579b0 2023-12-16T01:25:58.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.799+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c155610 con 0x7f5e7c1579b0 2023-12-16T01:25:58.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.820+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5e7403b050 con 0x7f5e7c1579b0 2023-12-16T01:25:58.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.820+0000 7f5e78ff9640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5e6806ae70 0x7f5e6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:58.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.821+0000 7f5e7bfff640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5e6806ae70 0x7f5e6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:58.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:58.821+0000 7f5e7bfff640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5e6806ae70 0x7f5e6806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009b40 tx=0x7f5e70009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:59.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.060+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e74034e40 con 0x7f5e7c1579b0 2023-12-16T01:25:59.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.061+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5e74077160 con 0x7f5e7c1579b0 2023-12-16T01:25:59.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.229+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e7c1559f0 con 0x7f5e7c1579b0 2023-12-16T01:25:59.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.265+0000 7f5e78ff9640 1 -- 172.21.15.107:0/2592480292 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f5e7c1559f0 con 0x7f5e7c1579b0 2023-12-16T01:25:59.267 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:25:59.267 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:25:59.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5e6806ae70 msgr2=0x7f5e6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:59.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5e6806ae70 0x7f5e6806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009b40 tx=0x7f5e70009190 comp rx=0 tx=0).stop 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 msgr2=0x7f5e7c1f0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c1f0f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402c560 tx=0x7f5e74004a40 comp rx=0 tx=0).stop 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 shutdown_connections 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7c1579b0 0x7f5e7c1f0f50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5e6806ae70 0x7f5e6806d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e7c1514d0 0x7f5e7c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 --2- 172.21.15.107:0/2592480292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e7c0c87d0 0x7f5e7c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 >> 172.21.15.107:0/2592480292 conn(0x7f5e7c071410 msgr2=0x7f5e7c0c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 shutdown_connections 2023-12-16T01:25:59.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.267+0000 7f5e8258e640 1 -- 172.21.15.107:0/2592480292 wait complete. 2023-12-16T01:25:59.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T01:25:48.506111+0000', 'modified': '2023-12-16T01:25:55.558353+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6837/1933485264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 1933485264}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 1933485264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-16T01:25:59.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T01:25:59.884 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-16T01:25:59.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.985+0000 7f0b9080e640 1 Processor -- start 2023-12-16T01:25:59.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.985+0000 7f0b9080e640 1 -- start start 2023-12-16T01:25:59.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.986+0000 7f0b9080e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:59.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.986+0000 7f0b9080e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0b8c0c5e60 0x7f0b8c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:25:59.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.986+0000 7f0b9080e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c159fa0 con 0x7f0b8c153be0 2023-12-16T01:25:59.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.986+0000 7f0b9080e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c0c3340 con 0x7f0b8c0c5e60 2023-12-16T01:25:59.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.986+0000 7f0b9080e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c153fc0 con 0x7f0b8c06fa00 2023-12-16T01:25:59.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.987+0000 7f0b8ad9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0b8c0c5e60 0x7f0b8c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:59.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.987+0000 7f0b8a59c640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0b8c153be0 0x7f0b8c159890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:48030/0 (socket says 172.21.15.107:48030) 2023-12-16T01:25:59.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.987+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:25:59.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.987+0000 7f0b8a59c640 1 -- 172.21.15.107:0/398420484 learned_addr learned my addr 172.21.15.107:0/398420484 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:25:59.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.989+0000 7f0b8ad9d640 1 -- 172.21.15.107:0/398420484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 msgr2=0x7f0b8c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:25:59.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.989+0000 7f0b8ad9d640 1 --2- 172.21.15.107:0/398420484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c0c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.989+0000 7f0b8ad9d640 1 -- 172.21.15.107:0/398420484 >> v1:172.21.15.157:6789/0 conn(0x7f0b8c153be0 legacy=0x7f0b8c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:59.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.989+0000 7f0b8ad9d640 1 -- 172.21.15.107:0/398420484 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c06b7b0 con 0x7f0b8c0c5e60 2023-12-16T01:25:59.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.989+0000 7f0b8959a640 1 -- 172.21.15.107:0/398420484 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942749234 0 0) 0x7f0b8c159fa0 con 0x7f0b8c153be0 2023-12-16T01:25:59.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.991+0000 7f0b8ad9d640 1 --2- 172.21.15.107:0/398420484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c0c46f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b840097a0 tx=0x7f0b8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaa6748261f1643 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:25:59.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.994+0000 7f0b8959a640 1 -- 172.21.15.107:0/398420484 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84031830 con 0x7f0b8c0c5e60 2023-12-16T01:25:59.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b8959a640 1 -- 172.21.15.107:0/398420484 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b84031990 con 0x7f0b8c0c5e60 2023-12-16T01:25:59.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b8959a640 1 -- 172.21.15.107:0/398420484 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84031d20 con 0x7f0b8c0c5e60 2023-12-16T01:25:59.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 -- 172.21.15.107:0/398420484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 msgr2=0x7f0b8c0c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:25:59.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 --2- 172.21.15.107:0/398420484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c0c46f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b840097a0 tx=0x7f0b8402b8d0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 -- 172.21.15.107:0/398420484 shutdown_connections 2023-12-16T01:25:59.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 --2- 172.21.15.107:0/398420484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c0c46f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 --2- 172.21.15.107:0/398420484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c0c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:25:59.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 -- 172.21.15.107:0/398420484 >> 172.21.15.107:0/398420484 conn(0x7f0b8c0c7f60 msgr2=0x7f0b8c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:25:59.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 -- 172.21.15.107:0/398420484 shutdown_connections 2023-12-16T01:25:59.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.995+0000 7f0b9080e640 1 -- 172.21.15.107:0/398420484 wait complete. 2023-12-16T01:25:59.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 Processor -- start 2023-12-16T01:25:59.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 -- start start 2023-12-16T01:26:00.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c14b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b8c153be0 0x7f0b8c1e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c158e00 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c14f7e0 con 0x7f0b8c153be0 2023-12-16T01:26:00.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.997+0000 7f0b9080e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1f3230 con 0x7f0b8c06fa00 2023-12-16T01:26:00.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.998+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c14b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.998+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.998+0000 7f0b8ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b8c153be0 0x7f0b8c1e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.998+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c14b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36034/0 (socket says 172.21.15.107:36034) 2023-12-16T01:26:00.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:25:59.998+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1392190358 learned_addr learned my addr 172.21.15.107:0/1392190358 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:00.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.001+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1392190358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 msgr2=0x7f0b8c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.001+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.001+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1392190358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b8c153be0 msgr2=0x7f0b8c1e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.001+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b8c153be0 0x7f0b8c1e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.001+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1392190358 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84009400 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.004+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c14b1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000e9b0 tx=0x7f0b8000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.007+0000 7f0b7affd640 1 -- 172.21.15.107:0/1392190358 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80009670 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.007+0000 7f0b7affd640 1 -- 172.21.15.107:0/1392190358 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000c9a0 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.007+0000 7f0b7affd640 1 -- 172.21.15.107:0/1392190358 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000cd30 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.007+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c1f2980 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.007+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c159f60 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.011+0000 7f0b933a5740 1 Processor -- start 2023-12-16T01:26:00.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.011+0000 7f0b933a5740 1 -- start start 2023-12-16T01:26:00.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.012+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d51740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.012+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d51c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.012+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 0x55a5f5d90bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.012+0000 7f0b933a5740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5cbf090 con 0x55a5f5d51360 2023-12-16T01:26:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.012+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5cbc780 con 0x55a5f5d9b1e0 2023-12-16T01:26:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.012+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5cb8070 con 0x55a5f5d4fdc0 2023-12-16T01:26:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.013+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 0x55a5f5d90bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.013+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d51c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.013+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 0x55a5f5d90bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:35722/0 (socket says 172.21.15.107:35722) 2023-12-16T01:26:00.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.013+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d51c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44762/0 (socket says 172.21.15.107:44762) 2023-12-16T01:26:00.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.013+0000 7f0b89d9b640 1 -- 172.21.15.107:0/768505175 learned_addr learned my addr 172.21.15.107:0/768505175 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.016+0000 7f0b89d9b640 1 -- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 msgr2=0x55a5f5d51c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.016+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d51c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.016+0000 7f0b89d9b640 1 -- 172.21.15.107:0/768505175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 msgr2=0x55a5f5d51740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.016+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d51740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.016+0000 7f0b89d9b640 1 -- 172.21.15.107:0/768505175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5f5c7ad00 con 0x55a5f5d4fdc0 2023-12-16T01:26:00.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.019+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 0x55a5f5d90bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000e980 tx=0x7f0b80013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44cf6d96090abc8a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.023+0000 7f0b6bfff640 1 -- 172.21.15.107:0/768505175 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80006610 con 0x55a5f5d4fdc0 2023-12-16T01:26:00.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.023+0000 7f0b6bfff640 1 -- 172.21.15.107:0/768505175 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80006770 con 0x55a5f5d4fdc0 2023-12-16T01:26:00.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.023+0000 7f0b6bfff640 1 -- 172.21.15.107:0/768505175 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80013690 con 0x55a5f5d4fdc0 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 -- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 msgr2=0x55a5f5d90bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 0x55a5f5d90bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000e980 tx=0x7f0b80013000 comp rx=0 tx=0).stop 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 -- 172.21.15.107:0/768505175 shutdown_connections 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d4fdc0 0x55a5f5d90bc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d51c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 --2- 172.21.15.107:0/768505175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d51740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 -- 172.21.15.107:0/768505175 >> 172.21.15.107:0/768505175 conn(0x55a5f5d4dd60 msgr2=0x55a5f5d50410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 -- 172.21.15.107:0/768505175 shutdown_connections 2023-12-16T01:26:00.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 -- 172.21.15.107:0/768505175 wait complete. 2023-12-16T01:26:00.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 -- start start 2023-12-16T01:26:00.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.024+0000 7f0b933a5740 1 Processor -- start 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d93290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d75ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 0x55a5f5d6fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5c71e70 con 0x55a5f5d51360 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5c71b10 con 0x55a5f5d9b1e0 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5c372e0 con 0x55a5f5d72540 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.025+0000 7f0b933a5740 10 client.0 _ll_register_callbacks cb 0x55a5f59c9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.026+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 0x55a5f5d6fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.026+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d75ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.026+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 0x55a5f5d6fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:35726/0 (socket says 172.21.15.107:35726) 2023-12-16T01:26:00.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.026+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d75ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44768/0 (socket says 172.21.15.107:44768) 2023-12-16T01:26:00.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.026+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1211132457 learned_addr learned my addr 172.21.15.107:0/1211132457 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:00.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.029+0000 7f0b7affd640 1 -- 172.21.15.107:0/1392190358 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0b80006410 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.030+0000 7f0b7affd640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b6c06ae00 0x7f0b6c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.030+0000 7f0b8ad9d640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b6c06ae00 0x7f0b6c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.030+0000 7f0b8ad9d640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b6c06ae00 0x7f0b6c06d2c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b84036000 tx=0x7f0b8402e000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.031+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 msgr2=0x55a5f5d75ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.031+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d75ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.031+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1211132457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 msgr2=0x55a5f5d93290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.031+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d93290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.031+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1211132457 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c159f60 con 0x55a5f5d72540 2023-12-16T01:26:00.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.033+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 0x55a5f5d6fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c520 tx=0x7f0b80005990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585792e8d97f1391 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.033+0000 7f0b697fa640 10 client.0 ms_handle_connect on v2:172.21.15.157:3301/0 2023-12-16T01:26:00.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.034+0000 7f0b7affd640 1 -- 172.21.15.107:0/1392190358 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b80060fb0 con 0x7f0b8c0c5e60 2023-12-16T01:26:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.038+0000 7f0b697fa640 1 -- 172.21.15.107:0/1211132457 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80060af0 con 0x55a5f5d72540 2023-12-16T01:26:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.038+0000 7f0b697fa640 1 -- 172.21.15.107:0/1211132457 <== mon.2 v2:172.21.15.157:3301/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b80065050 con 0x55a5f5d72540 2023-12-16T01:26:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.038+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5f5cb0f00 con 0x55a5f5d72540 2023-12-16T01:26:00.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.040+0000 7f0b697fa640 1 -- 172.21.15.107:0/1211132457 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b8007e250 con 0x55a5f5d72540 2023-12-16T01:26:00.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.040+0000 7f0b933a5740 10 client.4298 fetch_fsmap learned FSMap version 7 2023-12-16T01:26:00.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.040+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a5f5cb66f0 con 0x55a5f5d72540 2023-12-16T01:26:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b697fa640 1 -- 172.21.15.107:0/1211132457 <== mon.2 v2:172.21.15.157:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5f5cb0f00 con 0x55a5f5d72540 2023-12-16T01:26:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b697fa640 1 -- 172.21.15.107:0/1211132457 <== mon.2 v2:172.21.15.157:3301/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f0b80011070 con 0x55a5f5d72540 2023-12-16T01:26:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b933a5740 10 client.4298 fetch_fsmap finished waiting for FSMap version 7 2023-12-16T01:26:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b933a5740 10 client.4298 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-16T01:26:00.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b933a5740 20 client.4298 populate_metadata read hostname 'smithi107' 2023-12-16T01:26:00.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5da5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b933a5740 4 client.4298 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T01:26:00.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.051+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 --> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5f5cb0c20 con 0x55a5f5da5480 2023-12-16T01:26:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.060+0000 7f0b8a59c640 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5da5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.144+0000 7f0b8a59c640 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5da5860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed3e114f56d074f8 server_cookie=80c52e251f9e9553 in_seq=0 out_seq=0 2023-12-16T01:26:00.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.144+0000 7f0b697fa640 10 client.4298 ms_handle_connect on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b697fa640 1 -- 172.21.15.107:0/1211132457 <== mds.0 v2:172.21.15.157:6836/1933485264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5f5cb0c20 con 0x55a5f5da5480 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b697fa640 10 client.4298 handle_command_reply: tid=0 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 client.4298 shutdown 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 msgr2=0x55a5f5d6fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 0x55a5f5d6fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c520 tx=0x7f0b80005990 comp rx=0 tx=0).stop 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 shutdown_connections 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5da5860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d72540 0x55a5f5d6fe60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5d75ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b697fa640 0 client.4298 ms_handle_reset on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1211132457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d93290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 >> 172.21.15.107:0/1211132457 conn(0x55a5f5d4fdc0 msgr2=0x55a5f5d92270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 shutdown_connections 2023-12-16T01:26:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 1 -- 172.21.15.107:0/1211132457 wait complete. 2023-12-16T01:26:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.259+0000 7f0b933a5740 20 client.4298 trim_cache size 0 max 16384 2023-12-16T01:26:00.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.275+0000 7f0b933a5740 1 Processor -- start 2023-12-16T01:26:00.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.275+0000 7f0b933a5740 1 -- start start 2023-12-16T01:26:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.276+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d51360 0x55a5f5d4aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.276+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 0x55a5f5d502d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.276+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5db44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.276+0000 7f0b933a5740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5d4d950 con 0x55a5f5d72540 2023-12-16T01:26:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.276+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5d6d380 con 0x55a5f5d9b1e0 2023-12-16T01:26:00.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.276+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5d4d070 con 0x55a5f5d51360 2023-12-16T01:26:00.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.277+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 0x55a5f5d502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.277+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d51360 0x55a5f5d4aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.277+0000 7f0b8ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5db44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.277+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 0x55a5f5d502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36052/0 (socket says 172.21.15.107:36052) 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.277+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1795927699 learned_addr learned my addr 172.21.15.107:0/1795927699 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.279+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1795927699 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d51360 msgr2=0x55a5f5d4aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.279+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d51360 0x55a5f5d4aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.279+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1795927699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 msgr2=0x55a5f5db44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.279+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5db44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.279+0000 7f0b89d9b640 1 -- 172.21.15.107:0/1795927699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5f5c53d70 con 0x55a5f5d72540 2023-12-16T01:26:00.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.281+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 0x55a5f5d502d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b800059d0 tx=0x7f0b80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d060c8cec2bf5f12 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.285+0000 7f0b78ff9640 1 -- 172.21.15.107:0/1795927699 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8007e250 con 0x55a5f5d72540 2023-12-16T01:26:00.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.285+0000 7f0b78ff9640 1 -- 172.21.15.107:0/1795927699 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80060af0 con 0x55a5f5d72540 2023-12-16T01:26:00.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.285+0000 7f0b78ff9640 1 -- 172.21.15.107:0/1795927699 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8005d2f0 con 0x55a5f5d72540 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 -- 172.21.15.107:0/1795927699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 msgr2=0x55a5f5d502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 0x55a5f5d502d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b800059d0 tx=0x7f0b80014000 comp rx=0 tx=0).stop 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 -- 172.21.15.107:0/1795927699 shutdown_connections 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d9b1e0 0x55a5f5db44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d72540 0x55a5f5d502d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 --2- 172.21.15.107:0/1795927699 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d51360 0x55a5f5d4aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 -- 172.21.15.107:0/1795927699 >> 172.21.15.107:0/1795927699 conn(0x55a5f5d4fdc0 msgr2=0x55a5f5d52c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 -- 172.21.15.107:0/1795927699 shutdown_connections 2023-12-16T01:26:00.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 -- 172.21.15.107:0/1795927699 wait complete. 2023-12-16T01:26:00.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.286+0000 7f0b933a5740 1 -- start start 2023-12-16T01:26:00.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.287+0000 7f0b933a5740 1 Processor -- start 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d90ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d72540 0x55a5f5d4f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d9b1e0 0x55a5f5d730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5d72290 con 0x55a5f5d51360 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5d4fa20 con 0x55a5f5d72540 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5f5d4b720 con 0x55a5f5d9b1e0 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b933a5740 10 client.0 _ll_register_callbacks cb 0x7f0b8001f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d90ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b89d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d72540 0x55a5f5d4f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b8ad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d9b1e0 0x55a5f5d730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.288+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d90ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36066/0 (socket says 172.21.15.107:36066) 2023-12-16T01:26:00.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.289+0000 7f0b8a59c640 1 -- 172.21.15.107:0/2428093208 learned_addr learned my addr 172.21.15.107:0/2428093208 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:00.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.291+0000 7f0b8a59c640 1 -- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d9b1e0 msgr2=0x55a5f5d730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.291+0000 7f0b8a59c640 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d9b1e0 0x55a5f5d730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.291+0000 7f0b8a59c640 1 -- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d72540 msgr2=0x55a5f5d4f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.291+0000 7f0b8a59c640 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d72540 0x55a5f5d4f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.292+0000 7f0b8a59c640 1 -- 172.21.15.107:0/2428093208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5f5cb66f0 con 0x55a5f5d51360 2023-12-16T01:26:00.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.293+0000 7f0b8a59c640 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d90ec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c002090 tx=0x7f0b7c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2e5c4bf2a3ffc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.293+0000 7f0b697fa640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-12-16T01:26:00.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.297+0000 7f0b697fa640 1 -- 172.21.15.107:0/2428093208 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c01c8a0 con 0x55a5f5d51360 2023-12-16T01:26:00.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.297+0000 7f0b697fa640 1 -- 172.21.15.107:0/2428093208 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b7c021b90 con 0x55a5f5d51360 2023-12-16T01:26:00.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.297+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5f5d72cb0 con 0x55a5f5d51360 2023-12-16T01:26:00.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.299+0000 7f0b697fa640 1 -- 172.21.15.107:0/2428093208 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b7c021d50 con 0x55a5f5d51360 2023-12-16T01:26:00.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.299+0000 7f0b933a5740 10 client.4386 fetch_fsmap learned FSMap version 7 2023-12-16T01:26:00.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.299+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a5f5c79560 con 0x55a5f5d51360 2023-12-16T01:26:00.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b697fa640 1 -- 172.21.15.107:0/2428093208 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5f5d72cb0 con 0x55a5f5d51360 2023-12-16T01:26:00.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b697fa640 1 -- 172.21.15.107:0/2428093208 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f0b7c024070 con 0x55a5f5d51360 2023-12-16T01:26:00.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b933a5740 10 client.4386 fetch_fsmap finished waiting for FSMap version 7 2023-12-16T01:26:00.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b933a5740 10 client.4386 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-16T01:26:00.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b933a5740 20 client.4386 populate_metadata read hostname 'smithi107' 2023-12-16T01:26:00.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b933a5740 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5dfadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b933a5740 4 client.4386 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T01:26:00.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.303+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 --> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f0b80006770 con 0x55a5f5da5480 2023-12-16T01:26:00.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.304+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5dfadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.307+0000 7f0b89d9b640 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5dfadd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c939c23c391a383d server_cookie=726780bb88cce64b in_seq=0 out_seq=0 2023-12-16T01:26:00.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.307+0000 7f0b697fa640 10 client.4386 ms_handle_connect on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:00.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b697fa640 1 -- 172.21.15.107:0/2428093208 <== mds.0 v2:172.21.15.157:6836/1933485264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f0b80006770 con 0x55a5f5da5480 2023-12-16T01:26:00.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b697fa640 10 client.4386 handle_command_reply: tid=0 2023-12-16T01:26:00.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 client.4386 shutdown 2023-12-16T01:26:00.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 msgr2=0x55a5f5d90ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d90ec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c002090 tx=0x7f0b7c001630 comp rx=0 tx=0).stop 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 shutdown_connections 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x55a5f5da5480 0x55a5f5dfadd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55a5f5d9b1e0 0x55a5f5d730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b697fa640 0 client.4386 ms_handle_reset on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a5f5d72540 0x55a5f5d4f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 --2- 172.21.15.107:0/2428093208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a5f5d51360 0x55a5f5d90ec0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 >> 172.21.15.107:0/2428093208 conn(0x55a5f5d4fdc0 msgr2=0x55a5f5d93810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 shutdown_connections 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 1 -- 172.21.15.107:0/2428093208 wait complete. 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b933a5740 20 client.4386 trim_cache size 0 max 16384 2023-12-16T01:26:00.327 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "928cabe9-0ef6-4aba-be14-8cbcf8a73b88", 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4273, 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 10.658741804, 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 7, 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 26, 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 26, 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 18.345315323000001 2023-12-16T01:26:00.328 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b6c06ae00 msgr2=0x7f0b6c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b6c06ae00 0x7f0b6c06d2c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b84036000 tx=0x7f0b8402e000 comp rx=0 tx=0).stop 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 msgr2=0x7f0b8c14b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c14b1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000e9b0 tx=0x7f0b8000ee70 comp rx=0 tx=0).stop 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 shutdown_connections 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b6c06ae00 0x7f0b6c06d2c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b8c153be0 0x7f0b8c1e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b8c0c5e60 0x7f0b8c14b1e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 --2- 172.21.15.107:0/1392190358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b8c06fa00 0x7f0b8c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 >> 172.21.15.107:0/1392190358 conn(0x7f0b8c0c7f60 msgr2=0x7f0b8c0c40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 shutdown_connections 2023-12-16T01:26:00.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.325+0000 7f0b9080e640 1 -- 172.21.15.107:0/1392190358 wait complete. 2023-12-16T01:26:00.338 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T01:26:00.338 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:00.338 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T01:26:00.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 Processor -- start 2023-12-16T01:26:00.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 -- start start 2023-12-16T01:26:00.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3924153900 0x7f39240c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39240cb4a0 0x7f39240cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39240cbe70 con 0x7f39240c6280 2023-12-16T01:26:00.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39240c8960 con 0x7f3924153900 2023-12-16T01:26:00.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.439+0000 7f3929d33640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240ca460 con 0x7f39240cb4a0 2023-12-16T01:26:00.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.440+0000 7f3923fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39240cb4a0 0x7f39240cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.440+0000 7f39237fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3924153900 0x7f39240c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.440+0000 7f3922ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f39240c6280 0x7f39240ca960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55262/0 (socket says 172.21.15.107:55262) 2023-12-16T01:26:00.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.440+0000 7f3922ffd640 1 -- 172.21.15.107:0/1368070114 learned_addr learned my addr 172.21.15.107:0/1368070114 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:00.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.443+0000 7f3923fff640 1 -- 172.21.15.107:0/1368070114 >> v2:172.21.15.107:3300/0 conn(0x7f3924153900 msgr2=0x7f39240c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:00.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.443+0000 7f3923fff640 1 --2- 172.21.15.107:0/1368070114 >> v2:172.21.15.107:3300/0 conn(0x7f3924153900 0x7f39240c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.443+0000 7f3923fff640 1 -- 172.21.15.107:0/1368070114 >> v1:172.21.15.107:6789/0 conn(0x7f39240c6280 legacy=0x7f39240ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.443+0000 7f3923fff640 1 -- 172.21.15.107:0/1368070114 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924159a40 con 0x7f39240cb4a0 2023-12-16T01:26:00.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.445+0000 7f3923fff640 1 --2- 172.21.15.107:0/1368070114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39240cb4a0 0x7f39240cb930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f391c009d90 tx=0x7f391c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf549976f95196 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.448+0000 7f39227fc640 1 -- 172.21.15.107:0/1368070114 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c02cbc0 con 0x7f39240cb4a0 2023-12-16T01:26:00.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.448+0000 7f39227fc640 1 -- 172.21.15.107:0/1368070114 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c02cd20 con 0x7f39240cb4a0 2023-12-16T01:26:00.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.448+0000 7f39227fc640 1 -- 172.21.15.107:0/1368070114 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c034660 con 0x7f39240cb4a0 2023-12-16T01:26:00.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 -- 172.21.15.107:0/1368070114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39240cb4a0 msgr2=0x7f39240cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 --2- 172.21.15.107:0/1368070114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39240cb4a0 0x7f39240cb930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f391c009d90 tx=0x7f391c02be10 comp rx=0 tx=0).stop 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 -- 172.21.15.107:0/1368070114 shutdown_connections 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 --2- 172.21.15.107:0/1368070114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39240cb4a0 0x7f39240cb930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 --2- 172.21.15.107:0/1368070114 >> v2:172.21.15.107:3300/0 conn(0x7f3924153900 0x7f39240c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 -- 172.21.15.107:0/1368070114 >> 172.21.15.107:0/1368070114 conn(0x7f392408afb0 msgr2=0x7f392408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 -- 172.21.15.107:0/1368070114 shutdown_connections 2023-12-16T01:26:00.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.449+0000 7f3929d33640 1 -- 172.21.15.107:0/1368070114 wait complete. 2023-12-16T01:26:00.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.450+0000 7f3929d33640 1 Processor -- start 2023-12-16T01:26:00.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.450+0000 7f3929d33640 1 -- start start 2023-12-16T01:26:00.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3929d33640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39240c6280 0x7f3924150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3929d33640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 0x7f39241ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3929d33640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3924153900 0x7f39240cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3929d33640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241ef140 con 0x7f39240cb4a0 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3929d33640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241f0260 con 0x7f39240c6280 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3929d33640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39241eedf0 con 0x7f3924153900 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.451+0000 7f3922ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 0x7f39241ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.452+0000 7f3922ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 0x7f39241ef5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36080/0 (socket says 172.21.15.107:36080) 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.452+0000 7f3922ffd640 1 -- 172.21.15.107:0/1638863299 learned_addr learned my addr 172.21.15.107:0/1638863299 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.452+0000 7f3923fff640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3924153900 0x7f39240cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.452+0000 7f39237fe640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39240c6280 0x7f3924150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.455+0000 7f3922ffd640 1 -- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3924153900 msgr2=0x7f39240cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.455+0000 7f3922ffd640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3924153900 0x7f39240cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.455+0000 7f3922ffd640 1 -- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39240c6280 msgr2=0x7f3924150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.455+0000 7f3922ffd640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39240c6280 0x7f3924150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.455+0000 7f3922ffd640 1 -- 172.21.15.107:0/1638863299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c009a70 con 0x7f39240cb4a0 2023-12-16T01:26:00.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.457+0000 7f3922ffd640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 0x7f39241ef5d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f391800c400 tx=0x7f391800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.460+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918005ce0 con 0x7f39240cb4a0 2023-12-16T01:26:00.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.460+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918005e40 con 0x7f39240cb4a0 2023-12-16T01:26:00.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.460+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180072d0 con 0x7f39240cb4a0 2023-12-16T01:26:00.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.460+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39241f2850 con 0x7f39240cb4a0 2023-12-16T01:26:00.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.460+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39241f2e10 con 0x7f39240cb4a0 2023-12-16T01:26:00.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.461+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39241ef2f0 con 0x7f39240cb4a0 2023-12-16T01:26:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.479+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f39180074f0 con 0x7f39240cb4a0 2023-12-16T01:26:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.480+0000 7f390bfff640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f391006ae90 0x7f391006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.480+0000 7f39237fe640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f391006ae90 0x7f391006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.480+0000 7f39237fe640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f391006ae90 0x7f391006d350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3914009aa0 tx=0x7f3914009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.482+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3918057d00 con 0x7f39240cb4a0 2023-12-16T01:26:00.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.718+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3918054040 con 0x7f39240cb4a0 2023-12-16T01:26:00.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.932+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39241ef2f0 con 0x7f39240cb4a0 2023-12-16T01:26:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.937+0000 7f390bfff640 1 -- 172.21.15.107:0/1638863299 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f39241ef2f0 con 0x7f39240cb4a0 2023-12-16T01:26:00.938 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f391006ae90 msgr2=0x7f391006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f391006ae90 0x7f391006d350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3914009aa0 tx=0x7f3914009190 comp rx=0 tx=0).stop 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 msgr2=0x7f39241ef5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 0x7f39241ef5d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f391800c400 tx=0x7f391800c8c0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 shutdown_connections 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3924153900 0x7f39240cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39240cb4a0 0x7f39241ef5d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f391006ae90 0x7f391006d350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 --2- 172.21.15.107:0/1638863299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39240c6280 0x7f3924150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 >> 172.21.15.107:0/1638863299 conn(0x7f392408afb0 msgr2=0x7f3924157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 shutdown_connections 2023-12-16T01:26:00.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:00.940+0000 7f3929d33640 1 -- 172.21.15.107:0/1638863299 wait complete. 2023-12-16T01:26:00.951 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T01:26:00.951 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T01:26:00.951 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2023-12-16T01:26:00.951 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-16T01:26:00.951 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:00.952 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T01:26:00.952 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T01:26:00.952 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T01:26:00.952 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-16T01:26:00.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:00.952 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2023-12-16T01:26:00.966 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:00.967 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T01:26:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T01:26:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42256sec preferred_lft 42256sec 2023-12-16T01:26:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2023-12-16T01:26:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-12-16T01:26:00.968 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T01:26:00.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T01:26:00.969 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:01.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:01.510 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T01:26:01.538 INFO:teuthology.orchestra.run.smithi107.stdout:1 2023-12-16T01:26:01.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:01.539 DEBUG:teuthology.orchestra.run.smithi107:> route 2023-12-16T01:26:01.724 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2023-12-16T01:26:01.724 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T01:26:01.725 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T01:26:01.725 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T01:26:01.725 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T01:26:01.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:01.725 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:01.725 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:01.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T01:26:01.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T01:26:01.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T01:26:01.726 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:01.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:01.963 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-12-16T01:26:01.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:01.979 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2023-12-16T01:26:02.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:02.033 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:02.033 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:02.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:02.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-16T01:26:02.034 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:02.115 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-16T01:26:02.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-16T01:26:02.116 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:02.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:02.257 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:02.257 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:02.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2023-12-16T01:26:02.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T01:26:02.257 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:02.299 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-16T01:26:02.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T01:26:02.300 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:02.355 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-16T01:26:02.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T01:26:02.355 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:02.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:02.477 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:02.533 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:02.533 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:02.534 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:02.535 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:02.536 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:02.536 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:02.536 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:02.536 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:02.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:02.536 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:02.589 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-16T01:26:02.589 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-16T01:26:02.631 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:02.657 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:02.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:02.716 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:02.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:2023-12-16T01:26:02.733+0000 7fd4a6e73480 -1 init, newargv = 0x562227ea77f0 newargc=15 2023-12-16T01:26:02.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:ceph-fuse[94180]: starting ceph client 2023-12-16T01:26:02.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:ceph-fuse[94180]: starting fuse 2023-12-16T01:26:03.850 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:03.879 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:03.935 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:03.936 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run.smithi107.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:03.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:03.938 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:03.991 INFO:teuthology.orchestra.run.smithi107.stdout:42 2023-12-16T01:26:03.991 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-12-16T01:26:03.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo stdin-killer -- python3 -c ' 2023-12-16T01:26:03.991 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2023-12-16T01:26:03.991 DEBUG:teuthology.orchestra.run.smithi107:> import re 2023-12-16T01:26:03.991 DEBUG:teuthology.orchestra.run.smithi107:> import os 2023-12-16T01:26:03.991 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2023-12-16T01:26:03.991 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-16T01:26:03.992 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> return f 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.admin")) 2023-12-16T01:26:03.993 DEBUG:teuthology.orchestra.run.smithi107:> ' 2023-12-16T01:26:04.111 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.admin.94180.asok 2023-12-16T01:26:04.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-16T01:26:04.122 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94180.asok 2023-12-16T01:26:04.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:04.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94180.asok status 2023-12-16T01:26:04.257 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:26:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "6d933094a156ec7587742e5aa25fba5ba27ec678", 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)", 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "admin", 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "94180", 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4393, 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2023-12-16T01:26:04.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4393 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1894576664 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1894576664 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4393 172.21.15.107:0/1894576664", 2023-12-16T01:26:04.259 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "172.21.15.107:0/1894576664", 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 7, 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 26, 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2023-12-16T01:26:04.260 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:26:04.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:04.266 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2023-12-16T01:26:04.266 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:04.291 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2023-12-16T01:26:04.292 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:04.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:04.292 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:04.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:04.426 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-16T01:26:04.633 INFO:teuthology.orchestra.run.smithi107.stdout:# file: . 2023-12-16T01:26:04.634 INFO:teuthology.orchestra.run.smithi107.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-16T01:26:04.634 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:04.634 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:26:04.634 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T01:26:04.650 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.790+0000 7f8b48a1e640 1 Processor -- start 2023-12-16T01:26:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.790+0000 7f8b48a1e640 1 -- start start 2023-12-16T01:26:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.790+0000 7f8b48a1e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b441501c0 0x7f8b44159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.790+0000 7f8b48a1e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b44072b60 con 0x7f8b440bff00 2023-12-16T01:26:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.790+0000 7f8b48a1e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440c1a90 con 0x7f8b44156e60 2023-12-16T01:26:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.790+0000 7f8b48a1e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b441572d0 con 0x7f8b441501c0 2023-12-16T01:26:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.791+0000 7f8b4259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b441501c0 0x7f8b44159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.791+0000 7f8b42d9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8b44156e60 0x7f8b44071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:48044/0 (socket says 172.21.15.107:48044) 2023-12-16T01:26:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.791+0000 7f8b42d9d640 1 -- 172.21.15.107:0/1934240166 learned_addr learned my addr 172.21.15.107:0/1934240166 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.794+0000 7f8b4159a640 1 -- 172.21.15.107:0/1934240166 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298354437 0 0) 0x7f8b440c1a90 con 0x7f8b44156e60 2023-12-16T01:26:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.794+0000 7f8b4159a640 1 -- 172.21.15.107:0/1934240166 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2c005730 con 0x7f8b44156e60 2023-12-16T01:26:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.794+0000 7f8b4259c640 1 -- 172.21.15.107:0/1934240166 >> v1:172.21.15.157:6789/0 conn(0x7f8b44156e60 legacy=0x7f8b44071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.794+0000 7f8b4259c640 1 -- 172.21.15.107:0/1934240166 >> v1:172.21.15.107:6789/0 conn(0x7f8b440bff00 legacy=0x7f8b44072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.794+0000 7f8b4259c640 1 -- 172.21.15.107:0/1934240166 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440c1d30 con 0x7f8b441501c0 2023-12-16T01:26:04.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.798+0000 7f8b4259c640 1 --2- 172.21.15.107:0/1934240166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b441501c0 0x7f8b44159860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097a0 tx=0x7f8b3802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa12d592ccd4bef server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:04.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.802+0000 7f8b4159a640 1 -- 172.21.15.107:0/1934240166 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3802f810 con 0x7f8b441501c0 2023-12-16T01:26:04.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.802+0000 7f8b4159a640 1 -- 172.21.15.107:0/1934240166 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3802f970 con 0x7f8b441501c0 2023-12-16T01:26:04.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.802+0000 7f8b4159a640 1 -- 172.21.15.107:0/1934240166 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3802fd00 con 0x7f8b441501c0 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1934240166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b441501c0 msgr2=0x7f8b44159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1934240166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b441501c0 0x7f8b44159860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097a0 tx=0x7f8b3802b9f0 comp rx=0 tx=0).stop 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1934240166 shutdown_connections 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1934240166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b441501c0 0x7f8b44159860 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1934240166 >> 172.21.15.107:0/1934240166 conn(0x7f8b4406cd60 msgr2=0x7f8b4406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1934240166 shutdown_connections 2023-12-16T01:26:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.803+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1934240166 wait complete. 2023-12-16T01:26:04.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.804+0000 7f8b48a1e640 1 Processor -- start 2023-12-16T01:26:04.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.804+0000 7f8b48a1e640 1 -- start start 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b48a1e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b440bff00 0x7f8b441ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b48a1e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b441501c0 0x7f8b441eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b48a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 0x7f8b441576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b48a1e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b441eecd0 con 0x7f8b44156e60 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b48a1e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b441eace0 con 0x7f8b441501c0 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b48a1e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b441e2290 con 0x7f8b440bff00 2023-12-16T01:26:04.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b42d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 0x7f8b441576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:04.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b42d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 0x7f8b441576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36092/0 (socket says 172.21.15.107:36092) 2023-12-16T01:26:04.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.805+0000 7f8b42d9d640 1 -- 172.21.15.107:0/1589067138 learned_addr learned my addr 172.21.15.107:0/1589067138 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:04.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.806+0000 7f8b41d9b640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b441501c0 0x7f8b441eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:04.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.806+0000 7f8b4259c640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b440bff00 0x7f8b441ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:04.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.809+0000 7f8b42d9d640 1 -- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b440bff00 msgr2=0x7f8b441ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:04.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.809+0000 7f8b42d9d640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b440bff00 0x7f8b441ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:04.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.809+0000 7f8b42d9d640 1 -- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b441501c0 msgr2=0x7f8b441eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:04.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.809+0000 7f8b42d9d640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b441501c0 0x7f8b441eb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:04.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.809+0000 7f8b42d9d640 1 -- 172.21.15.107:0/1589067138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009400 con 0x7f8b44156e60 2023-12-16T01:26:04.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.811+0000 7f8b42d9d640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 0x7f8b441576a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cb40 tx=0x7f8b3c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:04.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.814+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00aca0 con 0x7f8b44156e60 2023-12-16T01:26:04.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.814+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00ae00 con 0x7f8b44156e60 2023-12-16T01:26:04.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.814+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c012620 con 0x7f8b44156e60 2023-12-16T01:26:04.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.814+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b441e1a30 con 0x7f8b44156e60 2023-12-16T01:26:04.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.814+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b441e1cd0 con 0x7f8b44156e60 2023-12-16T01:26:04.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:04.815+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b440c77e0 con 0x7f8b44156e60 2023-12-16T01:26:05.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.055+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8b3c007070 con 0x7f8b44156e60 2023-12-16T01:26:05.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.055+0000 7f8b32ffd640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8b2406ae90 0x7f8b2406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.055+0000 7f8b4259c640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8b2406ae90 0x7f8b2406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.056+0000 7f8b4259c640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8b2406ae90 0x7f8b2406d350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b38036000 tx=0x7f8b38008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.070+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b3c0588a0 con 0x7f8b44156e60 2023-12-16T01:26:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.070+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8b3c054be0 con 0x7f8b44156e60 2023-12-16T01:26:05.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.237+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b44067500 con 0x7f8b44156e60 2023-12-16T01:26:05.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.273+0000 7f8b32ffd640 1 -- 172.21.15.107:0/1589067138 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f8b3c017070 con 0x7f8b44156e60 2023-12-16T01:26:05.275 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:05.275 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.275+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8b2406ae90 msgr2=0x7f8b2406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.275+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8b2406ae90 0x7f8b2406d350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b38036000 tx=0x7f8b38008030 comp rx=0 tx=0).stop 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.275+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 msgr2=0x7f8b441576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.275+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 0x7f8b441576a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cb40 tx=0x7f8b3c00a060 comp rx=0 tx=0).stop 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 shutdown_connections 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b44156e60 0x7f8b441576a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8b2406ae90 0x7f8b2406d350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b441501c0 0x7f8b441eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 --2- 172.21.15.107:0/1589067138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b440bff00 0x7f8b441ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 >> 172.21.15.107:0/1589067138 conn(0x7f8b4406cd60 msgr2=0x7f8b4414af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:05.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 shutdown_connections 2023-12-16T01:26:05.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.276+0000 7f8b48a1e640 1 -- 172.21.15.107:0/1589067138 wait complete. 2023-12-16T01:26:05.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T01:25:45.757668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T01:25:47.362497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T01:25:52.786986+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T01:26:05.288 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:26:05.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 Processor -- start 2023-12-16T01:26:05.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 -- start start 2023-12-16T01:26:05.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdcfc0bff00 0x7fdcfc159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdcfc156e60 0x7fdcfc071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc072b60 con 0x7fdcfc1501c0 2023-12-16T01:26:05.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc1572d0 con 0x7fdcfc0bff00 2023-12-16T01:26:05.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.392+0000 7fdd0314c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0c1a90 con 0x7fdcfc156e60 2023-12-16T01:26:05.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.393+0000 7fdd016e9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdcfc156e60 0x7fdcfc071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.393+0000 7fdd00ee8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fdcfc1501c0 0x7fdcfc072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55274/0 (socket says 172.21.15.107:55274) 2023-12-16T01:26:05.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.393+0000 7fdd00ee8640 1 -- 172.21.15.107:0/4147120582 learned_addr learned my addr 172.21.15.107:0/4147120582 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:05.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.393+0000 7fdcf3fff640 1 --2- 172.21.15.107:0/4147120582 >> v2:172.21.15.107:3300/0 conn(0x7fdcfc0bff00 0x7fdcfc159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.395+0000 7fdd016e9640 1 -- 172.21.15.107:0/4147120582 >> v2:172.21.15.107:3300/0 conn(0x7fdcfc0bff00 msgr2=0x7fdcfc159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:05.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.395+0000 7fdd016e9640 1 --2- 172.21.15.107:0/4147120582 >> v2:172.21.15.107:3300/0 conn(0x7fdcfc0bff00 0x7fdcfc159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.395+0000 7fdd016e9640 1 -- 172.21.15.107:0/4147120582 >> v1:172.21.15.107:6789/0 conn(0x7fdcfc1501c0 legacy=0x7fdcfc072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.395+0000 7fdd016e9640 1 -- 172.21.15.107:0/4147120582 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0c1d30 con 0x7fdcfc156e60 2023-12-16T01:26:05.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.397+0000 7fdd016e9640 1 --2- 172.21.15.107:0/4147120582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc156e60 0x7fdcfc071710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc070840 tx=0x7fdcf402e160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592e088d55b0437a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:05.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdcf37fe640 1 -- 172.21.15.107:0/4147120582 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4036440 con 0x7fdcfc156e60 2023-12-16T01:26:05.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdcf37fe640 1 -- 172.21.15.107:0/4147120582 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40365a0 con 0x7fdcfc156e60 2023-12-16T01:26:05.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdcf37fe640 1 -- 172.21.15.107:0/4147120582 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4036930 con 0x7fdcfc156e60 2023-12-16T01:26:05.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdd0314c640 1 -- 172.21.15.107:0/4147120582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc156e60 msgr2=0x7fdcfc071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4147120582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc156e60 0x7fdcfc071710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc070840 tx=0x7fdcf402e160 comp rx=0 tx=0).stop 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdd0314c640 1 -- 172.21.15.107:0/4147120582 shutdown_connections 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4147120582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc156e60 0x7fdcfc071710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4147120582 >> v2:172.21.15.107:3300/0 conn(0x7fdcfc0bff00 0x7fdcfc159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.401+0000 7fdd0314c640 1 -- 172.21.15.107:0/4147120582 >> 172.21.15.107:0/4147120582 conn(0x7fdcfc06cd60 msgr2=0x7fdcfc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.402+0000 7fdd0314c640 1 -- 172.21.15.107:0/4147120582 shutdown_connections 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.402+0000 7fdd0314c640 1 -- 172.21.15.107:0/4147120582 wait complete. 2023-12-16T01:26:05.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 Processor -- start 2023-12-16T01:26:05.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 -- start start 2023-12-16T01:26:05.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc0bff00 0x7fdcfc0710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcfc1501c0 0x7fdcfc159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcfc156e60 0x7fdcfc149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc151530 con 0x7fdcfc156e60 2023-12-16T01:26:05.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1578b0 con 0x7fdcfc0bff00 2023-12-16T01:26:05.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.403+0000 7fdd0314c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1590b0 con 0x7fdcfc1501c0 2023-12-16T01:26:05.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.404+0000 7fdd016e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcfc156e60 0x7fdcfc149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.404+0000 7fdd00ee8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc0bff00 0x7fdcfc0710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.404+0000 7fdd016e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcfc156e60 0x7fdcfc149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36110/0 (socket says 172.21.15.107:36110) 2023-12-16T01:26:05.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.404+0000 7fdd016e9640 1 -- 172.21.15.107:0/4204594167 learned_addr learned my addr 172.21.15.107:0/4204594167 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:05.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.404+0000 7fdcf3fff640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcfc1501c0 0x7fdcfc159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.407+0000 7fdd00ee8640 1 -- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcfc1501c0 msgr2=0x7fdcfc159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.407+0000 7fdd00ee8640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcfc1501c0 0x7fdcfc159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.408+0000 7fdd00ee8640 1 -- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcfc156e60 msgr2=0x7fdcfc149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.408+0000 7fdd00ee8640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcfc156e60 0x7fdcfc149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.408+0000 7fdd00ee8640 1 -- 172.21.15.107:0/4204594167 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4009a70 con 0x7fdcfc0bff00 2023-12-16T01:26:05.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.410+0000 7fdd00ee8640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc0bff00 0x7fdcfc0710a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800c440 tx=0x7fdcf8001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.413+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8005ce0 con 0x7fdcfc0bff00 2023-12-16T01:26:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.413+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8005e40 con 0x7fdcfc0bff00 2023-12-16T01:26:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.413+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80072d0 con 0x7fdcfc0bff00 2023-12-16T01:26:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.413+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc153a70 con 0x7fdcfc0bff00 2023-12-16T01:26:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.413+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc1534b0 con 0x7fdcfc0bff00 2023-12-16T01:26:05.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.414+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc067500 con 0x7fdcfc0bff00 2023-12-16T01:26:05.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.432+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fdcf8007430 con 0x7fdcfc0bff00 2023-12-16T01:26:05.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.433+0000 7fdcf17fa640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdce806aec0 0x7fdce806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.433+0000 7fdcf3fff640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdce806aec0 0x7fdce806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.433+0000 7fdcf3fff640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdce806aec0 0x7fdce806d380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc14d060 tx=0x7fdcec008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:05.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.435+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdcf8057e30 con 0x7fdcfc0bff00 2023-12-16T01:26:05.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.676+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fdcf8054170 con 0x7fdcfc0bff00 2023-12-16T01:26:05.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.848+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcfc156630 con 0x7fdcfc0bff00 2023-12-16T01:26:05.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.871+0000 7fdcf17fa640 1 -- 172.21.15.107:0/4204594167 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcf80170a0 con 0x7fdcfc0bff00 2023-12-16T01:26:05.872 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdce806aec0 msgr2=0x7fdce806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdce806aec0 0x7fdce806d380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc14d060 tx=0x7fdcec008040 comp rx=0 tx=0).stop 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc0bff00 msgr2=0x7fdcfc0710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc0bff00 0x7fdcfc0710a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800c440 tx=0x7fdcf8001e70 comp rx=0 tx=0).stop 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 shutdown_connections 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcfc156e60 0x7fdcfc149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcfc1501c0 0x7fdcfc159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdce806aec0 0x7fdce806d380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 --2- 172.21.15.107:0/4204594167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcfc0bff00 0x7fdcfc0710a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 >> 172.21.15.107:0/4204594167 conn(0x7fdcfc06cd60 msgr2=0x7fdcfc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:05.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 shutdown_connections 2023-12-16T01:26:05.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.873+0000 7fdd0314c640 1 -- 172.21.15.107:0/4204594167 wait complete. 2023-12-16T01:26:05.884 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T01:26:05.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.987+0000 7f2197290640 1 Processor -- start 2023-12-16T01:26:05.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.987+0000 7f2197290640 1 -- start start 2023-12-16T01:26:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.988+0000 7f2197290640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2190153be0 0x7f2190159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.988+0000 7f2197290640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21900c5e60 0x7f21901641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.988+0000 7f2197290640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2190153fc0 con 0x7f219006fa00 2023-12-16T01:26:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.988+0000 7f2197290640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900c3340 con 0x7f21900c5e60 2023-12-16T01:26:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.988+0000 7f2197290640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219006b7b0 con 0x7f2190153be0 2023-12-16T01:26:05.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.989+0000 7f219582d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21900c5e60 0x7f21901641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.989+0000 7f219502c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2190153be0 0x7f2190159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:05.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.989+0000 7f219582d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21900c5e60 0x7f21901641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44846/0 (socket says 172.21.15.107:44846) 2023-12-16T01:26:05.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.989+0000 7f219582d640 1 -- 172.21.15.107:0/614723178 learned_addr learned my addr 172.21.15.107:0/614723178 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:05.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.992+0000 7f219502c640 1 -- 172.21.15.107:0/614723178 >> v2:172.21.15.157:3300/0 conn(0x7f21900c5e60 msgr2=0x7f21901641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:05.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.992+0000 7f219502c640 1 --2- 172.21.15.107:0/614723178 >> v2:172.21.15.157:3300/0 conn(0x7f21900c5e60 0x7f21901641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:05.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.992+0000 7f219502c640 1 -- 172.21.15.107:0/614723178 >> v1:172.21.15.157:6789/0 conn(0x7f219006fa00 legacy=0x7f21900c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:05.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.992+0000 7f219502c640 1 -- 172.21.15.107:0/614723178 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219006ba90 con 0x7f2190153be0 2023-12-16T01:26:05.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.994+0000 7f219502c640 1 --2- 172.21.15.107:0/614723178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2190153be0 0x7f2190159890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f218c009d90 tx=0x7f218c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25acba65c7507bc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:06.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.997+0000 7f2187fff640 1 -- 172.21.15.107:0/614723178 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c02cc50 con 0x7f2190153be0 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.997+0000 7f2187fff640 1 -- 172.21.15.107:0/614723178 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c02cdb0 con 0x7f2190153be0 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2187fff640 1 -- 172.21.15.107:0/614723178 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c034660 con 0x7f2190153be0 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 -- 172.21.15.107:0/614723178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2190153be0 msgr2=0x7f2190159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 --2- 172.21.15.107:0/614723178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2190153be0 0x7f2190159890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f218c009d90 tx=0x7f218c02bea0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 -- 172.21.15.107:0/614723178 shutdown_connections 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 --2- 172.21.15.107:0/614723178 >> v2:172.21.15.157:3300/0 conn(0x7f21900c5e60 0x7f21901641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 --2- 172.21.15.107:0/614723178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2190153be0 0x7f2190159890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 -- 172.21.15.107:0/614723178 >> 172.21.15.107:0/614723178 conn(0x7f21900c7f60 msgr2=0x7f21900c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 -- 172.21.15.107:0/614723178 shutdown_connections 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.998+0000 7f2197290640 1 -- 172.21.15.107:0/614723178 wait complete. 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.999+0000 7f2197290640 1 Processor -- start 2023-12-16T01:26:06.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:05.999+0000 7f2197290640 1 -- start start 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f2197290640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 0x7f21901564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f2197290640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21900c5e60 0x7f21900c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f2197290640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2190153be0 0x7f21900ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f2197290640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21900c4e00 con 0x7f219006fa00 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f2197290640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21901ef280 con 0x7f2190153be0 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f2197290640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21901570b0 con 0x7f21900c5e60 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.000+0000 7f219502c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 0x7f21901564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.001+0000 7f219482b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21900c5e60 0x7f21900c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.001+0000 7f219502c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 0x7f21901564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36114/0 (socket says 172.21.15.107:36114) 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.001+0000 7f219502c640 1 -- 172.21.15.107:0/419657295 learned_addr learned my addr 172.21.15.107:0/419657295 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:06.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.001+0000 7f219582d640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2190153be0 0x7f21900ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.004+0000 7f219502c640 1 -- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21900c5e60 msgr2=0x7f21900c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.004+0000 7f219502c640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21900c5e60 0x7f21900c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.004+0000 7f219502c640 1 -- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2190153be0 msgr2=0x7f21900ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.004+0000 7f219502c640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2190153be0 0x7f21900ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.004+0000 7f219502c640 1 -- 172.21.15.107:0/419657295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009a70 con 0x7f219006fa00 2023-12-16T01:26:06.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.006+0000 7f219502c640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 0x7f21901564c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f218c009d90 tx=0x7f218c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:06.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.009+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c03e610 con 0x7f219006fa00 2023-12-16T01:26:06.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.010+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c03e770 con 0x7f219006fa00 2023-12-16T01:26:06.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.010+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c03eae0 con 0x7f219006fa00 2023-12-16T01:26:06.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.010+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21901ef540 con 0x7f219006fa00 2023-12-16T01:26:06.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.010+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21900c95e0 con 0x7f219006fa00 2023-12-16T01:26:06.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.011+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2190067500 con 0x7f219006fa00 2023-12-16T01:26:06.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.028+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f218c03b050 con 0x7f219006fa00 2023-12-16T01:26:06.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.029+0000 7f2185ffb640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f217406ae90 0x7f217406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.029+0000 7f219482b640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f217406ae90 0x7f217406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.029+0000 7f219482b640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f217406ae90 0x7f217406d350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21900c7d70 tx=0x7f2180009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:06.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.032+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f218c054e20 con 0x7f219006fa00 2023-12-16T01:26:06.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.262+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f218c077450 con 0x7f219006fa00 2023-12-16T01:26:06.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.455+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f219006f7e0 con 0x7f219006fa00 2023-12-16T01:26:06.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.474+0000 7f2185ffb640 1 -- 172.21.15.107:0/419657295 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f218c04e0a0 con 0x7f219006fa00 2023-12-16T01:26:06.475 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:06.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f217406ae90 msgr2=0x7f217406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f217406ae90 0x7f217406d350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21900c7d70 tx=0x7f2180009040 comp rx=0 tx=0).stop 2023-12-16T01:26:06.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 msgr2=0x7f21901564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 0x7f21901564c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f218c009d90 tx=0x7f218c004a40 comp rx=0 tx=0).stop 2023-12-16T01:26:06.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 shutdown_connections 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f217406ae90 0x7f217406d350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2190153be0 0x7f21900ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21900c5e60 0x7f21900c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 --2- 172.21.15.107:0/419657295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f219006fa00 0x7f21901564c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 >> 172.21.15.107:0/419657295 conn(0x7f21900c7f60 msgr2=0x7f21900c2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 shutdown_connections 2023-12-16T01:26:06.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.476+0000 7f2197290640 1 -- 172.21.15.107:0/419657295 wait complete. 2023-12-16T01:26:06.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T01:26:06.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.591+0000 7f45b1dce640 1 Processor -- start 2023-12-16T01:26:06.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.592+0000 7f45b1dce640 1 -- start start 2023-12-16T01:26:06.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.592+0000 7f45b1dce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac06b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.592+0000 7f45b1dce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45ac15af60 0x7f45ac15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.592+0000 7f45b1dce640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac151b00 con 0x7f45ac0c68f0 2023-12-16T01:26:06.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.592+0000 7f45b1dce640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac1582b0 con 0x7f45ac15af60 2023-12-16T01:26:06.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.592+0000 7f45b1dce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac157730 con 0x7f45ac151720 2023-12-16T01:26:06.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.593+0000 7f45abfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45ac15af60 0x7f45ac15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.593+0000 7f45ab7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac06b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.593+0000 7f45abfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45ac15af60 0x7f45ac15b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44858/0 (socket says 172.21.15.107:44858) 2023-12-16T01:26:06.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.593+0000 7f45abfff640 1 -- 172.21.15.107:0/2397135047 learned_addr learned my addr 172.21.15.107:0/2397135047 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:06.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.596+0000 7f45ab7fe640 1 -- 172.21.15.107:0/2397135047 >> v2:172.21.15.157:3300/0 conn(0x7f45ac15af60 msgr2=0x7f45ac15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:06.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.596+0000 7f45ab7fe640 1 --2- 172.21.15.107:0/2397135047 >> v2:172.21.15.157:3300/0 conn(0x7f45ac15af60 0x7f45ac15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.596+0000 7f45ab7fe640 1 -- 172.21.15.107:0/2397135047 >> v1:172.21.15.157:6789/0 conn(0x7f45ac0c68f0 legacy=0x7f45ac06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:06.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.596+0000 7f45ab7fe640 1 -- 172.21.15.107:0/2397135047 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac157a10 con 0x7f45ac151720 2023-12-16T01:26:06.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.598+0000 7f45ab7fe640 1 --2- 172.21.15.107:0/2397135047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac06b840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45940097a0 tx=0x7f459402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34efd090050cb339 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45aaffd640 1 -- 172.21.15.107:0/2397135047 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459402f050 con 0x7f45ac151720 2023-12-16T01:26:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45aaffd640 1 -- 172.21.15.107:0/2397135047 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594031700 con 0x7f45ac151720 2023-12-16T01:26:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45aaffd640 1 -- 172.21.15.107:0/2397135047 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594031a90 con 0x7f45ac151720 2023-12-16T01:26:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 -- 172.21.15.107:0/2397135047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 msgr2=0x7f45ac06b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 --2- 172.21.15.107:0/2397135047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac06b840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45940097a0 tx=0x7f459402b7a0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 -- 172.21.15.107:0/2397135047 shutdown_connections 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 --2- 172.21.15.107:0/2397135047 >> v2:172.21.15.157:3300/0 conn(0x7f45ac15af60 0x7f45ac15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 --2- 172.21.15.107:0/2397135047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac06b840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 -- 172.21.15.107:0/2397135047 >> 172.21.15.107:0/2397135047 conn(0x7f45ac0cbef0 msgr2=0x7f45ac0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 -- 172.21.15.107:0/2397135047 shutdown_connections 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.602+0000 7f45b1dce640 1 -- 172.21.15.107:0/2397135047 wait complete. 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.603+0000 7f45b1dce640 1 Processor -- start 2023-12-16T01:26:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 -- start start 2023-12-16T01:26:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0c68f0 0x7f45ac0c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45ac15af60 0x7f45ac159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c8180 con 0x7f45ac0c68f0 2023-12-16T01:26:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c9070 con 0x7f45ac15af60 2023-12-16T01:26:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.604+0000 7f45b1dce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c83b0 con 0x7f45ac151720 2023-12-16T01:26:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.605+0000 7f45abfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45ac15af60 0x7f45ac159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.605+0000 7f45ab7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0c68f0 0x7f45ac0c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.605+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.605+0000 7f45ab7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0c68f0 0x7f45ac0c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36124/0 (socket says 172.21.15.107:36124) 2023-12-16T01:26:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.605+0000 7f45ab7fe640 1 -- 172.21.15.107:0/4219182091 learned_addr learned my addr 172.21.15.107:0/4219182091 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.609+0000 7f45a2ffd640 1 -- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45ac15af60 msgr2=0x7f45ac159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.609+0000 7f45a2ffd640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45ac15af60 0x7f45ac159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.609+0000 7f45a2ffd640 1 -- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0c68f0 msgr2=0x7f45ac0c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.609+0000 7f45a2ffd640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0c68f0 0x7f45ac0c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.609+0000 7f45a2ffd640 1 -- 172.21.15.107:0/4219182091 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594009400 con 0x7f45ac151720 2023-12-16T01:26:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.609+0000 7f45abfff640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45ac15af60 0x7f45ac159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.611+0000 7f45a2ffd640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac0c1c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f459c00c410 tx=0x7f459c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.615+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c005230 con 0x7f45ac151720 2023-12-16T01:26:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.615+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c005390 con 0x7f45ac151720 2023-12-16T01:26:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.615+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac1584e0 con 0x7f45ac151720 2023-12-16T01:26:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.615+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c004820 con 0x7f45ac151720 2023-12-16T01:26:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.615+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0c95e0 con 0x7f45ac151720 2023-12-16T01:26:06.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.616+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0cce50 con 0x7f45ac151720 2023-12-16T01:26:06.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.633+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f459c004980 con 0x7f45ac151720 2023-12-16T01:26:06.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.634+0000 7f45a8ff9640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f459006aec0 0x7f459006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:06.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.634+0000 7f45ab7fe640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f459006aec0 0x7f459006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:06.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.634+0000 7f45ab7fe640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f459006aec0 0x7f459006d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f459402b7e0 tx=0x7f4594008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:06.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.636+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f459c057a10 con 0x7f45ac151720 2023-12-16T01:26:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:06.880+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f459c053d50 con 0x7f45ac151720 2023-12-16T01:26:07.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.045+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45ac0740e0 con 0x7f45ac151720 2023-12-16T01:26:07.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.051+0000 7f45a8ff9640 1 -- 172.21.15.107:0/4219182091 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f459c017020 con 0x7f45ac151720 2023-12-16T01:26:07.052 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f459006aec0 msgr2=0x7f459006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f459006aec0 0x7f459006d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f459402b7e0 tx=0x7f4594008030 comp rx=0 tx=0).stop 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 msgr2=0x7f45ac0c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac0c1c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f459c00c410 tx=0x7f459c00c8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 shutdown_connections 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f459006aec0 0x7f459006d380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45ac15af60 0x7f45ac159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45ac151720 0x7f45ac0c1c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 --2- 172.21.15.107:0/4219182091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0c68f0 0x7f45ac0c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 >> 172.21.15.107:0/4219182091 conn(0x7f45ac0cbef0 msgr2=0x7f45ac14ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:07.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 shutdown_connections 2023-12-16T01:26:07.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.053+0000 7f45b1dce640 1 -- 172.21.15.107:0/4219182091 wait complete. 2023-12-16T01:26:07.064 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T01:26:07.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.165+0000 7f03c8bc9640 1 Processor -- start 2023-12-16T01:26:07.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.165+0000 7f03c8bc9640 1 -- start start 2023-12-16T01:26:07.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.166+0000 7f03c8bc9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f03c4151630 0x7f03c406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.166+0000 7f03c8bc9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f03c4157f50 0x7f03c40c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.166+0000 7f03c8bc9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c415b9c0 con 0x7f03c40ca130 2023-12-16T01:26:07.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.166+0000 7f03c8bc9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c41583c0 con 0x7f03c4151630 2023-12-16T01:26:07.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.166+0000 7f03c8bc9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c415ab60 con 0x7f03c4157f50 2023-12-16T01:26:07.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.167+0000 7f03c259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f03c4151630 0x7f03c406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.167+0000 7f03c259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f03c4151630 0x7f03c406f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36128/0 (socket says 172.21.15.107:36128) 2023-12-16T01:26:07.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.167+0000 7f03c259c640 1 -- 172.21.15.107:0/913855098 learned_addr learned my addr 172.21.15.107:0/913855098 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:07.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.167+0000 7f03c1d9b640 1 --2- 172.21.15.107:0/913855098 >> v2:172.21.15.157:3300/0 conn(0x7f03c4157f50 0x7f03c40c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.169+0000 7f03c259c640 1 -- 172.21.15.107:0/913855098 >> v2:172.21.15.157:3300/0 conn(0x7f03c4157f50 msgr2=0x7f03c40c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:07.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.169+0000 7f03c259c640 1 --2- 172.21.15.107:0/913855098 >> v2:172.21.15.157:3300/0 conn(0x7f03c4157f50 0x7f03c40c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.169+0000 7f03c259c640 1 -- 172.21.15.107:0/913855098 >> v1:172.21.15.157:6789/0 conn(0x7f03c40ca130 legacy=0x7f03c40c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.169+0000 7f03c259c640 1 -- 172.21.15.107:0/913855098 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c415ae40 con 0x7f03c4151630 2023-12-16T01:26:07.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.171+0000 7f03c259c640 1 --2- 172.21.15.107:0/913855098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4151630 0x7f03c406f590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c4220 tx=0x7f03b402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93aed49927562241 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:07.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.174+0000 7f03c159a640 1 -- 172.21.15.107:0/913855098 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b402cbb0 con 0x7f03c4151630 2023-12-16T01:26:07.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.175+0000 7f03c159a640 1 -- 172.21.15.107:0/913855098 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b402cd10 con 0x7f03c4151630 2023-12-16T01:26:07.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.175+0000 7f03c159a640 1 -- 172.21.15.107:0/913855098 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4034610 con 0x7f03c4151630 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 -- 172.21.15.107:0/913855098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4151630 msgr2=0x7f03c406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/913855098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4151630 0x7f03c406f590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c4220 tx=0x7f03b402c010 comp rx=0 tx=0).stop 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 -- 172.21.15.107:0/913855098 shutdown_connections 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/913855098 >> v2:172.21.15.157:3300/0 conn(0x7f03c4157f50 0x7f03c40c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/913855098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4151630 0x7f03c406f590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 -- 172.21.15.107:0/913855098 >> 172.21.15.107:0/913855098 conn(0x7f03c4061100 msgr2=0x7f03c40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 -- 172.21.15.107:0/913855098 shutdown_connections 2023-12-16T01:26:07.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.176+0000 7f03c8bc9640 1 -- 172.21.15.107:0/913855098 wait complete. 2023-12-16T01:26:07.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.177+0000 7f03c8bc9640 1 Processor -- start 2023-12-16T01:26:07.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 -- start start 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f03c40ca130 0x7f03c41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c4151630 0x7f03c4155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 0x7f03c40c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c406d6b0 con 0x7f03c4157f50 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4156c10 con 0x7f03c4151630 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.178+0000 7f03c8bc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c406d410 con 0x7f03c40ca130 2023-12-16T01:26:07.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.179+0000 7f03c2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 0x7f03c40c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.179+0000 7f03c2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 0x7f03c40c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36142/0 (socket says 172.21.15.107:36142) 2023-12-16T01:26:07.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.179+0000 7f03c2d9d640 1 -- 172.21.15.107:0/2593753179 learned_addr learned my addr 172.21.15.107:0/2593753179 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:07.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.179+0000 7f03c1d9b640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c4151630 0x7f03c4155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.179+0000 7f03c259c640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f03c40ca130 0x7f03c41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.182+0000 7f03c2d9d640 1 -- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f03c40ca130 msgr2=0x7f03c41566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.182+0000 7f03c2d9d640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f03c40ca130 0x7f03c41566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.182+0000 7f03c2d9d640 1 -- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c4151630 msgr2=0x7f03c4155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.182+0000 7f03c2d9d640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c4151630 0x7f03c4155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.182+0000 7f03c2d9d640 1 -- 172.21.15.107:0/2593753179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4009b30 con 0x7f03c4157f50 2023-12-16T01:26:07.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.185+0000 7f03c2d9d640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 0x7f03c40c5580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03bc001eb0 tx=0x7f03bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:07.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.188+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0052d0 con 0x7f03c4157f50 2023-12-16T01:26:07.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.188+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc005430 con 0x7f03c4157f50 2023-12-16T01:26:07.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.188+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003810 con 0x7f03c4157f50 2023-12-16T01:26:07.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.188+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c406cc30 con 0x7f03c4157f50 2023-12-16T01:26:07.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.188+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c4158f00 con 0x7f03c4157f50 2023-12-16T01:26:07.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.189+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c4159120 con 0x7f03c4157f50 2023-12-16T01:26:07.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.208+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f03bc003970 con 0x7f03c4157f50 2023-12-16T01:26:07.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.208+0000 7f03b2ffd640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f03a406ae90 0x7f03a406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.209+0000 7f03c259c640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f03a406ae90 0x7f03a406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.209+0000 7f03c259c640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f03a406ae90 0x7f03a406d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03b4035000 tx=0x7f03b4030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:07.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.211+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03bc057bd0 con 0x7f03c4157f50 2023-12-16T01:26:07.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.443+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f03bc053f10 con 0x7f03c4157f50 2023-12-16T01:26:07.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.622+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f03c40740e0 con 0x7f03c4157f50 2023-12-16T01:26:07.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.627+0000 7f03b2ffd640 1 -- 172.21.15.107:0/2593753179 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f03bc057530 con 0x7f03c4157f50 2023-12-16T01:26:07.628 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.629+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f03a406ae90 msgr2=0x7f03a406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.629+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f03a406ae90 0x7f03a406d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03b4035000 tx=0x7f03b4030000 comp rx=0 tx=0).stop 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.629+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 msgr2=0x7f03c40c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.629+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 0x7f03c40c5580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03bc001eb0 tx=0x7f03bc00c890 comp rx=0 tx=0).stop 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 shutdown_connections 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03c4157f50 0x7f03c40c5580 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f03a406ae90 0x7f03a406d350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c4151630 0x7f03c4155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 --2- 172.21.15.107:0/2593753179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f03c40ca130 0x7f03c41566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 >> 172.21.15.107:0/2593753179 conn(0x7f03c4061100 msgr2=0x7f03c40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 shutdown_connections 2023-12-16T01:26:07.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.630+0000 7f03c8bc9640 1 -- 172.21.15.107:0/2593753179 wait complete. 2023-12-16T01:26:07.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T01:26:07.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.743+0000 7f53ecebb640 1 Processor -- start 2023-12-16T01:26:07.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.743+0000 7f53ecebb640 1 -- start start 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53ecebb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e8153c70 0x7f53e815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53ecebb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f53e80ceef0 0x7f53e80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53ecebb640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e815a700 con 0x7f53e8153890 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53ecebb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80ca870 con 0x7f53e80ceef0 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53ecebb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8159af0 con 0x7f53e8153c70 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53e659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f53e8153890 0x7f53e80c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55276/0 (socket says 172.21.15.107:55276) 2023-12-16T01:26:07.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.744+0000 7f53e659c640 1 -- 172.21.15.107:0/2891442013 learned_addr learned my addr 172.21.15.107:0/2891442013 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:07.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.745+0000 7f53e6d9d640 1 --2- 172.21.15.107:0/2891442013 >> v2:172.21.15.157:3300/0 conn(0x7f53e80ceef0 0x7f53e80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.745+0000 7f53dffff640 1 --2- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e8153c70 0x7f53e815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.747+0000 7f53e5d9b640 1 -- 172.21.15.107:0/2891442013 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136851899 0 0) 0x7f53e815a700 con 0x7f53e8153890 2023-12-16T01:26:07.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.747+0000 7f53e5d9b640 1 -- 172.21.15.107:0/2891442013 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d4003520 con 0x7f53e8153890 2023-12-16T01:26:07.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.747+0000 7f53e6d9d640 1 -- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e8153c70 msgr2=0x7f53e815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:07.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.747+0000 7f53e6d9d640 1 --2- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e8153c70 0x7f53e815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.747+0000 7f53e6d9d640 1 -- 172.21.15.107:0/2891442013 >> v1:172.21.15.107:6789/0 conn(0x7f53e8153890 legacy=0x7f53e80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.747+0000 7f53e6d9d640 1 -- 172.21.15.107:0/2891442013 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8159dd0 con 0x7f53e80ceef0 2023-12-16T01:26:07.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.749+0000 7f53e6d9d640 1 --2- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e80ceef0 0x7f53e80cf340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009d90 tx=0x7f53e002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815161d286974e8a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:07.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.751+0000 7f53e5d9b640 1 -- 172.21.15.107:0/2891442013 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e002cce0 con 0x7f53e80ceef0 2023-12-16T01:26:07.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.753+0000 7f53e5d9b640 1 -- 172.21.15.107:0/2891442013 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e002ce40 con 0x7f53e80ceef0 2023-12-16T01:26:07.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.753+0000 7f53e5d9b640 1 -- 172.21.15.107:0/2891442013 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0034640 con 0x7f53e80ceef0 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.753+0000 7f53ecebb640 1 -- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e80ceef0 msgr2=0x7f53e80cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.753+0000 7f53ecebb640 1 --2- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e80ceef0 0x7f53e80cf340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009d90 tx=0x7f53e002bf30 comp rx=0 tx=0).stop 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.754+0000 7f53ecebb640 1 -- 172.21.15.107:0/2891442013 shutdown_connections 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.754+0000 7f53ecebb640 1 --2- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e80ceef0 0x7f53e80cf340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.754+0000 7f53ecebb640 1 --2- 172.21.15.107:0/2891442013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e8153c70 0x7f53e815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.754+0000 7f53ecebb640 1 -- 172.21.15.107:0/2891442013 >> 172.21.15.107:0/2891442013 conn(0x7f53e806ba00 msgr2=0x7f53e806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.754+0000 7f53ecebb640 1 -- 172.21.15.107:0/2891442013 shutdown_connections 2023-12-16T01:26:07.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.754+0000 7f53ecebb640 1 -- 172.21.15.107:0/2891442013 wait complete. 2023-12-16T01:26:07.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.755+0000 7f53ecebb640 1 Processor -- start 2023-12-16T01:26:07.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.755+0000 7f53ecebb640 1 -- start start 2023-12-16T01:26:07.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53ecebb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e80ceef0 0x7f53e80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53ecebb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e8153890 0x7f53e8145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53ecebb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e8153c70 0x7f53e8147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:07.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53ecebb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e814fd80 con 0x7f53e8153c70 2023-12-16T01:26:07.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53ecebb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80b5100 con 0x7f53e8153890 2023-12-16T01:26:07.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53ecebb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80b48a0 con 0x7f53e80ceef0 2023-12-16T01:26:07.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e8153c70 0x7f53e8147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53dffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e8153890 0x7f53e8145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53e659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e80ceef0 0x7f53e80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:07.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e8153c70 0x7f53e8147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36144/0 (socket says 172.21.15.107:36144) 2023-12-16T01:26:07.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.756+0000 7f53e6d9d640 1 -- 172.21.15.107:0/3236345094 learned_addr learned my addr 172.21.15.107:0/3236345094 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:07.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.760+0000 7f53dffff640 1 -- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e80ceef0 msgr2=0x7f53e80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.760+0000 7f53dffff640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e80ceef0 0x7f53e80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.760+0000 7f53dffff640 1 -- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e8153c70 msgr2=0x7f53e8147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:07.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.760+0000 7f53dffff640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e8153c70 0x7f53e8147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:07.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.760+0000 7f53dffff640 1 -- 172.21.15.107:0/3236345094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0009a70 con 0x7f53e8153890 2023-12-16T01:26:07.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.762+0000 7f53dffff640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e8153890 0x7f53e8145330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53d000e870 tx=0x7f53d000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.764+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000ee60 con 0x7f53e8153890 2023-12-16T01:26:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.764+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e80b4b40 con 0x7f53e8153890 2023-12-16T01:26:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.764+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e81ef230 con 0x7f53e8153890 2023-12-16T01:26:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.765+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e8067500 con 0x7f53e8153890 2023-12-16T01:26:07.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:07.968+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0005990 con 0x7f53e8153890 2023-12-16T01:26:08.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.025+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0005d00 con 0x7f53e8153890 2023-12-16T01:26:08.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.025+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f53d000c940 con 0x7f53e8153890 2023-12-16T01:26:08.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.026+0000 7f53deffd640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f53c806ae40 0x7f53c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:08.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.026+0000 7f53e659c640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f53c806ae40 0x7f53c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:08.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.026+0000 7f53e659c640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f53c806ae40 0x7f53c806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53d80011e0 tx=0x7f53d8007d30 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:08.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.031+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53d0058b40 con 0x7f53e8153890 2023-12-16T01:26:08.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.042+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f53d0054e80 con 0x7f53e8153890 2023-12-16T01:26:08.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.222+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53e81571c0 con 0x7f53e8153890 2023-12-16T01:26:08.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.228+0000 7f53deffd640 1 -- 172.21.15.107:0/3236345094 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53d0021020 con 0x7f53e8153890 2023-12-16T01:26:08.228 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2023-12-16T01:26:08.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f53c806ae40 msgr2=0x7f53c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f53c806ae40 0x7f53c806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53d80011e0 tx=0x7f53d8007d30 comp rx=0 tx=0).stop 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e8153890 msgr2=0x7f53e8145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e8153890 0x7f53e8145330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53d000e870 tx=0x7f53d000ed30 comp rx=0 tx=0).stop 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 shutdown_connections 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e8153c70 0x7f53e8147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f53c806ae40 0x7f53c806d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53e8153890 0x7f53e8145330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 --2- 172.21.15.107:0/3236345094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53e80ceef0 0x7f53e80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 >> 172.21.15.107:0/3236345094 conn(0x7f53e806ba00 msgr2=0x7f53e8148fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.229+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 shutdown_connections 2023-12-16T01:26:08.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.230+0000 7f53ecebb640 1 -- 172.21.15.107:0/3236345094 wait complete. 2023-12-16T01:26:08.241 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:26:08.241 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T01:26:08.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:08.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.395+0000 7f2ad4b7c640 1 Processor -- start 2023-12-16T01:26:08.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.395+0000 7f2ad4b7c640 1 -- start start 2023-12-16T01:26:08.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.396+0000 7f2ad4b7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:08.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.396+0000 7f2ad4b7c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00ccc50 con 0x7f2ad0070d00 2023-12-16T01:26:08.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.396+0000 7f2ad4b7c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00ccf10 con 0x7f2ad00710e0 2023-12-16T01:26:08.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.396+0000 7f2ad4b7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00cdb90 con 0x7f2ad0153a90 2023-12-16T01:26:08.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.396+0000 7f2ace59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2ad0070d00 0x7f2ad0153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55278/0 (socket says 172.21.15.107:55278) 2023-12-16T01:26:08.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.396+0000 7f2ace59c640 1 -- 172.21.15.107:0/1699508306 learned_addr learned my addr 172.21.15.107:0/1699508306 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:08.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.397+0000 7f2acdd9b640 1 --2- 172.21.15.107:0/1699508306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783951894 0 0) 0x7f2ad00ccc50 con 0x7f2ad0070d00 2023-12-16T01:26:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2abc003520 con 0x7f2ad0070d00 2023-12-16T01:26:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817855402 0 0) 0x7f2ad00ccf10 con 0x7f2ad00710e0 2023-12-16T01:26:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad00ccc50 con 0x7f2ad00710e0 2023-12-16T01:26:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1699508306 >> v1:172.21.15.157:6789/0 conn(0x7f2ad00710e0 legacy=0x7f2ad00c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1699508306 >> v1:172.21.15.107:6789/0 conn(0x7f2ad0070d00 legacy=0x7f2ad0153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.399+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1699508306 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00cd1f0 con 0x7f2ad0153a90 2023-12-16T01:26:08.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.402+0000 7f2acdd9b640 1 --2- 172.21.15.107:0/1699508306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad00ca1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80097d0 tx=0x7f2ab802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e79d894c90d8d0b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.404+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8030880 con 0x7f2ad0153a90 2023-12-16T01:26:08.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.406+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab80309e0 con 0x7f2ad0153a90 2023-12-16T01:26:08.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.406+0000 7f2acd59a640 1 -- 172.21.15.107:0/1699508306 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8030d50 con 0x7f2ad0153a90 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1699508306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 msgr2=0x7f2ad00ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1699508306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad00ca1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80097d0 tx=0x7f2ab802b9c0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1699508306 shutdown_connections 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1699508306 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad00ca1c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1699508306 >> 172.21.15.107:0/1699508306 conn(0x7f2ad006ab30 msgr2=0x7f2ad006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1699508306 shutdown_connections 2023-12-16T01:26:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.407+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1699508306 wait complete. 2023-12-16T01:26:08.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.408+0000 7f2ad4b7c640 1 Processor -- start 2023-12-16T01:26:08.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.408+0000 7f2ad4b7c640 1 -- start start 2023-12-16T01:26:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.409+0000 7f2ad4b7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ad0070d00 0x7f2ad014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.409+0000 7f2ad4b7c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 0x7f2ad01f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.409+0000 7f2ad4b7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad015d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.409+0000 7f2ad4b7c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01f2cb0 con 0x7f2ad00710e0 2023-12-16T01:26:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.409+0000 7f2ad4b7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01eff20 con 0x7f2ad0070d00 2023-12-16T01:26:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.409+0000 7f2ad4b7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01ef960 con 0x7f2ad0153a90 2023-12-16T01:26:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.410+0000 7f2acdd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 0x7f2ad01f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.410+0000 7f2aced9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.410+0000 7f2ace59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ad0070d00 0x7f2ad014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.410+0000 7f2acdd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 0x7f2ad01f3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36158/0 (socket says 172.21.15.107:36158) 2023-12-16T01:26:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.410+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1849947979 learned_addr learned my addr 172.21.15.107:0/1849947979 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.413+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1849947979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 msgr2=0x7f2ad015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.413+0000 7f2acdd9b640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad015d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.413+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1849947979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ad0070d00 msgr2=0x7f2ad014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.413+0000 7f2acdd9b640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ad0070d00 0x7f2ad014e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.413+0000 7f2acdd9b640 1 -- 172.21.15.107:0/1849947979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009400 con 0x7f2ad00710e0 2023-12-16T01:26:08.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.415+0000 7f2acdd9b640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 0x7f2ad01f3140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ab802ba00 tx=0x7f2ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.419+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab803f070 con 0x7f2ad00710e0 2023-12-16T01:26:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.419+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8003610 con 0x7f2ad00710e0 2023-12-16T01:26:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.419+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8003980 con 0x7f2ad00710e0 2023-12-16T01:26:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.419+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad01efc40 con 0x7f2ad00710e0 2023-12-16T01:26:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.419+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad01f2940 con 0x7f2ad00710e0 2023-12-16T01:26:08.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.420+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad01f2ad0 con 0x7f2ad00710e0 2023-12-16T01:26:08.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.663+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2ab8003ae0 con 0x7f2ad00710e0 2023-12-16T01:26:08.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.663+0000 7f2ac6ffd640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ab006ae90 0x7f2ab006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:08.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.664+0000 7f2ace59c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ab006ae90 0x7f2ab006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:08.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.664+0000 7f2ace59c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ab006ae90 0x7f2ab006d350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00012e0 tx=0x7f2ac0001ad0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:08.682 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.681+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ab807a870 con 0x7f2ad00710e0 2023-12-16T01:26:08.682 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.681+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2ab8076bb0 con 0x7f2ad00710e0 2023-12-16T01:26:08.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.865+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad01579a0 con 0x7f2ad00710e0 2023-12-16T01:26:08.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.902+0000 7f2ac6ffd640 1 -- 172.21.15.107:0/1849947979 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f2ab807a1d0 con 0x7f2ad00710e0 2023-12-16T01:26:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:08.903 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ab006ae90 msgr2=0x7f2ab006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ab006ae90 0x7f2ab006d350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00012e0 tx=0x7f2ac0001ad0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 msgr2=0x7f2ad01f3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 0x7f2ad01f3140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ab802ba00 tx=0x7f2ab80046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 shutdown_connections 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ad0153a90 0x7f2ad015d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ad00710e0 0x7f2ad01f3140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ab006ae90 0x7f2ab006d350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 --2- 172.21.15.107:0/1849947979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ad0070d00 0x7f2ad014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:08.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 >> 172.21.15.107:0/1849947979 conn(0x7f2ad006ab30 msgr2=0x7f2ad00c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:08.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 shutdown_connections 2023-12-16T01:26:08.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:08.904+0000 7f2ad4b7c640 1 -- 172.21.15.107:0/1849947979 wait complete. 2023-12-16T01:26:08.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T01:25:45.757668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T01:25:47.362497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T01:25:52.786986+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T01:26:08.916 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:26:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.018+0000 7f9d85c15640 1 Processor -- start 2023-12-16T01:26:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.018+0000 7f9d85c15640 1 -- start start 2023-12-16T01:26:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.019+0000 7f9d85c15640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d8006f160 0x7f9d80159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.019+0000 7f9d85c15640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9d800c2e40 0x7f9d8015a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.019+0000 7f9d85c15640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8006e0f0 con 0x7f9d801537d0 2023-12-16T01:26:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.019+0000 7f9d85c15640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d80159710 con 0x7f9d800c2e40 2023-12-16T01:26:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.019+0000 7f9d85c15640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d800c72d0 con 0x7f9d8006f160 2023-12-16T01:26:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.020+0000 7f9d7effd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d8006f160 0x7f9d80159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.020+0000 7f9d7f7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9d801537d0 0x7f9d8006a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55290/0 (socket says 172.21.15.107:55290) 2023-12-16T01:26:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.020+0000 7f9d7f7fe640 1 -- 172.21.15.107:0/2481008986 learned_addr learned my addr 172.21.15.107:0/2481008986 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.020+0000 7f9d7ffff640 1 --2- 172.21.15.107:0/2481008986 >> v2:172.21.15.107:3300/0 conn(0x7f9d800c2e40 0x7f9d8015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.022+0000 7f9d7effd640 1 -- 172.21.15.107:0/2481008986 >> v2:172.21.15.107:3300/0 conn(0x7f9d800c2e40 msgr2=0x7f9d8015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.022+0000 7f9d7effd640 1 --2- 172.21.15.107:0/2481008986 >> v2:172.21.15.107:3300/0 conn(0x7f9d800c2e40 0x7f9d8015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.022+0000 7f9d7effd640 1 -- 172.21.15.107:0/2481008986 >> v1:172.21.15.107:6789/0 conn(0x7f9d801537d0 legacy=0x7f9d8006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.022+0000 7f9d7effd640 1 -- 172.21.15.107:0/2481008986 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800c7590 con 0x7f9d8006f160 2023-12-16T01:26:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.024+0000 7f9d7effd640 1 --2- 172.21.15.107:0/2481008986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80159bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d800b20e0 tx=0x7f9d7402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c4fe2f4103d240f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:09.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.030+0000 7f9d7e7fc640 1 -- 172.21.15.107:0/2481008986 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74030610 con 0x7f9d8006f160 2023-12-16T01:26:09.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d7e7fc640 1 -- 172.21.15.107:0/2481008986 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74030770 con 0x7f9d8006f160 2023-12-16T01:26:09.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d7e7fc640 1 -- 172.21.15.107:0/2481008986 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74030b00 con 0x7f9d8006f160 2023-12-16T01:26:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 -- 172.21.15.107:0/2481008986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 msgr2=0x7f9d80159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 --2- 172.21.15.107:0/2481008986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80159bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d800b20e0 tx=0x7f9d7402b960 comp rx=0 tx=0).stop 2023-12-16T01:26:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 -- 172.21.15.107:0/2481008986 shutdown_connections 2023-12-16T01:26:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 --2- 172.21.15.107:0/2481008986 >> v2:172.21.15.107:3300/0 conn(0x7f9d800c2e40 0x7f9d8015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 --2- 172.21.15.107:0/2481008986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80159bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 -- 172.21.15.107:0/2481008986 >> 172.21.15.107:0/2481008986 conn(0x7f9d800cbf60 msgr2=0x7f9d800cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 -- 172.21.15.107:0/2481008986 shutdown_connections 2023-12-16T01:26:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.031+0000 7f9d85c15640 1 -- 172.21.15.107:0/2481008986 wait complete. 2023-12-16T01:26:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.032+0000 7f9d85c15640 1 Processor -- start 2023-12-16T01:26:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 -- start start 2023-12-16T01:26:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d800c2e40 0x7f9d801566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 0x7f9d80159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c4490 con 0x7f9d801537d0 2023-12-16T01:26:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c3360 con 0x7f9d8006f160 2023-12-16T01:26:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.033+0000 7f9d85c15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d801eed70 con 0x7f9d800c2e40 2023-12-16T01:26:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.034+0000 7f9d7ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 0x7f9d80159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.034+0000 7f9d7effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d800c2e40 0x7f9d801566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.034+0000 7f9d7ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 0x7f9d80159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36170/0 (socket says 172.21.15.107:36170) 2023-12-16T01:26:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.034+0000 7f9d7ffff640 1 -- 172.21.15.107:0/1935361339 learned_addr learned my addr 172.21.15.107:0/1935361339 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:09.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.036+0000 7f9d7f7fe640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.037+0000 7f9d7ffff640 1 -- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d800c2e40 msgr2=0x7f9d801566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.037+0000 7f9d7ffff640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d800c2e40 0x7f9d801566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.037+0000 7f9d7ffff640 1 -- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 msgr2=0x7f9d80148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.037+0000 7f9d7ffff640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.037+0000 7f9d7ffff640 1 -- 172.21.15.107:0/1935361339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009400 con 0x7f9d801537d0 2023-12-16T01:26:09.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.040+0000 7f9d7ffff640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 0x7f9d80159af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800efc0 tx=0x7f9d7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:09.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.043+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78014480 con 0x7f9d801537d0 2023-12-16T01:26:09.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.043+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800f040 con 0x7f9d801537d0 2023-12-16T01:26:09.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.043+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d801eefd0 con 0x7f9d801537d0 2023-12-16T01:26:09.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.043+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78014820 con 0x7f9d801537d0 2023-12-16T01:26:09.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.043+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d801ef590 con 0x7f9d801537d0 2023-12-16T01:26:09.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.044+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d800674e0 con 0x7f9d801537d0 2023-12-16T01:26:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.063+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f9d78014980 con 0x7f9d801537d0 2023-12-16T01:26:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.063+0000 7f9d67fff640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9d6c06ae90 0x7f9d6c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.063+0000 7f9d7f7fe640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9d6c06ae90 0x7f9d6c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.064+0000 7f9d7f7fe640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9d6c06ae90 0x7f9d6c06d350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d70007fd0 tx=0x7f9d70007e80 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:09.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.295+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d78059670 con 0x7f9d801537d0 2023-12-16T01:26:09.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.295+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f9d780559b0 con 0x7f9d801537d0 2023-12-16T01:26:09.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.461+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d80070880 con 0x7f9d801537d0 2023-12-16T01:26:09.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.465+0000 7f9d67fff640 1 -- 172.21.15.107:0/1935361339 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d78018070 con 0x7f9d801537d0 2023-12-16T01:26:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9d6c06ae90 msgr2=0x7f9d6c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9d6c06ae90 0x7f9d6c06d350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d70007fd0 tx=0x7f9d70007e80 comp rx=0 tx=0).stop 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 msgr2=0x7f9d80159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 0x7f9d80159af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800efc0 tx=0x7f9d7800c490 comp rx=0 tx=0).stop 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 shutdown_connections 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d801537d0 0x7f9d80159af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d800c2e40 0x7f9d801566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9d6c06ae90 0x7f9d6c06d350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 --2- 172.21.15.107:0/1935361339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d8006f160 0x7f9d80148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.467+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 >> 172.21.15.107:0/1935361339 conn(0x7f9d800cbf60 msgr2=0x7f9d80070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.468+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 shutdown_connections 2023-12-16T01:26:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.468+0000 7f9d85c15640 1 -- 172.21.15.107:0/1935361339 wait complete. 2023-12-16T01:26:09.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T01:26:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.580+0000 7f288942d640 1 Processor -- start 2023-12-16T01:26:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.580+0000 7f288942d640 1 -- start start 2023-12-16T01:26:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.581+0000 7f288942d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28840bff00 0x7f2884159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.581+0000 7f288942d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2884072b60 con 0x7f2884156e60 2023-12-16T01:26:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.581+0000 7f288942d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840c1a90 con 0x7f28841501c0 2023-12-16T01:26:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.581+0000 7f288942d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c1d30 con 0x7f28840bff00 2023-12-16T01:26:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.581+0000 7f28837fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2884156e60 0x7f2884071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52758/0 (socket says 172.21.15.107:52758) 2023-12-16T01:26:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.581+0000 7f28837fe640 1 -- 172.21.15.107:0/2418175834 learned_addr learned my addr 172.21.15.107:0/2418175834 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.582+0000 7f28827fc640 1 --2- 172.21.15.107:0/2418175834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28840bff00 0x7f2884159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.584+0000 7f2881ffb640 1 -- 172.21.15.107:0/2418175834 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298410448 0 0) 0x7f2884072b60 con 0x7f2884156e60 2023-12-16T01:26:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.584+0000 7f2881ffb640 1 -- 172.21.15.107:0/2418175834 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c005730 con 0x7f2884156e60 2023-12-16T01:26:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.585+0000 7f2881ffb640 1 -- 172.21.15.107:0/2418175834 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489952416 0 0) 0x7f28840c1a90 con 0x7f28841501c0 2023-12-16T01:26:09.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.585+0000 7f28827fc640 1 -- 172.21.15.107:0/2418175834 >> v1:172.21.15.157:6789/0 conn(0x7f28841501c0 legacy=0x7f2884072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.585+0000 7f28827fc640 1 -- 172.21.15.107:0/2418175834 >> v1:172.21.15.107:6789/0 conn(0x7f2884156e60 legacy=0x7f2884071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.585+0000 7f28827fc640 1 -- 172.21.15.107:0/2418175834 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840c2010 con 0x7f28840bff00 2023-12-16T01:26:09.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.587+0000 7f28827fc640 1 --2- 172.21.15.107:0/2418175834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28840bff00 0x7f2884159860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f28780097d0 tx=0x7f287802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68bdfcff7f97e46 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:09.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.591+0000 7f2881ffb640 1 -- 172.21.15.107:0/2418175834 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878030880 con 0x7f28840bff00 2023-12-16T01:26:09.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.591+0000 7f2881ffb640 1 -- 172.21.15.107:0/2418175834 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28780309e0 con 0x7f28840bff00 2023-12-16T01:26:09.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.591+0000 7f2881ffb640 1 -- 172.21.15.107:0/2418175834 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878030d70 con 0x7f28840bff00 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 -- 172.21.15.107:0/2418175834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28840bff00 msgr2=0x7f2884159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 --2- 172.21.15.107:0/2418175834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28840bff00 0x7f2884159860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f28780097d0 tx=0x7f287802b9c0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 -- 172.21.15.107:0/2418175834 shutdown_connections 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 --2- 172.21.15.107:0/2418175834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28840bff00 0x7f2884159860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 -- 172.21.15.107:0/2418175834 >> 172.21.15.107:0/2418175834 conn(0x7f288406cd60 msgr2=0x7f288406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 -- 172.21.15.107:0/2418175834 shutdown_connections 2023-12-16T01:26:09.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.592+0000 7f288942d640 1 -- 172.21.15.107:0/2418175834 wait complete. 2023-12-16T01:26:09.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.593+0000 7f288942d640 1 Processor -- start 2023-12-16T01:26:09.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.593+0000 7f288942d640 1 -- start start 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f288942d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 0x7f28840c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f288942d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28841501c0 0x7f28841ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f288942d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2884156e60 0x7f288414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f288942d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841e1ff0 con 0x7f28840bff00 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f288942d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841498e0 con 0x7f2884156e60 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f288942d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28841f2ff0 con 0x7f28841501c0 2023-12-16T01:26:09.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.594+0000 7f2882ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 0x7f28840c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.595+0000 7f28837fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2884156e60 0x7f288414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.595+0000 7f28827fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28841501c0 0x7f28841ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.595+0000 7f2882ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 0x7f28840c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36094/0 (socket says 172.21.15.107:36094) 2023-12-16T01:26:09.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.595+0000 7f2882ffd640 1 -- 172.21.15.107:0/1851463007 learned_addr learned my addr 172.21.15.107:0/1851463007 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:09.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.598+0000 7f2882ffd640 1 -- 172.21.15.107:0/1851463007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28841501c0 msgr2=0x7f28841ef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.598+0000 7f2882ffd640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28841501c0 0x7f28841ef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.598+0000 7f2882ffd640 1 -- 172.21.15.107:0/1851463007 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2884156e60 msgr2=0x7f288414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:09.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.598+0000 7f2882ffd640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2884156e60 0x7f288414eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:09.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.598+0000 7f2882ffd640 1 -- 172.21.15.107:0/1851463007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878009400 con 0x7f28840bff00 2023-12-16T01:26:09.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.601+0000 7f2882ffd640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 0x7f28840c5010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f287400c8c0 tx=0x7f287400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:09.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.604+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874003da0 con 0x7f28840bff00 2023-12-16T01:26:09.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.604+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874005070 con 0x7f28840bff00 2023-12-16T01:26:09.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.604+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874005420 con 0x7f28840bff00 2023-12-16T01:26:09.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.604+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28841f2700 con 0x7f28840bff00 2023-12-16T01:26:09.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.604+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28841f29a0 con 0x7f28840bff00 2023-12-16T01:26:09.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.606+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28840c77e0 con 0x7f28840bff00 2023-12-16T01:26:09.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.853+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2874005580 con 0x7f28840bff00 2023-12-16T01:26:09.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.853+0000 7f286b7fe640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f287006ae90 0x7f287006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:09.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.853+0000 7f28827fc640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f287006ae90 0x7f287006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:09.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.854+0000 7f28827fc640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f287006ae90 0x7f287006d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2878036000 tx=0x7f2878008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:09.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.868+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2874058180 con 0x7f28840bff00 2023-12-16T01:26:09.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:09.868+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f28740544c0 con 0x7f28840bff00 2023-12-16T01:26:10.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.063+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2884067500 con 0x7f28840bff00 2023-12-16T01:26:10.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.069+0000 7f286b7fe640 1 -- 172.21.15.107:0/1851463007 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2874057ae0 con 0x7f28840bff00 2023-12-16T01:26:10.070 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f287006ae90 msgr2=0x7f287006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f287006ae90 0x7f287006d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2878036000 tx=0x7f2878008030 comp rx=0 tx=0).stop 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 msgr2=0x7f28840c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 0x7f28840c5010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f287400c8c0 tx=0x7f287400cd80 comp rx=0 tx=0).stop 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 shutdown_connections 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f287006ae90 0x7f287006d350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2884156e60 0x7f288414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28841501c0 0x7f28841ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 --2- 172.21.15.107:0/1851463007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28840bff00 0x7f28840c5010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 >> 172.21.15.107:0/1851463007 conn(0x7f288406cd60 msgr2=0x7f288414ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:10.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 shutdown_connections 2023-12-16T01:26:10.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.072+0000 7f288942d640 1 -- 172.21.15.107:0/1851463007 wait complete. 2023-12-16T01:26:10.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T01:26:10.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.187+0000 7f4cb20b4640 1 Processor -- start 2023-12-16T01:26:10.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.187+0000 7f4cb20b4640 1 -- start start 2023-12-16T01:26:10.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.187+0000 7f4cb20b4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac070d00 0x7f4cac15d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.187+0000 7f4cb20b4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4cac153a90 0x7f4cac0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4cb20b4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac0ca6c0 con 0x7f4cac0710e0 2023-12-16T01:26:10.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4cb20b4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac15da60 con 0x7f4cac153a90 2023-12-16T01:26:10.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4cb20b4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac159880 con 0x7f4cac070d00 2023-12-16T01:26:10.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4cab7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac070d00 0x7f4cac15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4cabfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4cac153a90 0x7f4cac0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4caaffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4cac0710e0 0x7f4cac153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52774/0 (socket says 172.21.15.107:52774) 2023-12-16T01:26:10.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.188+0000 7f4caaffd640 1 -- 172.21.15.107:0/2917067938 learned_addr learned my addr 172.21.15.107:0/2917067938 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:10.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.191+0000 7f4cab7fe640 1 -- 172.21.15.107:0/2917067938 >> v2:172.21.15.107:3300/0 conn(0x7f4cac153a90 msgr2=0x7f4cac0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:10.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.191+0000 7f4cab7fe640 1 --2- 172.21.15.107:0/2917067938 >> v2:172.21.15.107:3300/0 conn(0x7f4cac153a90 0x7f4cac0c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.191+0000 7f4cab7fe640 1 -- 172.21.15.107:0/2917067938 >> v1:172.21.15.107:6789/0 conn(0x7f4cac0710e0 legacy=0x7f4cac153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.191+0000 7f4cab7fe640 1 -- 172.21.15.107:0/2917067938 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac159b60 con 0x7f4cac070d00 2023-12-16T01:26:10.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.193+0000 7f4cab7fe640 1 --2- 172.21.15.107:0/2917067938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac070d00 0x7f4cac15d520 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0097a0 tx=0x7f4c9c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa148dbace805b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:10.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.196+0000 7f4caa7fc640 1 -- 172.21.15.107:0/2917067938 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c030610 con 0x7f4cac070d00 2023-12-16T01:26:10.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.196+0000 7f4caa7fc640 1 -- 172.21.15.107:0/2917067938 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c030770 con 0x7f4cac070d00 2023-12-16T01:26:10.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.196+0000 7f4caa7fc640 1 -- 172.21.15.107:0/2917067938 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c030b00 con 0x7f4cac070d00 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 -- 172.21.15.107:0/2917067938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac070d00 msgr2=0x7f4cac15d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/2917067938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac070d00 0x7f4cac15d520 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0097a0 tx=0x7f4c9c02b960 comp rx=0 tx=0).stop 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 -- 172.21.15.107:0/2917067938 shutdown_connections 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/2917067938 >> v2:172.21.15.107:3300/0 conn(0x7f4cac153a90 0x7f4cac0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/2917067938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac070d00 0x7f4cac15d520 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 -- 172.21.15.107:0/2917067938 >> 172.21.15.107:0/2917067938 conn(0x7f4cac06ab30 msgr2=0x7f4cac06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 -- 172.21.15.107:0/2917067938 shutdown_connections 2023-12-16T01:26:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.197+0000 7f4cb20b4640 1 -- 172.21.15.107:0/2917067938 wait complete. 2023-12-16T01:26:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.198+0000 7f4cb20b4640 1 Processor -- start 2023-12-16T01:26:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.198+0000 7f4cb20b4640 1 -- start start 2023-12-16T01:26:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.199+0000 7f4cb20b4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 0x7f4cac0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.199+0000 7f4cb20b4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac0710e0 0x7f4cac0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.199+0000 7f4cb20b4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cac153a90 0x7f4cac1f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.199+0000 7f4cb20b4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac156a50 con 0x7f4cac070d00 2023-12-16T01:26:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.199+0000 7f4cb20b4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0b2140 con 0x7f4cac153a90 2023-12-16T01:26:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.199+0000 7f4cb20b4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac155e80 con 0x7f4cac0710e0 2023-12-16T01:26:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.200+0000 7f4cab7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 0x7f4cac0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.200+0000 7f4cab7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 0x7f4cac0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36108/0 (socket says 172.21.15.107:36108) 2023-12-16T01:26:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.200+0000 7f4cab7fe640 1 -- 172.21.15.107:0/1864131677 learned_addr learned my addr 172.21.15.107:0/1864131677 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.200+0000 7f4caaffd640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac0710e0 0x7f4cac0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.200+0000 7f4cabfff640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cac153a90 0x7f4cac1f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.203+0000 7f4cab7fe640 1 -- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac0710e0 msgr2=0x7f4cac0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.203+0000 7f4cab7fe640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac0710e0 0x7f4cac0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.203+0000 7f4cab7fe640 1 -- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cac153a90 msgr2=0x7f4cac1f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.203+0000 7f4cab7fe640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cac153a90 0x7f4cac1f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.203+0000 7f4cab7fe640 1 -- 172.21.15.107:0/1864131677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c009400 con 0x7f4cac070d00 2023-12-16T01:26:10.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.206+0000 7f4cab7fe640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 0x7f4cac0cc0e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009890 tx=0x7f4c9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:10.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.209+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c03e040 con 0x7f4cac070d00 2023-12-16T01:26:10.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.209+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c039ce0 con 0x7f4cac070d00 2023-12-16T01:26:10.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.209+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c043680 con 0x7f4cac070d00 2023-12-16T01:26:10.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.209+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac0c7730 con 0x7f4cac070d00 2023-12-16T01:26:10.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.209+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac156400 con 0x7f4cac070d00 2023-12-16T01:26:10.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.210+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac067500 con 0x7f4cac070d00 2023-12-16T01:26:10.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.453+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4c9c0423e0 con 0x7f4cac070d00 2023-12-16T01:26:10.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.453+0000 7f4c93fff640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4c9806ae90 0x7f4c9806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.453+0000 7f4caaffd640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4c9806ae90 0x7f4c9806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.454+0000 7f4caaffd640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4c9806ae90 0x7f4c9806d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4cac06bf00 tx=0x7f4ca0009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.465+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c9c07ab60 con 0x7f4cac070d00 2023-12-16T01:26:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.466+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4c9c076ea0 con 0x7f4cac070d00 2023-12-16T01:26:10.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.631+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cac06bc50 con 0x7f4cac070d00 2023-12-16T01:26:10.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.637+0000 7f4c93fff640 1 -- 172.21.15.107:0/1864131677 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c9c048020 con 0x7f4cac070d00 2023-12-16T01:26:10.639 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-12-16T01:26:10.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4c9806ae90 msgr2=0x7f4c9806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4c9806ae90 0x7f4c9806d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4cac06bf00 tx=0x7f4ca0009040 comp rx=0 tx=0).stop 2023-12-16T01:26:10.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 msgr2=0x7f4cac0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 0x7f4cac0cc0e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009890 tx=0x7f4c9c004730 comp rx=0 tx=0).stop 2023-12-16T01:26:10.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 shutdown_connections 2023-12-16T01:26:10.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4c9806ae90 0x7f4c9806d350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cac153a90 0x7f4cac1f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cac0710e0 0x7f4cac0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 --2- 172.21.15.107:0/1864131677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac070d00 0x7f4cac0cc0e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 >> 172.21.15.107:0/1864131677 conn(0x7f4cac06ab30 msgr2=0x7f4cac06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:10.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 shutdown_connections 2023-12-16T01:26:10.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.639+0000 7f4cb20b4640 1 -- 172.21.15.107:0/1864131677 wait complete. 2023-12-16T01:26:10.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T01:26:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.754+0000 7ffa0a93a640 1 Processor -- start 2023-12-16T01:26:10.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.754+0000 7ffa0a93a640 1 -- start start 2023-12-16T01:26:10.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.755+0000 7ffa0a93a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa04151510 0x7ffa040cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.755+0000 7ffa0a93a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa040c61a0 0x7ffa040cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.755+0000 7ffa0a93a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0415b6e0 con 0x7ffa040728b0 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.755+0000 7ffa0a93a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0415a880 con 0x7ffa04151510 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.755+0000 7ffa0a93a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0406f7e0 con 0x7ffa040c61a0 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.755+0000 7ffa03fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa04151510 0x7ffa040cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.756+0000 7ffa08ed7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa040c61a0 0x7ffa040cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.756+0000 7ffa03fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa04151510 0x7ffa040cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36112/0 (socket says 172.21.15.107:36112) 2023-12-16T01:26:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.756+0000 7ffa03fff640 1 -- 172.21.15.107:0/1308918960 learned_addr learned my addr 172.21.15.107:0/1308918960 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:10.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.758+0000 7ffa03fff640 1 -- 172.21.15.107:0/1308918960 >> v2:172.21.15.157:3300/0 conn(0x7ffa040c61a0 msgr2=0x7ffa040cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:10.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.758+0000 7ffa03fff640 1 --2- 172.21.15.107:0/1308918960 >> v2:172.21.15.157:3300/0 conn(0x7ffa040c61a0 0x7ffa040cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.758+0000 7ffa03fff640 1 -- 172.21.15.107:0/1308918960 >> v1:172.21.15.157:6789/0 conn(0x7ffa040728b0 legacy=0x7ffa040c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.758+0000 7ffa03fff640 1 -- 172.21.15.107:0/1308918960 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0415aad0 con 0x7ffa04151510 2023-12-16T01:26:10.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.760+0000 7ffa03fff640 1 --2- 172.21.15.107:0/1308918960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa04151510 0x7ffa040cae30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa04070bf0 tx=0x7ff9f402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da55198328ab1af5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:10.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.763+0000 7ffa02ffd640 1 -- 172.21.15.107:0/1308918960 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4030860 con 0x7ffa04151510 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa02ffd640 1 -- 172.21.15.107:0/1308918960 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f40309c0 con 0x7ffa04151510 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa02ffd640 1 -- 172.21.15.107:0/1308918960 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4030d50 con 0x7ffa04151510 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 -- 172.21.15.107:0/1308918960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa04151510 msgr2=0x7ffa040cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/1308918960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa04151510 0x7ffa040cae30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa04070bf0 tx=0x7ff9f402b9a0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 -- 172.21.15.107:0/1308918960 shutdown_connections 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/1308918960 >> v2:172.21.15.157:3300/0 conn(0x7ffa040c61a0 0x7ffa040cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/1308918960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa04151510 0x7ffa040cae30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 -- 172.21.15.107:0/1308918960 >> 172.21.15.107:0/1308918960 conn(0x7ffa0406cd60 msgr2=0x7ffa0406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:10.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 -- 172.21.15.107:0/1308918960 shutdown_connections 2023-12-16T01:26:10.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.764+0000 7ffa0a93a640 1 -- 172.21.15.107:0/1308918960 wait complete. 2023-12-16T01:26:10.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.765+0000 7ffa0a93a640 1 Processor -- start 2023-12-16T01:26:10.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 -- start start 2023-12-16T01:26:10.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa040728b0 0x7ffa041ec980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 0x7ffa040c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa04151510 0x7ffa04151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040c4390 con 0x7ffa040c61a0 2023-12-16T01:26:10.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa041551d0 con 0x7ffa04151510 2023-12-16T01:26:10.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.766+0000 7ffa0a93a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040c2ad0 con 0x7ffa040728b0 2023-12-16T01:26:10.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.767+0000 7ffa037fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 0x7ffa040c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.767+0000 7ffa08ed7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa04151510 0x7ffa04151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.767+0000 7ffa037fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 0x7ffa040c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36130/0 (socket says 172.21.15.107:36130) 2023-12-16T01:26:10.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.767+0000 7ffa037fe640 1 -- 172.21.15.107:0/400139054 learned_addr learned my addr 172.21.15.107:0/400139054 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:10.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.767+0000 7ffa03fff640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa040728b0 0x7ffa041ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.771+0000 7ffa037fe640 1 -- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa040728b0 msgr2=0x7ffa041ec980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.771+0000 7ffa037fe640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa040728b0 0x7ffa041ec980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.771+0000 7ffa037fe640 1 -- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa04151510 msgr2=0x7ffa04151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:10.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.771+0000 7ffa037fe640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa04151510 0x7ffa04151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:10.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.771+0000 7ffa037fe640 1 -- 172.21.15.107:0/400139054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40094d0 con 0x7ffa040c61a0 2023-12-16T01:26:10.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.773+0000 7ffa037fe640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 0x7ffa040c3e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c3c0 tx=0x7ff9f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:10.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.776+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80052d0 con 0x7ffa040c61a0 2023-12-16T01:26:10.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.776+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f8005450 con 0x7ffa040c61a0 2023-12-16T01:26:10.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.776+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8007260 con 0x7ffa040c61a0 2023-12-16T01:26:10.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.777+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa040c2db0 con 0x7ffa040c61a0 2023-12-16T01:26:10.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.777+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa040c3370 con 0x7ffa040c61a0 2023-12-16T01:26:10.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.777+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04067500 con 0x7ffa040c61a0 2023-12-16T01:26:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.796+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff9f80073c0 con 0x7ffa040c61a0 2023-12-16T01:26:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.796+0000 7ffa00ff9640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f006ae90 0x7ff9f006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.796+0000 7ffa03fff640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f006ae90 0x7ff9f006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.797+0000 7ffa03fff640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f006ae90 0x7ff9f006d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4036000 tx=0x7ff9f4008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:10.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:10.798+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff9f8057c10 con 0x7ffa040c61a0 2023-12-16T01:26:11.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.027+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff9f8053f50 con 0x7ffa040c61a0 2023-12-16T01:26:11.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.199+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffa04152440 con 0x7ffa040c61a0 2023-12-16T01:26:11.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.205+0000 7ffa00ff9640 1 -- 172.21.15.107:0/400139054 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff9f8020020 con 0x7ffa040c61a0 2023-12-16T01:26:11.207 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f006ae90 msgr2=0x7ff9f006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f006ae90 0x7ff9f006d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4036000 tx=0x7ff9f4008030 comp rx=0 tx=0).stop 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 msgr2=0x7ffa040c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 0x7ffa040c3e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c3c0 tx=0x7ff9f800c880 comp rx=0 tx=0).stop 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 shutdown_connections 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f006ae90 0x7ff9f006d350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa04151510 0x7ffa04151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa040c61a0 0x7ffa040c3e50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 --2- 172.21.15.107:0/400139054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa040728b0 0x7ffa041ec980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 >> 172.21.15.107:0/400139054 conn(0x7ffa0406cd60 msgr2=0x7ffa04150070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:11.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 shutdown_connections 2023-12-16T01:26:11.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.207+0000 7ffa0a93a640 1 -- 172.21.15.107:0/400139054 wait complete. 2023-12-16T01:26:11.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T01:26:11.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.318+0000 7f4c06e2d640 1 Processor -- start 2023-12-16T01:26:11.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.318+0000 7f4c06e2d640 1 -- start start 2023-12-16T01:26:11.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4c06e2d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4c00151130 0x7f4c00157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4c06e2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c000b1ff0 0x7f4c00070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4c06e2d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c000cd1b0 con 0x7f4c000ccc50 2023-12-16T01:26:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4c06e2d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000cd490 con 0x7f4c00151130 2023-12-16T01:26:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4c06e2d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000cd770 con 0x7f4c000b1ff0 2023-12-16T01:26:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4c04bc9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4c00151130 0x7f4c00157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.319+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c000b1ff0 0x7f4c00070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.320+0000 7f4c04bc9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4c00151130 0x7f4c00157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51604/0 (socket says 172.21.15.107:51604) 2023-12-16T01:26:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.320+0000 7f4c04bc9640 1 -- 172.21.15.107:0/783438447 learned_addr learned my addr 172.21.15.107:0/783438447 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:11.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.322+0000 7f4bfffff640 1 -- 172.21.15.107:0/783438447 >> v2:172.21.15.157:3300/0 conn(0x7f4c00151130 msgr2=0x7f4c00157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:11.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.322+0000 7f4bfffff640 1 --2- 172.21.15.107:0/783438447 >> v2:172.21.15.157:3300/0 conn(0x7f4c00151130 0x7f4c00157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.322+0000 7f4bfffff640 1 -- 172.21.15.107:0/783438447 >> v1:172.21.15.157:6789/0 conn(0x7f4c000ccc50 legacy=0x7f4c000c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:11.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.322+0000 7f4bfffff640 1 -- 172.21.15.107:0/783438447 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00157430 con 0x7f4c000b1ff0 2023-12-16T01:26:11.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.324+0000 7f4bfffff640 1 --2- 172.21.15.107:0/783438447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c000b1ff0 0x7f4c00070a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4be80097d0 tx=0x7f4be802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db217a3c793dbc40 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:11.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.328+0000 7f4bff7fe640 1 -- 172.21.15.107:0/783438447 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8031800 con 0x7f4c000b1ff0 2023-12-16T01:26:11.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4bff7fe640 1 -- 172.21.15.107:0/783438447 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8031960 con 0x7f4c000b1ff0 2023-12-16T01:26:11.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4bff7fe640 1 -- 172.21.15.107:0/783438447 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8031cf0 con 0x7f4c000b1ff0 2023-12-16T01:26:11.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 -- 172.21.15.107:0/783438447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c000b1ff0 msgr2=0x7f4c00070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/783438447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c000b1ff0 0x7f4c00070a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4be80097d0 tx=0x7f4be802b8a0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 -- 172.21.15.107:0/783438447 shutdown_connections 2023-12-16T01:26:11.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/783438447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c000b1ff0 0x7f4c00070a90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/783438447 >> v2:172.21.15.157:3300/0 conn(0x7f4c00151130 0x7f4c00157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 -- 172.21.15.107:0/783438447 >> 172.21.15.107:0/783438447 conn(0x7f4c0006ab30 msgr2=0x7f4c0006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:11.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 -- 172.21.15.107:0/783438447 shutdown_connections 2023-12-16T01:26:11.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.329+0000 7f4c06e2d640 1 -- 172.21.15.107:0/783438447 wait complete. 2023-12-16T01:26:11.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.330+0000 7f4c06e2d640 1 Processor -- start 2023-12-16T01:26:11.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.330+0000 7f4c06e2d640 1 -- start start 2023-12-16T01:26:11.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.331+0000 7f4c06e2d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c000b1ff0 0x7f4c000c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:11.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.331+0000 7f4c06e2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 0x7f4c000cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:11.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.331+0000 7f4c06e2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c00151130 0x7f4c001e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:11.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.331+0000 7f4c06e2d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001e2760 con 0x7f4c000ccc50 2023-12-16T01:26:11.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.331+0000 7f4c06e2d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000b1a90 con 0x7f4c000b1ff0 2023-12-16T01:26:11.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.331+0000 7f4c06e2d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001e1e30 con 0x7f4c00151130 2023-12-16T01:26:11.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.332+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 0x7f4c000cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:11.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.332+0000 7f4c053ca640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c00151130 0x7f4c001e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:11.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.332+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 0x7f4c000cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36138/0 (socket says 172.21.15.107:36138) 2023-12-16T01:26:11.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.332+0000 7f4bfffff640 1 -- 172.21.15.107:0/1833420445 learned_addr learned my addr 172.21.15.107:0/1833420445 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:11.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.332+0000 7f4c04bc9640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c000b1ff0 0x7f4c000c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:11.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.336+0000 7f4bfffff640 1 -- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c00151130 msgr2=0x7f4c001e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.336+0000 7f4bfffff640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c00151130 0x7f4c001e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.336+0000 7f4bfffff640 1 -- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c000b1ff0 msgr2=0x7f4c000c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.336+0000 7f4bfffff640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c000b1ff0 0x7f4c000c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.336+0000 7f4bfffff640 1 -- 172.21.15.107:0/1833420445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8009400 con 0x7f4c000ccc50 2023-12-16T01:26:11.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.338+0000 7f4bfffff640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 0x7f4c000cbef0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4be802b8e0 tx=0x7f4be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:11.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.341+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be803bc70 con 0x7f4c000ccc50 2023-12-16T01:26:11.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.341+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be803bdd0 con 0x7f4c000ccc50 2023-12-16T01:26:11.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.341+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c001e2110 con 0x7f4c000ccc50 2023-12-16T01:26:11.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.341+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8045630 con 0x7f4c000ccc50 2023-12-16T01:26:11.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.341+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c000c5a40 con 0x7f4c000ccc50 2023-12-16T01:26:11.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.342+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c001e2910 con 0x7f4c000ccc50 2023-12-16T01:26:11.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.587+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4be804e450 con 0x7f4c000ccc50 2023-12-16T01:26:11.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.587+0000 7f4bfd7fa640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4be006ae70 0x7f4be006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:11.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.587+0000 7f4c04bc9640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4be006ae70 0x7f4be006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:11.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.588+0000 7f4c04bc9640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4be006ae70 0x7f4be006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009b30 tx=0x7f4bf0009240 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:11.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.599+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4be802e070 con 0x7f4c000ccc50 2023-12-16T01:26:11.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.599+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4be8076c60 con 0x7f4c000ccc50 2023-12-16T01:26:11.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.782+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c001e2910 con 0x7f4c000ccc50 2023-12-16T01:26:11.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.786+0000 7f4bfd7fa640 1 -- 172.21.15.107:0/1833420445 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4c001e2910 con 0x7f4c000ccc50 2023-12-16T01:26:11.788 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2023-12-16T01:26:11.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4be006ae70 msgr2=0x7f4be006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4be006ae70 0x7f4be006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009b30 tx=0x7f4bf0009240 comp rx=0 tx=0).stop 2023-12-16T01:26:11.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 msgr2=0x7f4c000cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:11.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 0x7f4c000cbef0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4be802b8e0 tx=0x7f4be80046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 shutdown_connections 2023-12-16T01:26:11.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c00151130 0x7f4c001e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c000ccc50 0x7f4c000cbef0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4be006ae70 0x7f4be006d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 --2- 172.21.15.107:0/1833420445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c000b1ff0 0x7f4c000c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:11.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 >> 172.21.15.107:0/1833420445 conn(0x7f4c0006ab30 msgr2=0x7f4c00155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:11.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 shutdown_connections 2023-12-16T01:26:11.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:11.788+0000 7f4c06e2d640 1 -- 172.21.15.107:0/1833420445 wait complete. 2023-12-16T01:26:11.800 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2023-12-16T01:26:11.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:11.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-16T01:26:11.826 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:ceph-fuse[94180]: fuse finished with error 0 and tester_r 0 2023-12-16T01:26:11.827 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:26:11.924 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:26:11.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:11.924 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-16T01:26:11.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:12.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.096+0000 7ff2a8056640 1 Processor -- start 2023-12-16T01:26:12.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.096+0000 7ff2a8056640 1 -- start start 2023-12-16T01:26:12.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a8056640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a8056640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2a00ceef0 0x7ff2a00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a8056640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a015a700 con 0x7ff2a0153890 2023-12-16T01:26:12.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a8056640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00ca870 con 0x7ff2a00ceef0 2023-12-16T01:26:12.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a8056640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0159af0 con 0x7ff2a0153c70 2023-12-16T01:26:12.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a65f3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2a00ceef0 0x7ff2a00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.097+0000 7ff2a55f1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.098+0000 7ff2a65f3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2a00ceef0 0x7ff2a00cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51632/0 (socket says 172.21.15.107:51632) 2023-12-16T01:26:12.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.098+0000 7ff2a65f3640 1 -- 172.21.15.107:0/3307488016 learned_addr learned my addr 172.21.15.107:0/3307488016 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:12.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.101+0000 7ff2a55f1640 1 -- 172.21.15.107:0/3307488016 >> v2:172.21.15.157:3300/0 conn(0x7ff2a00ceef0 msgr2=0x7ff2a00cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:12.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.101+0000 7ff2a55f1640 1 --2- 172.21.15.107:0/3307488016 >> v2:172.21.15.157:3300/0 conn(0x7ff2a00ceef0 0x7ff2a00cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.101+0000 7ff2a55f1640 1 -- 172.21.15.107:0/3307488016 >> v1:172.21.15.157:6789/0 conn(0x7ff2a0153890 legacy=0x7ff2a00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.101+0000 7ff2a55f1640 1 -- 172.21.15.107:0/3307488016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0159dd0 con 0x7ff2a0153c70 2023-12-16T01:26:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.106+0000 7ff2a55f1640 1 --2- 172.21.15.107:0/3307488016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a015d950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2900097a0 tx=0x7ff29002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a8e5888a4752680 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:12.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.163+0000 7ff2a4df0640 1 -- 172.21.15.107:0/3307488016 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290030610 con 0x7ff2a0153c70 2023-12-16T01:26:12.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.163+0000 7ff2a4df0640 1 -- 172.21.15.107:0/3307488016 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290030770 con 0x7ff2a0153c70 2023-12-16T01:26:12.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.163+0000 7ff2a4df0640 1 -- 172.21.15.107:0/3307488016 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290030b00 con 0x7ff2a0153c70 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 -- 172.21.15.107:0/3307488016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 msgr2=0x7ff2a015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 --2- 172.21.15.107:0/3307488016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a015d950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2900097a0 tx=0x7ff29002b960 comp rx=0 tx=0).stop 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 -- 172.21.15.107:0/3307488016 shutdown_connections 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 --2- 172.21.15.107:0/3307488016 >> v2:172.21.15.157:3300/0 conn(0x7ff2a00ceef0 0x7ff2a00cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 --2- 172.21.15.107:0/3307488016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a015d950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 -- 172.21.15.107:0/3307488016 >> 172.21.15.107:0/3307488016 conn(0x7ff2a006ba00 msgr2=0x7ff2a006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 -- 172.21.15.107:0/3307488016 shutdown_connections 2023-12-16T01:26:12.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.164+0000 7ff2a8056640 1 -- 172.21.15.107:0/3307488016 wait complete. 2023-12-16T01:26:12.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 Processor -- start 2023-12-16T01:26:12.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 -- start start 2023-12-16T01:26:12.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a00ceef0 0x7ff2a0147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 0x7ff2a0146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a0154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0154880 con 0x7ff2a00ceef0 2023-12-16T01:26:12.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a01489d0 con 0x7ff2a0153890 2023-12-16T01:26:12.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.166+0000 7ff2a8056640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0147560 con 0x7ff2a0153c70 2023-12-16T01:26:12.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.167+0000 7ff2a55f1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 0x7ff2a0146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.167+0000 7ff2a65f3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.168+0000 7ff2a55f1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 0x7ff2a0146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51646/0 (socket says 172.21.15.107:51646) 2023-12-16T01:26:12.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.168+0000 7ff2a65f3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a0154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:41666/0 (socket says 172.21.15.107:41666) 2023-12-16T01:26:12.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.168+0000 7ff2a55f1640 1 -- 172.21.15.107:0/2572120494 learned_addr learned my addr 172.21.15.107:0/2572120494 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:12.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.168+0000 7ff2a5df2640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a00ceef0 0x7ff2a0147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.171+0000 7ff2a55f1640 1 -- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 msgr2=0x7ff2a0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.171+0000 7ff2a55f1640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.171+0000 7ff2a55f1640 1 -- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a00ceef0 msgr2=0x7ff2a0147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.171+0000 7ff2a55f1640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a00ceef0 0x7ff2a0147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.171+0000 7ff2a55f1640 1 -- 172.21.15.107:0/2572120494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290009400 con 0x7ff2a0153890 2023-12-16T01:26:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.174+0000 7ff2a55f1640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 0x7ff2a0146930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff290009890 tx=0x7ff2900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:12.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.177+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29003e070 con 0x7ff2a0153890 2023-12-16T01:26:12.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.177+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a0146fa0 con 0x7ff2a0153890 2023-12-16T01:26:12.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.177+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a01541c0 con 0x7ff2a0153890 2023-12-16T01:26:12.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.178+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a01549c0 con 0x7ff2a0153890 2023-12-16T01:26:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.478+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2900397a0 con 0x7ff2a0153890 2023-12-16T01:26:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.478+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290039b10 con 0x7ff2a0153890 2023-12-16T01:26:12.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.478+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff290039cb0 con 0x7ff2a0153890 2023-12-16T01:26:12.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.479+0000 7ff2967fc640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff28406ae40 0x7ff28406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.479+0000 7ff2a5df2640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff28406ae40 0x7ff28406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.479+0000 7ff2a5df2640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff28406ae40 0x7ff28406d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff29c001640 tx=0x7ff29c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:12.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.481+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff29007b2f0 con 0x7ff2a0153890 2023-12-16T01:26:12.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.492+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff290076f30 con 0x7ff2a0153890 2023-12-16T01:26:12.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.663+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a01549c0 con 0x7ff2a0153890 2023-12-16T01:26:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.702+0000 7ff2967fc640 1 -- 172.21.15.107:0/2572120494 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7ff2a01549c0 con 0x7ff2a0153890 2023-12-16T01:26:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:12.704 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff28406ae40 msgr2=0x7ff28406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff28406ae40 0x7ff28406d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff29c001640 tx=0x7ff29c009040 comp rx=0 tx=0).stop 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 msgr2=0x7ff2a0146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 0x7ff2a0146930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff290009890 tx=0x7ff2900046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 shutdown_connections 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a0153c70 0x7ff2a0154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff28406ae40 0x7ff28406d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a0153890 0x7ff2a0146930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 --2- 172.21.15.107:0/2572120494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a00ceef0 0x7ff2a0147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 >> 172.21.15.107:0/2572120494 conn(0x7ff2a006ba00 msgr2=0x7ff2a015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 shutdown_connections 2023-12-16T01:26:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.703+0000 7ff2a8056640 1 -- 172.21.15.107:0/2572120494 wait complete. 2023-12-16T01:26:12.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:12.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.815+0000 7f2e23fff640 1 Processor -- start 2023-12-16T01:26:12.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.815+0000 7f2e23fff640 1 -- start start 2023-12-16T01:26:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e23fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2e240cde30 0x7f2e2415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e23fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 0x7f2e240cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e23fff640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e240c95f0 con 0x7f2e24153840 2023-12-16T01:26:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e23fff640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e240c9e00 con 0x7f2e240cde30 2023-12-16T01:26:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e23fff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e241594e0 con 0x7f2e240cb390 2023-12-16T01:26:12.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e227fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2e240cde30 0x7f2e2415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.816+0000 7f2e237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 0x7f2e240cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.817+0000 7f2e237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 0x7f2e240cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:41674/0 (socket says 172.21.15.107:41674) 2023-12-16T01:26:12.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.817+0000 7f2e237fe640 1 -- 172.21.15.107:0/1098759781 learned_addr learned my addr 172.21.15.107:0/1098759781 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.819+0000 7f2e237fe640 1 -- 172.21.15.107:0/1098759781 >> v2:172.21.15.157:3300/0 conn(0x7f2e240cde30 msgr2=0x7f2e2415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.819+0000 7f2e237fe640 1 --2- 172.21.15.107:0/1098759781 >> v2:172.21.15.157:3300/0 conn(0x7f2e240cde30 0x7f2e2415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.819+0000 7f2e237fe640 1 -- 172.21.15.107:0/1098759781 >> v1:172.21.15.157:6789/0 conn(0x7f2e24153840 legacy=0x7f2e24159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.819+0000 7f2e237fe640 1 -- 172.21.15.107:0/1098759781 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e240cc030 con 0x7f2e240cb390 2023-12-16T01:26:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.822+0000 7f2e237fe640 1 --2- 172.21.15.107:0/1098759781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 0x7f2e240cd2d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009870 tx=0x7f2e1402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e322f48e8b56d52 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:12.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e21ffb640 1 -- 172.21.15.107:0/1098759781 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14031640 con 0x7f2e240cb390 2023-12-16T01:26:12.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e21ffb640 1 -- 172.21.15.107:0/1098759781 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e140317a0 con 0x7f2e240cb390 2023-12-16T01:26:12.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e21ffb640 1 -- 172.21.15.107:0/1098759781 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14031b30 con 0x7f2e240cb390 2023-12-16T01:26:12.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 -- 172.21.15.107:0/1098759781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 msgr2=0x7f2e240cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 --2- 172.21.15.107:0/1098759781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 0x7f2e240cd2d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009870 tx=0x7f2e1402b8f0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 -- 172.21.15.107:0/1098759781 shutdown_connections 2023-12-16T01:26:12.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 --2- 172.21.15.107:0/1098759781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e240cb390 0x7f2e240cd2d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 --2- 172.21.15.107:0/1098759781 >> v2:172.21.15.157:3300/0 conn(0x7f2e240cde30 0x7f2e2415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 -- 172.21.15.107:0/1098759781 >> 172.21.15.107:0/1098759781 conn(0x7f2e24060f20 msgr2=0x7f2e24061330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:12.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 -- 172.21.15.107:0/1098759781 shutdown_connections 2023-12-16T01:26:12.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.826+0000 7f2e23fff640 1 -- 172.21.15.107:0/1098759781 wait complete. 2023-12-16T01:26:12.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.827+0000 7f2e23fff640 1 Processor -- start 2023-12-16T01:26:12.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.827+0000 7f2e23fff640 1 -- start start 2023-12-16T01:26:12.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.828+0000 7f2e23fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e240cb390 0x7f2e24158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.828+0000 7f2e23fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 0x7f2e240cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.828+0000 7f2e23fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e24153840 0x7f2e240ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:12.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.828+0000 7f2e23fff640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24149620 con 0x7f2e240cde30 2023-12-16T01:26:12.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.828+0000 7f2e23fff640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2414a1e0 con 0x7f2e240cb390 2023-12-16T01:26:12.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.828+0000 7f2e23fff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24156110 con 0x7f2e24153840 2023-12-16T01:26:12.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.829+0000 7f2e227fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 0x7f2e240cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.829+0000 7f2e22ffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e240cb390 0x7f2e24158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.829+0000 7f2e237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e24153840 0x7f2e240ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:12.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.829+0000 7f2e227fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 0x7f2e240cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36160/0 (socket says 172.21.15.107:36160) 2023-12-16T01:26:12.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.829+0000 7f2e227fc640 1 -- 172.21.15.107:0/3252535698 learned_addr learned my addr 172.21.15.107:0/3252535698 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:12.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.832+0000 7f2e227fc640 1 -- 172.21.15.107:0/3252535698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e24153840 msgr2=0x7f2e240ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.832+0000 7f2e227fc640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e24153840 0x7f2e240ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.832+0000 7f2e227fc640 1 -- 172.21.15.107:0/3252535698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e240cb390 msgr2=0x7f2e24158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:12.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.832+0000 7f2e227fc640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e240cb390 0x7f2e24158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:12.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.832+0000 7f2e227fc640 1 -- 172.21.15.107:0/3252535698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140094d0 con 0x7f2e240cde30 2023-12-16T01:26:12.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.835+0000 7f2e227fc640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 0x7f2e240cca50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00e9b0 tx=0x7f2e0c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.838+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c009670 con 0x7f2e240cde30 2023-12-16T01:26:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.838+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00c9a0 con 0x7f2e240cde30 2023-12-16T01:26:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.838+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00cd50 con 0x7f2e240cde30 2023-12-16T01:26:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.838+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24154270 con 0x7f2e240cde30 2023-12-16T01:26:12.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.839+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e241563d0 con 0x7f2e240cde30 2023-12-16T01:26:12.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:12.840+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e240740e0 con 0x7f2e240cde30 2023-12-16T01:26:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.083+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2e0c013470 con 0x7f2e240cde30 2023-12-16T01:26:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.083+0000 7f2e1bfff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2e0406ae90 0x7f2e0406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.083+0000 7f2e22ffd640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2e0406ae90 0x7f2e0406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.084+0000 7f2e22ffd640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2e0406ae90 0x7f2e0406d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c001e70 tx=0x7f2e1c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.097+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e0c058dc0 con 0x7f2e240cde30 2023-12-16T01:26:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.098+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2e0c055100 con 0x7f2e240cde30 2023-12-16T01:26:13.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.269+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e240cc4f0 con 0x7f2e240cde30 2023-12-16T01:26:13.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.307+0000 7f2e1bfff640 1 -- 172.21.15.107:0/3252535698 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f2e0c021020 con 0x7f2e240cde30 2023-12-16T01:26:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:13.309 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2e0406ae90 msgr2=0x7f2e0406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2e0406ae90 0x7f2e0406d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c001e70 tx=0x7f2e1c009040 comp rx=0 tx=0).stop 2023-12-16T01:26:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 msgr2=0x7f2e240cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 0x7f2e240cca50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00e9b0 tx=0x7f2e0c00ee70 comp rx=0 tx=0).stop 2023-12-16T01:26:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 shutdown_connections 2023-12-16T01:26:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e24153840 0x7f2e240ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e240cde30 0x7f2e240cca50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2e0406ae90 0x7f2e0406d350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 --2- 172.21.15.107:0/3252535698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e240cb390 0x7f2e24158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 >> 172.21.15.107:0/3252535698 conn(0x7f2e24060f20 msgr2=0x7f2e24150410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 shutdown_connections 2023-12-16T01:26:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.309+0000 7f2e23fff640 1 -- 172.21.15.107:0/3252535698 wait complete. 2023-12-16T01:26:13.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-16T01:26:13.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.422+0000 7f46a2a7c640 1 Processor -- start 2023-12-16T01:26:13.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.422+0000 7f46a2a7c640 1 -- start start 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.423+0000 7f46a2a7c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f469c0c9dd0 0x7f469c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.423+0000 7f46a2a7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 0x7f469c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.423+0000 7f46a2a7c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c15cc90 con 0x7f469c06f590 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.423+0000 7f46a2a7c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c1596a0 con 0x7f469c0c9dd0 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.423+0000 7f46a2a7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c7c40 con 0x7f469c0ca1b0 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.424+0000 7f469bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 0x7f469c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.424+0000 7f46a0818640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f469c0c9dd0 0x7f469c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.424+0000 7f469bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 0x7f469c15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:41682/0 (socket says 172.21.15.107:41682) 2023-12-16T01:26:13.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.424+0000 7f469bfff640 1 -- 172.21.15.107:0/107789268 learned_addr learned my addr 172.21.15.107:0/107789268 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:13.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.427+0000 7f469bfff640 1 -- 172.21.15.107:0/107789268 >> v2:172.21.15.107:3300/0 conn(0x7f469c0c9dd0 msgr2=0x7f469c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:13.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.427+0000 7f469bfff640 1 --2- 172.21.15.107:0/107789268 >> v2:172.21.15.107:3300/0 conn(0x7f469c0c9dd0 0x7f469c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.427+0000 7f469bfff640 1 -- 172.21.15.107:0/107789268 >> v1:172.21.15.107:6789/0 conn(0x7f469c06f590 legacy=0x7f469c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:13.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.427+0000 7f469bfff640 1 -- 172.21.15.107:0/107789268 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c1598b0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.428+0000 7f469bfff640 1 --2- 172.21.15.107:0/107789268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 0x7f469c15d120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4690009870 tx=0x7f469002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ad6aef35d9e215 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.432+0000 7f469b7fe640 1 -- 172.21.15.107:0/107789268 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469002f840 con 0x7f469c0ca1b0 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.432+0000 7f469b7fe640 1 -- 172.21.15.107:0/107789268 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469002f9a0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.432+0000 7f469b7fe640 1 -- 172.21.15.107:0/107789268 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469002fd30 con 0x7f469c0ca1b0 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 -- 172.21.15.107:0/107789268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 msgr2=0x7f469c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/107789268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 0x7f469c15d120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4690009870 tx=0x7f469002ba20 comp rx=0 tx=0).stop 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 -- 172.21.15.107:0/107789268 shutdown_connections 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/107789268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c0ca1b0 0x7f469c15d120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/107789268 >> v2:172.21.15.107:3300/0 conn(0x7f469c0c9dd0 0x7f469c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 -- 172.21.15.107:0/107789268 >> 172.21.15.107:0/107789268 conn(0x7f469c061100 msgr2=0x7f469c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:13.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 -- 172.21.15.107:0/107789268 shutdown_connections 2023-12-16T01:26:13.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.433+0000 7f46a2a7c640 1 -- 172.21.15.107:0/107789268 wait complete. 2023-12-16T01:26:13.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.434+0000 7f46a2a7c640 1 Processor -- start 2023-12-16T01:26:13.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.434+0000 7f46a2a7c640 1 -- start start 2023-12-16T01:26:13.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a2a7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c06f590 0x7f469c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a2a7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c0c9dd0 0x7f469c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a2a7c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 0x7f469c1f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a2a7c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1560a0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a2a7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0cdb20 con 0x7f469c0c9dd0 2023-12-16T01:26:13.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a2a7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1eecd0 con 0x7f469c06f590 2023-12-16T01:26:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.435+0000 7f46a1019640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 0x7f469c1f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.436+0000 7f46a1019640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 0x7f469c1f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36182/0 (socket says 172.21.15.107:36182) 2023-12-16T01:26:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.436+0000 7f46a1019640 1 -- 172.21.15.107:0/4290312149 learned_addr learned my addr 172.21.15.107:0/4290312149 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.436+0000 7f46a0818640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c06f590 0x7f469c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.436+0000 7f469bfff640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c0c9dd0 0x7f469c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.439+0000 7f46a1019640 1 -- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c06f590 msgr2=0x7f469c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:13.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.439+0000 7f46a1019640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c06f590 0x7f469c0cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.439+0000 7f46a1019640 1 -- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c0c9dd0 msgr2=0x7f469c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:13.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.439+0000 7f46a1019640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c0c9dd0 0x7f469c070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:13.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.439+0000 7f46a1019640 1 -- 172.21.15.107:0/4290312149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46900094d0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.442+0000 7f46a1019640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 0x7f469c1f2260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f469400c7a0 tx=0x7f469400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.446+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694003b70 con 0x7f469c0ca1b0 2023-12-16T01:26:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.446+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694003cf0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.446+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400aa30 con 0x7f469c0ca1b0 2023-12-16T01:26:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.446+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c1efca0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.446+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c1eeee0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.447+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0740e0 con 0x7f469c0ca1b0 2023-12-16T01:26:13.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.688+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f469400ab90 con 0x7f469c0ca1b0 2023-12-16T01:26:13.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.688+0000 7f46997fa640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f468806ae40 0x7f468806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:13.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.688+0000 7f46a0818640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f468806ae40 0x7f468806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:13.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.688+0000 7f46a0818640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f468806ae40 0x7f468806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f468c009b40 tx=0x7f468c009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:13.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.701+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f469400ae40 con 0x7f469c0ca1b0 2023-12-16T01:26:13.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.701+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4694054f20 con 0x7f469c0ca1b0 2023-12-16T01:26:13.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:13.931+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f469c157ae0 con 0x7f469c0ca1b0 2023-12-16T01:26:14.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.990+0000 7f46997fa640 1 -- 172.21.15.107:0/4290312149 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4694059e60 con 0x7f469c0ca1b0 2023-12-16T01:26:14.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f468806ae40 msgr2=0x7f468806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:14.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f468806ae40 0x7f468806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f468c009b40 tx=0x7f468c009190 comp rx=0 tx=0).stop 2023-12-16T01:26:14.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 msgr2=0x7f469c1f2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 0x7f469c1f2260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f469400c7a0 tx=0x7f469400cc60 comp rx=0 tx=0).stop 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 shutdown_connections 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c0ca1b0 0x7f469c1f2260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f468806ae40 0x7f468806d300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c0c9dd0 0x7f469c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 --2- 172.21.15.107:0/4290312149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f469c06f590 0x7f469c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 >> 172.21.15.107:0/4290312149 conn(0x7f469c061100 msgr2=0x7f469c0c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 shutdown_connections 2023-12-16T01:26:14.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:14.992+0000 7f46a2a7c640 1 -- 172.21.15.107:0/4290312149 wait complete. 2023-12-16T01:26:15.005 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-12-16T01:26:15.005 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-16T01:26:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.108+0000 7f503a2e7640 1 Processor -- start 2023-12-16T01:26:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.108+0000 7f503a2e7640 1 -- start start 2023-12-16T01:26:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.108+0000 7f503a2e7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5034153c70 0x7f503415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.108+0000 7f503a2e7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415a700 con 0x7f5034153890 2023-12-16T01:26:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.108+0000 7f503a2e7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340ca870 con 0x7f50340ceef0 2023-12-16T01:26:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.108+0000 7f503a2e7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5034159af0 con 0x7f5034153c70 2023-12-16T01:26:15.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.109+0000 7f50337fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5034153c70 0x7f503415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:15.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.109+0000 7f5038884640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f50340ceef0 0x7f503415aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60946/0 (socket says 172.21.15.107:60946) 2023-12-16T01:26:15.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.109+0000 7f5038884640 1 -- 172.21.15.107:0/3265117690 learned_addr learned my addr 172.21.15.107:0/3265117690 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:15.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.111+0000 7f5032ffd640 1 -- 172.21.15.107:0/3265117690 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340916760 0 0) 0x7f50340ca870 con 0x7f50340ceef0 2023-12-16T01:26:15.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.111+0000 7f5032ffd640 1 -- 172.21.15.107:0/3265117690 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f501c003520 con 0x7f50340ceef0 2023-12-16T01:26:15.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.114+0000 7f50337fe640 1 -- 172.21.15.107:0/3265117690 >> v1:172.21.15.157:6789/0 conn(0x7f50340ceef0 legacy=0x7f503415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:15.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.114+0000 7f50337fe640 1 -- 172.21.15.107:0/3265117690 >> v1:172.21.15.107:6789/0 conn(0x7f5034153890 legacy=0x7f50340c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:15.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.114+0000 7f50337fe640 1 -- 172.21.15.107:0/3265117690 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034159dd0 con 0x7f5034153c70 2023-12-16T01:26:15.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.116+0000 7f50337fe640 1 --2- 172.21.15.107:0/3265117690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f503415d950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50280097a0 tx=0x7f502802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7091265ad0c9e7d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:15.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.120+0000 7f5032ffd640 1 -- 172.21.15.107:0/3265117690 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502802f810 con 0x7f5034153c70 2023-12-16T01:26:15.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.120+0000 7f5032ffd640 1 -- 172.21.15.107:0/3265117690 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502802f970 con 0x7f5034153c70 2023-12-16T01:26:15.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.120+0000 7f5032ffd640 1 -- 172.21.15.107:0/3265117690 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502802fd00 con 0x7f5034153c70 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 -- 172.21.15.107:0/3265117690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 msgr2=0x7f503415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 --2- 172.21.15.107:0/3265117690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f503415d950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50280097a0 tx=0x7f502802b9f0 comp rx=0 tx=0).stop 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 -- 172.21.15.107:0/3265117690 shutdown_connections 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 --2- 172.21.15.107:0/3265117690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f503415d950 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 -- 172.21.15.107:0/3265117690 >> 172.21.15.107:0/3265117690 conn(0x7f503406ba00 msgr2=0x7f503406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 -- 172.21.15.107:0/3265117690 shutdown_connections 2023-12-16T01:26:15.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.121+0000 7f503a2e7640 1 -- 172.21.15.107:0/3265117690 wait complete. 2023-12-16T01:26:15.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.122+0000 7f503a2e7640 1 Processor -- start 2023-12-16T01:26:15.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 -- start start 2023-12-16T01:26:15.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50340ceef0 0x7f5034149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5034153890 0x7f50340c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f5034152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c8310 con 0x7f5034153c70 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c7940 con 0x7f50340ceef0 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.123+0000 7f503a2e7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b4c70 con 0x7f5034153890 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.124+0000 7f5038884640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f5034152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.124+0000 7f50337fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5034153890 0x7f50340c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.124+0000 7f5038884640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f5034152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36210/0 (socket says 172.21.15.107:36210) 2023-12-16T01:26:15.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.124+0000 7f5038884640 1 -- 172.21.15.107:0/144885280 learned_addr learned my addr 172.21.15.107:0/144885280 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:15.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.124+0000 7f5033fff640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50340ceef0 0x7f5034149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:15.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.127+0000 7f5038884640 1 -- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5034153890 msgr2=0x7f50340c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:15.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.127+0000 7f5038884640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5034153890 0x7f50340c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:15.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.127+0000 7f5038884640 1 -- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50340ceef0 msgr2=0x7f5034149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:15.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.127+0000 7f5038884640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50340ceef0 0x7f5034149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:15.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.127+0000 7f5038884640 1 -- 172.21.15.107:0/144885280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028009400 con 0x7f5034153c70 2023-12-16T01:26:15.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.131+0000 7f5038884640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f5034152100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f502c00cb40 tx=0x7f502c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:15.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.133+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00aca0 con 0x7f5034153c70 2023-12-16T01:26:15.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.133+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00ae00 con 0x7f5034153c70 2023-12-16T01:26:15.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.133+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340b4f50 con 0x7f5034153c70 2023-12-16T01:26:15.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.133+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c012620 con 0x7f5034153c70 2023-12-16T01:26:15.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.133+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340c7cc0 con 0x7f5034153c70 2023-12-16T01:26:15.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.134+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340c84c0 con 0x7f5034153c70 2023-12-16T01:26:15.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.152+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f502c007070 con 0x7f5034153c70 2023-12-16T01:26:15.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.153+0000 7f5030ff9640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f502006ae90 0x7f502006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:15.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.153+0000 7f5033fff640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f502006ae90 0x7f502006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:15.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.153+0000 7f5033fff640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f502006ae90 0x7f502006d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5024000f60 tx=0x7f5024009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.387+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f502c058680 con 0x7f5034153c70 2023-12-16T01:26:15.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.387+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f502c0549c0 con 0x7f5034153c70 2023-12-16T01:26:15.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:15.588+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f50340c84c0 con 0x7f5034153c70 2023-12-16T01:26:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.003+0000 7f5030ff9640 1 -- 172.21.15.107:0/144885280 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50340c84c0 con 0x7f5034153c70 2023-12-16T01:26:16.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f502006ae90 msgr2=0x7f502006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f502006ae90 0x7f502006d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5024000f60 tx=0x7f5024009040 comp rx=0 tx=0).stop 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 msgr2=0x7f5034152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f5034152100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f502c00cb40 tx=0x7f502c00a060 comp rx=0 tx=0).stop 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 shutdown_connections 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5034153c70 0x7f5034152100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5034153890 0x7f50340c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f502006ae90 0x7f502006d350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 --2- 172.21.15.107:0/144885280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50340ceef0 0x7f5034149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.005+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 >> 172.21.15.107:0/144885280 conn(0x7f503406ba00 msgr2=0x7f503415c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.006+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 shutdown_connections 2023-12-16T01:26:16.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.006+0000 7f503a2e7640 1 -- 172.21.15.107:0/144885280 wait complete. 2023-12-16T01:26:16.018 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-16T01:26:16.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.122+0000 7fdb96116640 1 Processor -- start 2023-12-16T01:26:16.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.122+0000 7fdb96116640 1 -- start start 2023-12-16T01:26:16.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.123+0000 7fdb96116640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdb90153890 0x7fdb9015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:16.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.123+0000 7fdb96116640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb900ceef0 0x7fdb900cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:16.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.123+0000 7fdb96116640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9015a700 con 0x7fdb90153c70 2023-12-16T01:26:16.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.123+0000 7fdb96116640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb900ca870 con 0x7fdb90153890 2023-12-16T01:26:16.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.123+0000 7fdb96116640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb90159af0 con 0x7fdb900ceef0 2023-12-16T01:26:16.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.126+0000 7fdb8effd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdb90153c70 0x7fdb900c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60956/0 (socket says 172.21.15.107:60956) 2023-12-16T01:26:16.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.126+0000 7fdb8effd640 1 -- 172.21.15.107:0/3433805498 learned_addr learned my addr 172.21.15.107:0/3433805498 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:16.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.127+0000 7fdb8ffff640 1 --2- 172.21.15.107:0/3433805498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb900ceef0 0x7fdb900cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:16.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.130+0000 7fdb8f7fe640 1 --2- 172.21.15.107:0/3433805498 >> v2:172.21.15.107:3300/0 conn(0x7fdb90153890 0x7fdb9015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:16.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.133+0000 7fdb8f7fe640 1 -- 172.21.15.107:0/3433805498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb900ceef0 msgr2=0x7fdb900cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:16.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.133+0000 7fdb8f7fe640 1 --2- 172.21.15.107:0/3433805498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb900ceef0 0x7fdb900cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.133+0000 7fdb8f7fe640 1 -- 172.21.15.107:0/3433805498 >> v1:172.21.15.157:6789/0 conn(0x7fdb90153c70 legacy=0x7fdb900c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:16.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.133+0000 7fdb8f7fe640 1 -- 172.21.15.107:0/3433805498 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90159dd0 con 0x7fdb90153890 2023-12-16T01:26:16.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.137+0000 7fdb8f7fe640 1 --2- 172.21.15.107:0/3433805498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153890 0x7fdb9015d950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdb840097a0 tx=0x7fdb8402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2b5ae5fe11aa5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:16.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.143+0000 7fdb8e7fc640 1 -- 172.21.15.107:0/3433805498 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84030610 con 0x7fdb90153890 2023-12-16T01:26:16.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.143+0000 7fdb8e7fc640 1 -- 172.21.15.107:0/3433805498 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84030770 con 0x7fdb90153890 2023-12-16T01:26:16.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.143+0000 7fdb8e7fc640 1 -- 172.21.15.107:0/3433805498 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84030b00 con 0x7fdb90153890 2023-12-16T01:26:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 -- 172.21.15.107:0/3433805498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153890 msgr2=0x7fdb9015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 --2- 172.21.15.107:0/3433805498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153890 0x7fdb9015d950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdb840097a0 tx=0x7fdb8402b960 comp rx=0 tx=0).stop 2023-12-16T01:26:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 -- 172.21.15.107:0/3433805498 shutdown_connections 2023-12-16T01:26:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 --2- 172.21.15.107:0/3433805498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb900ceef0 0x7fdb900cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 --2- 172.21.15.107:0/3433805498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153890 0x7fdb9015d950 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 -- 172.21.15.107:0/3433805498 >> 172.21.15.107:0/3433805498 conn(0x7fdb9006ba00 msgr2=0x7fdb9006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 -- 172.21.15.107:0/3433805498 shutdown_connections 2023-12-16T01:26:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.144+0000 7fdb96116640 1 -- 172.21.15.107:0/3433805498 wait complete. 2023-12-16T01:26:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.145+0000 7fdb96116640 1 Processor -- start 2023-12-16T01:26:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.145+0000 7fdb96116640 1 -- start start 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.146+0000 7fdb96116640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb900ceef0 0x7fdb901eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.146+0000 7fdb96116640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb90153890 0x7fdb900c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.146+0000 7fdb96116640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 0x7fdb901f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.146+0000 7fdb96116640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb901f04a0 con 0x7fdb90153c70 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.146+0000 7fdb96116640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb90148750 con 0x7fdb900ceef0 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.146+0000 7fdb96116640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb900cce90 con 0x7fdb90153890 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.147+0000 7fdb8ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 0x7fdb901f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.147+0000 7fdb8effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb90153890 0x7fdb900c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.147+0000 7fdb8f7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb900ceef0 0x7fdb901eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.147+0000 7fdb8ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 0x7fdb901f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36228/0 (socket says 172.21.15.107:36228) 2023-12-16T01:26:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.147+0000 7fdb8ffff640 1 -- 172.21.15.107:0/2686088228 learned_addr learned my addr 172.21.15.107:0/2686088228 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:16.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.150+0000 7fdb8ffff640 1 -- 172.21.15.107:0/2686088228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb90153890 msgr2=0x7fdb900c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:16.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.150+0000 7fdb8ffff640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb90153890 0x7fdb900c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.150+0000 7fdb8ffff640 1 -- 172.21.15.107:0/2686088228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb900ceef0 msgr2=0x7fdb901eff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:16.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.150+0000 7fdb8ffff640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb900ceef0 0x7fdb901eff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:16.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.150+0000 7fdb8ffff640 1 -- 172.21.15.107:0/2686088228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb84009400 con 0x7fdb90153c70 2023-12-16T01:26:16.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.152+0000 7fdb8ffff640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 0x7fdb901f2a50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800efc0 tx=0x7fdb8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.156+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88014480 con 0x7fdb90153c70 2023-12-16T01:26:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.156+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8800f040 con 0x7fdb90153c70 2023-12-16T01:26:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.156+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb90148470 con 0x7fdb90153c70 2023-12-16T01:26:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.156+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88014820 con 0x7fdb90153c70 2023-12-16T01:26:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.156+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb900cd410 con 0x7fdb90153c70 2023-12-16T01:26:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.157+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9015aeb0 con 0x7fdb90153c70 2023-12-16T01:26:16.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.175+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fdb88014980 con 0x7fdb90153c70 2023-12-16T01:26:16.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.176+0000 7fdb77fff640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb7c06ae90 0x7fdb7c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:16.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.176+0000 7fdb8f7fe640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb7c06ae90 0x7fdb7c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:16.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.176+0000 7fdb8f7fe640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb7c06ae90 0x7fdb7c06d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb84036000 tx=0x7fdb84008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.178+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb88059610 con 0x7fdb90153c70 2023-12-16T01:26:16.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.410+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fdb88055950 con 0x7fdb90153c70 2023-12-16T01:26:16.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:16.617+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fdb9015aeb0 con 0x7fdb90153c70 2023-12-16T01:26:17.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.133+0000 7fdb77fff640 1 -- 172.21.15.107:0/2686088228 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7fdb9015aeb0 con 0x7fdb90153c70 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb7c06ae90 msgr2=0x7fdb7c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb7c06ae90 0x7fdb7c06d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb84036000 tx=0x7fdb84008030 comp rx=0 tx=0).stop 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 msgr2=0x7fdb901f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 0x7fdb901f2a50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800efc0 tx=0x7fdb8800c490 comp rx=0 tx=0).stop 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 shutdown_connections 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb90153c70 0x7fdb901f2a50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb90153890 0x7fdb900c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fdb7c06ae90 0x7fdb7c06d350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.135+0000 7fdb96116640 1 --2- 172.21.15.107:0/2686088228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb900ceef0 0x7fdb901eff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.136+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 >> 172.21.15.107:0/2686088228 conn(0x7fdb9006ba00 msgr2=0x7fdb90157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.136+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 shutdown_connections 2023-12-16T01:26:17.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.136+0000 7fdb96116640 1 -- 172.21.15.107:0/2686088228 wait complete. 2023-12-16T01:26:17.148 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-16T01:26:17.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:26:17.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.250+0000 7fd756fa5640 1 Processor -- start 2023-12-16T01:26:17.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.250+0000 7fd756fa5640 1 -- start start 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.251+0000 7fd756fa5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd75015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.251+0000 7fd756fa5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd750153c70 0x7fd7500c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.251+0000 7fd756fa5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd7500ceef0 0x7fd7500cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.251+0000 7fd756fa5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75015a700 con 0x7fd750153c70 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.251+0000 7fd756fa5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500ca870 con 0x7fd7500ceef0 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.251+0000 7fd756fa5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd750159af0 con 0x7fd750153890 2023-12-16T01:26:17.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.252+0000 7fd754d41640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd75015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.252+0000 7fd74ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd750153c70 0x7fd7500c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.252+0000 7fd754d41640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd75015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:41722/0 (socket says 172.21.15.107:41722) 2023-12-16T01:26:17.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.252+0000 7fd754d41640 1 -- 172.21.15.107:0/768088467 learned_addr learned my addr 172.21.15.107:0/768088467 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:17.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.253+0000 7fd755542640 1 --2- 172.21.15.107:0/768088467 >> v2:172.21.15.157:3300/0 conn(0x7fd7500ceef0 0x7fd7500cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.255+0000 7fd74ffff640 1 -- 172.21.15.107:0/768088467 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 msgr2=0x7fd75015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:17.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.255+0000 7fd74ffff640 1 --2- 172.21.15.107:0/768088467 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd75015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.255+0000 7fd74ffff640 1 -- 172.21.15.107:0/768088467 >> v2:172.21.15.157:3300/0 conn(0x7fd7500ceef0 msgr2=0x7fd7500cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:17.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.255+0000 7fd74ffff640 1 --2- 172.21.15.107:0/768088467 >> v2:172.21.15.157:3300/0 conn(0x7fd7500ceef0 0x7fd7500cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.255+0000 7fd74ffff640 1 -- 172.21.15.107:0/768088467 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750159dd0 con 0x7fd750153c70 2023-12-16T01:26:17.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.258+0000 7fd74ffff640 1 --2- 172.21.15.107:0/768088467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd750153c70 0x7fd7500c9fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd75006d6d0 tx=0x7fd73c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5dcbb4c65cef4f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:17.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd74f7fe640 1 -- 172.21.15.107:0/768088467 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c031830 con 0x7fd750153c70 2023-12-16T01:26:17.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd74f7fe640 1 -- 172.21.15.107:0/768088467 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c031990 con 0x7fd750153c70 2023-12-16T01:26:17.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd74f7fe640 1 -- 172.21.15.107:0/768088467 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c031d20 con 0x7fd750153c70 2023-12-16T01:26:17.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 -- 172.21.15.107:0/768088467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd750153c70 msgr2=0x7fd7500c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 --2- 172.21.15.107:0/768088467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd750153c70 0x7fd7500c9fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd75006d6d0 tx=0x7fd73c02b8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 -- 172.21.15.107:0/768088467 shutdown_connections 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 --2- 172.21.15.107:0/768088467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd750153c70 0x7fd7500c9fe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 --2- 172.21.15.107:0/768088467 >> v2:172.21.15.157:3300/0 conn(0x7fd7500ceef0 0x7fd7500cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 --2- 172.21.15.107:0/768088467 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd75015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 -- 172.21.15.107:0/768088467 >> 172.21.15.107:0/768088467 conn(0x7fd75006ba00 msgr2=0x7fd75006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 -- 172.21.15.107:0/768088467 shutdown_connections 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.263+0000 7fd756fa5640 1 -- 172.21.15.107:0/768088467 wait complete. 2023-12-16T01:26:17.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.264+0000 7fd756fa5640 1 Processor -- start 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 -- start start 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 0x7fd7501efef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd7500c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd750153c70 0x7fd7500ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7501f0430 con 0x7fd7500ceef0 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750158a00 con 0x7fd750153c70 2023-12-16T01:26:17.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.265+0000 7fd756fa5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd750152100 con 0x7fd750153890 2023-12-16T01:26:17.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.266+0000 7fd754d41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 0x7fd7501efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.266+0000 7fd74ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd7500c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.266+0000 7fd755542640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd750153c70 0x7fd7500ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.266+0000 7fd754d41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 0x7fd7501efef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36254/0 (socket says 172.21.15.107:36254) 2023-12-16T01:26:17.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.266+0000 7fd754d41640 1 -- 172.21.15.107:0/103491992 learned_addr learned my addr 172.21.15.107:0/103491992 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:17.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd754d41640 1 -- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 msgr2=0x7fd7500c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd754d41640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd7500c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd754d41640 1 -- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd750153c70 msgr2=0x7fd7500ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd754d41640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd750153c70 0x7fd7500ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd754d41640 1 -- 172.21.15.107:0/103491992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c009400 con 0x7fd7500ceef0 2023-12-16T01:26:17.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd755542640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd750153c70 0x7fd7500ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:17.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.269+0000 7fd74ffff640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd7500c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:17.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.272+0000 7fd754d41640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 0x7fd7501efef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd744009fd0 tx=0x7fd74400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:17.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.275+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400c940 con 0x7fd7500ceef0 2023-12-16T01:26:17.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.275+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74400caa0 con 0x7fd7500ceef0 2023-12-16T01:26:17.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.275+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400ce30 con 0x7fd7500ceef0 2023-12-16T01:26:17.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.275+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7500c6ff0 con 0x7fd7500ceef0 2023-12-16T01:26:17.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.275+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd750152680 con 0x7fd7500ceef0 2023-12-16T01:26:17.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.276+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd750067500 con 0x7fd7500ceef0 2023-12-16T01:26:17.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.517+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd744013470 con 0x7fd7500ceef0 2023-12-16T01:26:17.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.517+0000 7fd74d7fa640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd73406aec0 0x7fd73406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.517+0000 7fd74ffff640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd73406aec0 0x7fd73406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.518+0000 7fd74ffff640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd73406aec0 0x7fd73406d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd73c036000 tx=0x7fd73c03c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:17.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.537+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd744058cf0 con 0x7fd7500ceef0 2023-12-16T01:26:17.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.537+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd744055030 con 0x7fd7500ceef0 2023-12-16T01:26:17.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.747+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7501571c0 con 0x7fd7500ceef0 2023-12-16T01:26:17.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.759+0000 7fd74d7fa640 1 -- 172.21.15.107:0/103491992 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6532 (secure 0 0 0) 0x7fd744021020 con 0x7fd7500ceef0 2023-12-16T01:26:17.760 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:17.760 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:26:16.623444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T01:26:17.761 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2023-12-16T01:26:17.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd73406aec0 msgr2=0x7fd73406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd73406aec0 0x7fd73406d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd73c036000 tx=0x7fd73c03c040 comp rx=0 tx=0).stop 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 msgr2=0x7fd7501efef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 0x7fd7501efef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd744009fd0 tx=0x7fd74400ed40 comp rx=0 tx=0).stop 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 shutdown_connections 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd73406aec0 0x7fd73406d380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd750153c70 0x7fd7500ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd750153890 0x7fd7500c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 --2- 172.21.15.107:0/103491992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7500ceef0 0x7fd7501efef0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.761+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 >> 172.21.15.107:0/103491992 conn(0x7fd75006ba00 msgr2=0x7fd75015b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.762+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 shutdown_connections 2023-12-16T01:26:17.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.762+0000 7fd756fa5640 1 -- 172.21.15.107:0/103491992 wait complete. 2023-12-16T01:26:17.774 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:17.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.874+0000 7f8c6cf61640 1 Processor -- start 2023-12-16T01:26:17.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.874+0000 7f8c6cf61640 1 -- start start 2023-12-16T01:26:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.875+0000 7f8c6cf61640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c68151720 0x7f8c6806b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.875+0000 7f8c6cf61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c6815af60 0x7f8c6815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.875+0000 7f8c6cf61640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c68151b00 con 0x7f8c680c68f0 2023-12-16T01:26:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.875+0000 7f8c6cf61640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c681582b0 con 0x7f8c68151720 2023-12-16T01:26:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.875+0000 7f8c6cf61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68157730 con 0x7f8c6815af60 2023-12-16T01:26:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.876+0000 7f8c6659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c68151720 0x7f8c6806b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.876+0000 7f8c66d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c6815af60 0x7f8c6815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.876+0000 7f8c6659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c68151720 0x7f8c6806b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36264/0 (socket says 172.21.15.107:36264) 2023-12-16T01:26:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.876+0000 7f8c6659c640 1 -- 172.21.15.107:0/1789098880 learned_addr learned my addr 172.21.15.107:0/1789098880 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.878+0000 7f8c6659c640 1 -- 172.21.15.107:0/1789098880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c6815af60 msgr2=0x7f8c6815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.878+0000 7f8c6659c640 1 --2- 172.21.15.107:0/1789098880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c6815af60 0x7f8c6815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.878+0000 7f8c6659c640 1 -- 172.21.15.107:0/1789098880 >> v1:172.21.15.157:6789/0 conn(0x7f8c680c68f0 legacy=0x7f8c6806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.878+0000 7f8c6659c640 1 -- 172.21.15.107:0/1789098880 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68157a10 con 0x7f8c68151720 2023-12-16T01:26:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.881+0000 7f8c6659c640 1 --2- 172.21.15.107:0/1789098880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68151720 0x7f8c6806b840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009870 tx=0x7f8c6002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb201eafa7000e13 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.884+0000 7f8c6559a640 1 -- 172.21.15.107:0/1789098880 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60031640 con 0x7f8c68151720 2023-12-16T01:26:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.884+0000 7f8c6559a640 1 -- 172.21.15.107:0/1789098880 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c600317a0 con 0x7f8c68151720 2023-12-16T01:26:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.884+0000 7f8c6559a640 1 -- 172.21.15.107:0/1789098880 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60031b30 con 0x7f8c68151720 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 -- 172.21.15.107:0/1789098880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68151720 msgr2=0x7f8c6806b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/1789098880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68151720 0x7f8c6806b840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009870 tx=0x7f8c6002b8f0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 -- 172.21.15.107:0/1789098880 shutdown_connections 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/1789098880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c6815af60 0x7f8c6815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/1789098880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68151720 0x7f8c6806b840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 -- 172.21.15.107:0/1789098880 >> 172.21.15.107:0/1789098880 conn(0x7f8c680cbef0 msgr2=0x7f8c680cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 -- 172.21.15.107:0/1789098880 shutdown_connections 2023-12-16T01:26:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.885+0000 7f8c6cf61640 1 -- 172.21.15.107:0/1789098880 wait complete. 2023-12-16T01:26:17.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.887+0000 7f8c6cf61640 1 Processor -- start 2023-12-16T01:26:17.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.887+0000 7f8c6cf61640 1 -- start start 2023-12-16T01:26:17.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.887+0000 7f8c6cf61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 0x7f8c680c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.887+0000 7f8c6cf61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c68151720 0x7f8c680c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.887+0000 7f8c6cf61640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6815af60 0x7f8c680c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.887+0000 7f8c6cf61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681ed3e0 con 0x7f8c680c68f0 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.888+0000 7f8c6cf61640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681ed910 con 0x7f8c6815af60 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.888+0000 7f8c6cf61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681ed630 con 0x7f8c68151720 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.888+0000 7f8c6659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 0x7f8c680c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.888+0000 7f8c6659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 0x7f8c680c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36278/0 (socket says 172.21.15.107:36278) 2023-12-16T01:26:17.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.888+0000 7f8c6659c640 1 -- 172.21.15.107:0/2325077496 learned_addr learned my addr 172.21.15.107:0/2325077496 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:17.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.888+0000 7f8c65d9b640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c68151720 0x7f8c680c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.891+0000 7f8c6659c640 1 -- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c68151720 msgr2=0x7f8c680c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.891+0000 7f8c6659c640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c68151720 0x7f8c680c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.891+0000 7f8c6659c640 1 -- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6815af60 msgr2=0x7f8c680c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.891+0000 7f8c6659c640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6815af60 0x7f8c680c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:17.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.892+0000 7f8c6659c640 1 -- 172.21.15.107:0/2325077496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600094d0 con 0x7f8c680c68f0 2023-12-16T01:26:17.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.894+0000 7f8c6659c640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 0x7f8c680c8880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009990 tx=0x7f8c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.897+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6003a9f0 con 0x7f8c680c68f0 2023-12-16T01:26:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.897+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6003ab90 con 0x7f8c680c68f0 2023-12-16T01:26:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.897+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600443f0 con 0x7f8c680c68f0 2023-12-16T01:26:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.897+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c680c3fe0 con 0x7f8c680c68f0 2023-12-16T01:26:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.897+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6806c1b0 con 0x7f8c680c68f0 2023-12-16T01:26:17.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:17.898+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c680cce50 con 0x7f8c680c68f0 2023-12-16T01:26:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.152+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8c6002f050 con 0x7f8c680c68f0 2023-12-16T01:26:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.152+0000 7f8c56ffd640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8c4806ae90 0x7f8c4806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.152+0000 7f8c65d9b640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8c4806ae90 0x7f8c4806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.153+0000 7f8c65d9b640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8c4806ae90 0x7f8c4806d350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c68155240 tx=0x7f8c5c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:18.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.165+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c6007af00 con 0x7f8c680c68f0 2023-12-16T01:26:18.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.165+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8c60076b40 con 0x7f8c680c68f0 2023-12-16T01:26:18.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.345+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c680c36f0 con 0x7f8c680c68f0 2023-12-16T01:26:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.382+0000 7f8c56ffd640 1 -- 172.21.15.107:0/2325077496 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f8c6007a160 con 0x7f8c680c68f0 2023-12-16T01:26:18.383 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:18.383 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8c4806ae90 msgr2=0x7f8c4806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8c4806ae90 0x7f8c4806d350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c68155240 tx=0x7f8c5c009040 comp rx=0 tx=0).stop 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 msgr2=0x7f8c680c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 0x7f8c680c8880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009990 tx=0x7f8c600046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 shutdown_connections 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8c4806ae90 0x7f8c4806d350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6815af60 0x7f8c680c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8c68151720 0x7f8c680c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 --2- 172.21.15.107:0/2325077496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c68f0 0x7f8c680c8880 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 >> 172.21.15.107:0/2325077496 conn(0x7f8c680cbef0 msgr2=0x7f8c681505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 shutdown_connections 2023-12-16T01:26:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.384+0000 7f8c6cf61640 1 -- 172.21.15.107:0/2325077496 wait complete. 2023-12-16T01:26:18.396 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T01:26:18.396 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:26:18.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.496+0000 7f3cf3db0640 1 Processor -- start 2023-12-16T01:26:18.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.496+0000 7f3cf3db0640 1 -- start start 2023-12-16T01:26:18.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.497+0000 7f3cf3db0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3cec1537e0 0x7f3cec0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.497+0000 7f3cf3db0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.497+0000 7f3cf3db0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec06f870 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.497+0000 7f3cf3db0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec159600 con 0x7f3cec1537e0 2023-12-16T01:26:18.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.497+0000 7f3cf3db0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec15cd90 con 0x7f3cec0c7700 2023-12-16T01:26:18.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.498+0000 7f3cf1b4c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3cec1537e0 0x7f3cec0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.498+0000 7f3cf134b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.498+0000 7f3cf234d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3cec0ca0c0 0x7f3cec159a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60974/0 (socket says 172.21.15.107:60974) 2023-12-16T01:26:18.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.498+0000 7f3cf234d640 1 -- 172.21.15.107:0/3875639709 learned_addr learned my addr 172.21.15.107:0/3875639709 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:18.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.500+0000 7f3cf1b4c640 1 -- 172.21.15.107:0/3875639709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 msgr2=0x7f3cec0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:18.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.500+0000 7f3cf1b4c640 1 --2- 172.21.15.107:0/3875639709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.500+0000 7f3cf1b4c640 1 -- 172.21.15.107:0/3875639709 >> v1:172.21.15.157:6789/0 conn(0x7f3cec0ca0c0 legacy=0x7f3cec159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.500+0000 7f3cf1b4c640 1 -- 172.21.15.107:0/3875639709 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec15d070 con 0x7f3cec1537e0 2023-12-16T01:26:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.503+0000 7f3cf1b4c640 1 --2- 172.21.15.107:0/3875639709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec1537e0 0x7f3cec0cd6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009d90 tx=0x7f3ce402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d54cf94c0f67d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:18.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.506+0000 7f3cf0b4a640 1 -- 172.21.15.107:0/3875639709 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce402cce0 con 0x7f3cec1537e0 2023-12-16T01:26:18.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.506+0000 7f3cf0b4a640 1 -- 172.21.15.107:0/3875639709 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce402ce40 con 0x7f3cec1537e0 2023-12-16T01:26:18.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.506+0000 7f3cf0b4a640 1 -- 172.21.15.107:0/3875639709 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4034660 con 0x7f3cec1537e0 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3875639709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec1537e0 msgr2=0x7f3cec0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3875639709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec1537e0 0x7f3cec0cd6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009d90 tx=0x7f3ce402bf30 comp rx=0 tx=0).stop 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3875639709 shutdown_connections 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3875639709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3875639709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec1537e0 0x7f3cec0cd6a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3875639709 >> 172.21.15.107:0/3875639709 conn(0x7f3cec061100 msgr2=0x7f3cec0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3875639709 shutdown_connections 2023-12-16T01:26:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.507+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3875639709 wait complete. 2023-12-16T01:26:18.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.508+0000 7f3cf3db0640 1 Processor -- start 2023-12-16T01:26:18.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.508+0000 7f3cf3db0640 1 -- start start 2023-12-16T01:26:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf3db0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf3db0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 0x7f3cec1f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf3db0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cec1537e0 0x7f3cec1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf3db0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec1f1320 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf3db0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec156f80 con 0x7f3cec1537e0 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf3db0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0cc9e0 con 0x7f3cec0c7700 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.509+0000 7f3cf134b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 0x7f3cec1f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.510+0000 7f3cf1b4c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.510+0000 7f3cf234d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cec1537e0 0x7f3cec1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.510+0000 7f3cf134b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 0x7f3cec1f1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36304/0 (socket says 172.21.15.107:36304) 2023-12-16T01:26:18.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.510+0000 7f3cf134b640 1 -- 172.21.15.107:0/3788147960 learned_addr learned my addr 172.21.15.107:0/3788147960 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:18.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.513+0000 7f3cf134b640 1 -- 172.21.15.107:0/3788147960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 msgr2=0x7f3cec156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.513+0000 7f3cf134b640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.513+0000 7f3cf134b640 1 -- 172.21.15.107:0/3788147960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cec1537e0 msgr2=0x7f3cec1f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.513+0000 7f3cf134b640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cec1537e0 0x7f3cec1f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.513+0000 7f3cf134b640 1 -- 172.21.15.107:0/3788147960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009a70 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.515+0000 7f3cf134b640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 0x7f3cec1f1740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e8a0 tx=0x7f3cdc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:18.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.518+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0094f0 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.518+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00c940 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.518+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00ccf0 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.518+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec14e790 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.519+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec1f3130 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.519+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec1f1590 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.538+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3cdc013470 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.539+0000 7f3ce27fc640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3cd006ae90 0x7f3cd006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:18.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.539+0000 7f3cf1b4c640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3cd006ae90 0x7f3cd006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:18.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.539+0000 7f3cf1b4c640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3cd006ae90 0x7f3cd006d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4036000 tx=0x7f3ce4030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:18.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.775+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3cdc058c20 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.775+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3cdc054f60 con 0x7f3cec0ca0c0 2023-12-16T01:26:18.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.942+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cec061a80 con 0x7f3cd006ae90 2023-12-16T01:26:18.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.950+0000 7f3ce27fc640 1 -- 172.21.15.107:0/3788147960 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345323 (secure 0 0 0) 0x7f3cec061a80 con 0x7f3cd006ae90 2023-12-16T01:26:18.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:18.958 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:26:18.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3cd006ae90 msgr2=0x7f3cd006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3cd006ae90 0x7f3cd006d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4036000 tx=0x7f3ce4030000 comp rx=0 tx=0).stop 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 msgr2=0x7f3cec1f1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 0x7f3cec1f1740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e8a0 tx=0x7f3cdc00ed60 comp rx=0 tx=0).stop 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 shutdown_connections 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3cd006ae90 0x7f3cd006d350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cec1537e0 0x7f3cec1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cec0ca0c0 0x7f3cec1f1740 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 --2- 172.21.15.107:0/3788147960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cec0c7700 0x7f3cec156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 >> 172.21.15.107:0/3788147960 conn(0x7f3cec061100 msgr2=0x7f3cec1520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 shutdown_connections 2023-12-16T01:26:18.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:18.954+0000 7f3cf3db0640 1 -- 172.21.15.107:0/3788147960 wait complete. 2023-12-16T01:26:18.966 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-12-16T01:26:17.718131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235144,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739576,"statfs":{"total":773094113280,"available":772853325824,"internally_reserved":0,"allocated":2392064,"data_stored":2050444,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002617"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956050+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:25:54.956050+0000","last_peered":"2023-12-16T01:25:54.956050+0000","last_clean":"2023-12-16T01:25:54.956050+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:25:54.956050+0000","last_undegraded":"2023-12-16T01:25:54.956050+0000","last_fullsized":"2023-12-16T01:25:54.956050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976062+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:25:54.976062+0000","last_peered":"2023-12-16T01:25:54.976062+0000","last_clean":"2023-12-16T01:25:54.976062+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:25:54.976062+0000","last_undegraded":"2023-12-16T01:25:54.976062+0000","last_fullsized":"2023-12-16T01:25:54.976062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579762+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:25:57.579762+0000","last_peered":"2023-12-16T01:25:57.579762+0000","last_clean":"2023-12-16T01:25:57.579762+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:25:57.579762+0000","last_undegraded":"2023-12-16T01:25:57.579762+0000","last_fullsized":"2023-12-16T01:25:57.579762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976137+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:25:54.976137+0000","last_peered":"2023-12-16T01:25:54.976137+0000","last_clean":"2023-12-16T01:25:54.976137+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:25:54.976137+0000","last_undegraded":"2023-12-16T01:25:54.976137+0000","last_fullsized":"2023-12-16T01:25:54.976137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976018+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:25:54.976018+0000","last_peered":"2023-12-16T01:25:54.976018+0000","last_clean":"2023-12-16T01:25:54.976018+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:25:54.976018+0000","last_undegraded":"2023-12-16T01:25:54.976018+0000","last_fullsized":"2023-12-16T01:25:54.976018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.577950+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:25:57.577950+0000","last_peered":"2023-12-16T01:25:57.577950+0000","last_clean":"2023-12-16T01:25:57.577950+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:25:57.577950+0000","last_undegraded":"2023-12-16T01:25:57.577950+0000","last_fullsized":"2023-12-16T01:25:57.577950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977537+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:25:54.977537+0000","last_peered":"2023-12-16T01:25:54.977537+0000","last_clean":"2023-12-16T01:25:54.977537+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:25:54.977537+0000","last_undegraded":"2023-12-16T01:25:54.977537+0000","last_fullsized":"2023-12-16T01:25:54.977537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976272+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:25:54.976272+0000","last_peered":"2023-12-16T01:25:54.976272+0000","last_clean":"2023-12-16T01:25:54.976272+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:25:54.976272+0000","last_undegraded":"2023-12-16T01:25:54.976272+0000","last_fullsized":"2023-12-16T01:25:54.976272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578559+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:25:57.578559+0000","last_peered":"2023-12-16T01:25:57.578559+0000","last_clean":"2023-12-16T01:25:57.578559+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:25:57.578559+0000","last_undegraded":"2023-12-16T01:25:57.578559+0000","last_fullsized":"2023-12-16T01:25:57.578559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982296+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:25:54.982296+0000","last_peered":"2023-12-16T01:25:54.982296+0000","last_clean":"2023-12-16T01:25:54.982296+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:25:54.982296+0000","last_undegraded":"2023-12-16T01:25:54.982296+0000","last_fullsized":"2023-12-16T01:25:54.982296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976753+0000","last_change":"2023-12-16T01:25:49.153869+0000","last_active":"2023-12-16T01:25:54.976753+0000","last_peered":"2023-12-16T01:25:54.976753+0000","last_clean":"2023-12-16T01:25:54.976753+0000","last_became_active":"2023-12-16T01:25:49.153613+0000","last_became_peered":"2023-12-16T01:25:49.153613+0000","last_unstale":"2023-12-16T01:25:54.976753+0000","last_undegraded":"2023-12-16T01:25:54.976753+0000","last_fullsized":"2023-12-16T01:25:54.976753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:05.868096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578151+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:25:57.578151+0000","last_peered":"2023-12-16T01:25:57.578151+0000","last_clean":"2023-12-16T01:25:57.578151+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:25:57.578151+0000","last_undegraded":"2023-12-16T01:25:57.578151+0000","last_fullsized":"2023-12-16T01:25:57.578151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980257+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:25:54.980257+0000","last_peered":"2023-12-16T01:25:54.980257+0000","last_clean":"2023-12-16T01:25:54.980257+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:25:54.980257+0000","last_undegraded":"2023-12-16T01:25:54.980257+0000","last_fullsized":"2023-12-16T01:25:54.980257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977097+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:25:54.977097+0000","last_peered":"2023-12-16T01:25:54.977097+0000","last_clean":"2023-12-16T01:25:54.977097+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:25:54.977097+0000","last_undegraded":"2023-12-16T01:25:54.977097+0000","last_fullsized":"2023-12-16T01:25:54.977097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026894+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:25:56.026894+0000","last_peered":"2023-12-16T01:25:56.026894+0000","last_clean":"2023-12-16T01:25:56.026894+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:25:56.026894+0000","last_undegraded":"2023-12-16T01:25:56.026894+0000","last_fullsized":"2023-12-16T01:25:56.026894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951884+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:25:54.951884+0000","last_peered":"2023-12-16T01:25:54.951884+0000","last_clean":"2023-12-16T01:25:54.951884+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:25:54.951884+0000","last_undegraded":"2023-12-16T01:25:54.951884+0000","last_fullsized":"2023-12-16T01:25:54.951884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970306+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:25:54.970306+0000","last_peered":"2023-12-16T01:25:54.970306+0000","last_clean":"2023-12-16T01:25:54.970306+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:25:54.970306+0000","last_undegraded":"2023-12-16T01:25:54.970306+0000","last_fullsized":"2023-12-16T01:25:54.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.351491+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:25:56.351491+0000","last_peered":"2023-12-16T01:25:56.351491+0000","last_clean":"2023-12-16T01:25:56.351491+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:25:56.351491+0000","last_undegraded":"2023-12-16T01:25:56.351491+0000","last_fullsized":"2023-12-16T01:25:56.351491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955406+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:25:54.955406+0000","last_peered":"2023-12-16T01:25:54.955406+0000","last_clean":"2023-12-16T01:25:54.955406+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:25:54.955406+0000","last_undegraded":"2023-12-16T01:25:54.955406+0000","last_fullsized":"2023-12-16T01:25:54.955406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956170+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:25:54.956170+0000","last_peered":"2023-12-16T01:25:54.956170+0000","last_clean":"2023-12-16T01:25:54.956170+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:25:54.956170+0000","last_undegraded":"2023-12-16T01:25:54.956170+0000","last_fullsized":"2023-12-16T01:25:54.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578850+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:25:57.578850+0000","last_peered":"2023-12-16T01:25:57.578850+0000","last_clean":"2023-12-16T01:25:57.578850+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:25:57.578850+0000","last_undegraded":"2023-12-16T01:25:57.578850+0000","last_fullsized":"2023-12-16T01:25:57.578850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977333+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:25:54.977333+0000","last_peered":"2023-12-16T01:25:54.977333+0000","last_clean":"2023-12-16T01:25:54.977333+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:25:54.977333+0000","last_undegraded":"2023-12-16T01:25:54.977333+0000","last_fullsized":"2023-12-16T01:25:54.977333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977386+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:25:54.977386+0000","last_peered":"2023-12-16T01:25:54.977386+0000","last_clean":"2023-12-16T01:25:54.977386+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:25:54.977386+0000","last_undegraded":"2023-12-16T01:25:54.977386+0000","last_fullsized":"2023-12-16T01:25:54.977386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578376+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:25:57.578376+0000","last_peered":"2023-12-16T01:25:57.578376+0000","last_clean":"2023-12-16T01:25:57.578376+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:25:57.578376+0000","last_undegraded":"2023-12-16T01:25:57.578376+0000","last_fullsized":"2023-12-16T01:25:57.578376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955709+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:25:54.955709+0000","last_peered":"2023-12-16T01:25:54.955709+0000","last_clean":"2023-12-16T01:25:54.955709+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:25:54.955709+0000","last_undegraded":"2023-12-16T01:25:54.955709+0000","last_fullsized":"2023-12-16T01:25:54.955709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977705+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:25:54.977705+0000","last_peered":"2023-12-16T01:25:54.977705+0000","last_clean":"2023-12-16T01:25:54.977705+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:25:54.977705+0000","last_undegraded":"2023-12-16T01:25:54.977705+0000","last_fullsized":"2023-12-16T01:25:54.977705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578057+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:25:57.578057+0000","last_peered":"2023-12-16T01:25:57.578057+0000","last_clean":"2023-12-16T01:25:57.578057+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:25:57.578057+0000","last_undegraded":"2023-12-16T01:25:57.578057+0000","last_fullsized":"2023-12-16T01:25:57.578057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955950+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:25:54.955950+0000","last_peered":"2023-12-16T01:25:54.955950+0000","last_clean":"2023-12-16T01:25:54.955950+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:25:54.955950+0000","last_undegraded":"2023-12-16T01:25:54.955950+0000","last_fullsized":"2023-12-16T01:25:54.955950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955800+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:25:54.955800+0000","last_peered":"2023-12-16T01:25:54.955800+0000","last_clean":"2023-12-16T01:25:54.955800+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:25:54.955800+0000","last_undegraded":"2023-12-16T01:25:54.955800+0000","last_fullsized":"2023-12-16T01:25:54.955800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.021931+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:25:56.021931+0000","last_peered":"2023-12-16T01:25:56.021931+0000","last_clean":"2023-12-16T01:25:56.021931+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:25:56.021931+0000","last_undegraded":"2023-12-16T01:25:56.021931+0000","last_fullsized":"2023-12-16T01:25:56.021931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970664+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:25:54.970664+0000","last_peered":"2023-12-16T01:25:54.970664+0000","last_clean":"2023-12-16T01:25:54.970664+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:25:54.970664+0000","last_undegraded":"2023-12-16T01:25:54.970664+0000","last_fullsized":"2023-12-16T01:25:54.970664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976974+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:25:54.976974+0000","last_peered":"2023-12-16T01:25:54.976974+0000","last_clean":"2023-12-16T01:25:54.976974+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:25:54.976974+0000","last_undegraded":"2023-12-16T01:25:54.976974+0000","last_fullsized":"2023-12-16T01:25:54.976974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579763+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:25:57.579763+0000","last_peered":"2023-12-16T01:25:57.579763+0000","last_clean":"2023-12-16T01:25:57.579763+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:25:57.579763+0000","last_undegraded":"2023-12-16T01:25:57.579763+0000","last_fullsized":"2023-12-16T01:25:57.579763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892101+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:25:54.892101+0000","last_peered":"2023-12-16T01:25:54.892101+0000","last_clean":"2023-12-16T01:25:54.892101+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:25:54.892101+0000","last_undegraded":"2023-12-16T01:25:54.892101+0000","last_fullsized":"2023-12-16T01:25:54.892101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975270+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:25:54.975270+0000","last_peered":"2023-12-16T01:25:54.975270+0000","last_clean":"2023-12-16T01:25:54.975270+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:25:54.975270+0000","last_undegraded":"2023-12-16T01:25:54.975270+0000","last_fullsized":"2023-12-16T01:25:54.975270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578675+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:25:57.578675+0000","last_peered":"2023-12-16T01:25:57.578675+0000","last_clean":"2023-12-16T01:25:57.578675+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:25:57.578675+0000","last_undegraded":"2023-12-16T01:25:57.578675+0000","last_fullsized":"2023-12-16T01:25:57.578675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980017+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:25:54.980017+0000","last_peered":"2023-12-16T01:25:54.980017+0000","last_clean":"2023-12-16T01:25:54.980017+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:25:54.980017+0000","last_undegraded":"2023-12-16T01:25:54.980017+0000","last_fullsized":"2023-12-16T01:25:54.980017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980559+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:25:54.980559+0000","last_peered":"2023-12-16T01:25:54.980559+0000","last_clean":"2023-12-16T01:25:54.980559+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:25:54.980559+0000","last_undegraded":"2023-12-16T01:25:54.980559+0000","last_fullsized":"2023-12-16T01:25:54.980559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579261+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:25:57.579261+0000","last_peered":"2023-12-16T01:25:57.579261+0000","last_clean":"2023-12-16T01:25:57.579261+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:25:57.579261+0000","last_undegraded":"2023-12-16T01:25:57.579261+0000","last_fullsized":"2023-12-16T01:25:57.579261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970408+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:25:54.970408+0000","last_peered":"2023-12-16T01:25:54.970408+0000","last_clean":"2023-12-16T01:25:54.970408+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:25:54.970408+0000","last_undegraded":"2023-12-16T01:25:54.970408+0000","last_fullsized":"2023-12-16T01:25:54.970408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951593+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:25:54.951593+0000","last_peered":"2023-12-16T01:25:54.951593+0000","last_clean":"2023-12-16T01:25:54.951593+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:25:54.951593+0000","last_undegraded":"2023-12-16T01:25:54.951593+0000","last_fullsized":"2023-12-16T01:25:54.951593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579088+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:25:57.579088+0000","last_peered":"2023-12-16T01:25:57.579088+0000","last_clean":"2023-12-16T01:25:57.579088+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:25:57.579088+0000","last_undegraded":"2023-12-16T01:25:57.579088+0000","last_fullsized":"2023-12-16T01:25:57.579088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.969719+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:25:54.969719+0000","last_peered":"2023-12-16T01:25:54.969719+0000","last_clean":"2023-12-16T01:25:54.969719+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:25:54.969719+0000","last_undegraded":"2023-12-16T01:25:54.969719+0000","last_fullsized":"2023-12-16T01:25:54.969719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979749+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:25:54.979749+0000","last_peered":"2023-12-16T01:25:54.979749+0000","last_clean":"2023-12-16T01:25:54.979749+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:25:54.979749+0000","last_undegraded":"2023-12-16T01:25:54.979749+0000","last_fullsized":"2023-12-16T01:25:54.979749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578972+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:25:57.578972+0000","last_peered":"2023-12-16T01:25:57.578972+0000","last_clean":"2023-12-16T01:25:57.578972+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:25:57.578972+0000","last_undegraded":"2023-12-16T01:25:57.578972+0000","last_fullsized":"2023-12-16T01:25:57.578972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956071+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:25:54.956071+0000","last_peered":"2023-12-16T01:25:54.956071+0000","last_clean":"2023-12-16T01:25:54.956071+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:25:54.956071+0000","last_undegraded":"2023-12-16T01:25:54.956071+0000","last_fullsized":"2023-12-16T01:25:54.956071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977169+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:25:54.977169+0000","last_peered":"2023-12-16T01:25:54.977169+0000","last_clean":"2023-12-16T01:25:54.977169+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:25:54.977169+0000","last_undegraded":"2023-12-16T01:25:54.977169+0000","last_fullsized":"2023-12-16T01:25:54.977169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972956+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:25:54.972956+0000","last_peered":"2023-12-16T01:25:54.972956+0000","last_clean":"2023-12-16T01:25:54.972956+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:25:54.972956+0000","last_undegraded":"2023-12-16T01:25:54.972956+0000","last_fullsized":"2023-12-16T01:25:54.972956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027129+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:25:56.027129+0000","last_peered":"2023-12-16T01:25:56.027129+0000","last_clean":"2023-12-16T01:25:56.027129+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:25:56.027129+0000","last_undegraded":"2023-12-16T01:25:56.027129+0000","last_fullsized":"2023-12-16T01:25:56.027129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976823+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:25:54.976823+0000","last_peered":"2023-12-16T01:25:54.976823+0000","last_clean":"2023-12-16T01:25:54.976823+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:25:54.976823+0000","last_undegraded":"2023-12-16T01:25:54.976823+0000","last_fullsized":"2023-12-16T01:25:54.976823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970729+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:25:54.970729+0000","last_peered":"2023-12-16T01:25:54.970729+0000","last_clean":"2023-12-16T01:25:54.970729+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:25:54.970729+0000","last_undegraded":"2023-12-16T01:25:54.970729+0000","last_fullsized":"2023-12-16T01:25:54.970729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578266+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:25:57.578266+0000","last_peered":"2023-12-16T01:25:57.578266+0000","last_clean":"2023-12-16T01:25:57.578266+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:25:57.578266+0000","last_undegraded":"2023-12-16T01:25:57.578266+0000","last_fullsized":"2023-12-16T01:25:57.578266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982032+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:25:54.982032+0000","last_peered":"2023-12-16T01:25:54.982032+0000","last_clean":"2023-12-16T01:25:54.982032+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:25:54.982032+0000","last_undegraded":"2023-12-16T01:25:54.982032+0000","last_fullsized":"2023-12-16T01:25:54.982032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975450+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:25:54.975450+0000","last_peered":"2023-12-16T01:25:54.975450+0000","last_clean":"2023-12-16T01:25:54.975450+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:25:54.975450+0000","last_undegraded":"2023-12-16T01:25:54.975450+0000","last_fullsized":"2023-12-16T01:25:54.975450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579099+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:25:57.579099+0000","last_peered":"2023-12-16T01:25:57.579099+0000","last_clean":"2023-12-16T01:25:57.579099+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:25:57.579099+0000","last_undegraded":"2023-12-16T01:25:57.579099+0000","last_fullsized":"2023-12-16T01:25:57.579099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978727+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:25:54.978727+0000","last_peered":"2023-12-16T01:25:54.978727+0000","last_clean":"2023-12-16T01:25:54.978727+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:25:54.978727+0000","last_undegraded":"2023-12-16T01:25:54.978727+0000","last_fullsized":"2023-12-16T01:25:54.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955761+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:25:54.955761+0000","last_peered":"2023-12-16T01:25:54.955761+0000","last_clean":"2023-12-16T01:25:54.955761+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:25:54.955761+0000","last_undegraded":"2023-12-16T01:25:54.955761+0000","last_fullsized":"2023-12-16T01:25:54.955761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026421+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:25:56.026421+0000","last_peered":"2023-12-16T01:25:56.026421+0000","last_clean":"2023-12-16T01:25:56.026421+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:25:56.026421+0000","last_undegraded":"2023-12-16T01:25:56.026421+0000","last_fullsized":"2023-12-16T01:25:56.026421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892557+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:25:54.892557+0000","last_peered":"2023-12-16T01:25:54.892557+0000","last_clean":"2023-12-16T01:25:54.892557+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:25:54.892557+0000","last_undegraded":"2023-12-16T01:25:54.892557+0000","last_fullsized":"2023-12-16T01:25:54.892557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978933+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:25:54.978933+0000","last_peered":"2023-12-16T01:25:54.978933+0000","last_clean":"2023-12-16T01:25:54.978933+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:25:54.978933+0000","last_undegraded":"2023-12-16T01:25:54.978933+0000","last_fullsized":"2023-12-16T01:25:54.978933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578693+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:25:57.578693+0000","last_peered":"2023-12-16T01:25:57.578693+0000","last_clean":"2023-12-16T01:25:57.578693+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:25:57.578693+0000","last_undegraded":"2023-12-16T01:25:57.578693+0000","last_fullsized":"2023-12-16T01:25:57.578693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977264+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:25:54.977264+0000","last_peered":"2023-12-16T01:25:54.977264+0000","last_clean":"2023-12-16T01:25:54.977264+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:25:54.977264+0000","last_undegraded":"2023-12-16T01:25:54.977264+0000","last_fullsized":"2023-12-16T01:25:54.977264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955494+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:25:54.955494+0000","last_peered":"2023-12-16T01:25:54.955494+0000","last_clean":"2023-12-16T01:25:54.955494+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:25:54.955494+0000","last_undegraded":"2023-12-16T01:25:54.955494+0000","last_fullsized":"2023-12-16T01:25:54.955494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579484+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:25:57.579484+0000","last_peered":"2023-12-16T01:25:57.579484+0000","last_clean":"2023-12-16T01:25:57.579484+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:25:57.579484+0000","last_undegraded":"2023-12-16T01:25:57.579484+0000","last_fullsized":"2023-12-16T01:25:57.579484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972813+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:25:54.972813+0000","last_peered":"2023-12-16T01:25:54.972813+0000","last_clean":"2023-12-16T01:25:54.972813+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:25:54.972813+0000","last_undegraded":"2023-12-16T01:25:54.972813+0000","last_fullsized":"2023-12-16T01:25:54.972813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978171+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:25:54.978171+0000","last_peered":"2023-12-16T01:25:54.978171+0000","last_clean":"2023-12-16T01:25:54.978171+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:25:54.978171+0000","last_undegraded":"2023-12-16T01:25:54.978171+0000","last_fullsized":"2023-12-16T01:25:54.978171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579434+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:25:57.579434+0000","last_peered":"2023-12-16T01:25:57.579434+0000","last_clean":"2023-12-16T01:25:57.579434+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:25:57.579434+0000","last_undegraded":"2023-12-16T01:25:57.579434+0000","last_fullsized":"2023-12-16T01:25:57.579434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977003+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:25:54.977003+0000","last_peered":"2023-12-16T01:25:54.977003+0000","last_clean":"2023-12-16T01:25:54.977003+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:25:54.977003+0000","last_undegraded":"2023-12-16T01:25:54.977003+0000","last_fullsized":"2023-12-16T01:25:54.977003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980482+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:25:54.980482+0000","last_peered":"2023-12-16T01:25:54.980482+0000","last_clean":"2023-12-16T01:25:54.980482+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:25:54.980482+0000","last_undegraded":"2023-12-16T01:25:54.980482+0000","last_fullsized":"2023-12-16T01:25:54.980482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579147+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:25:57.579147+0000","last_peered":"2023-12-16T01:25:57.579147+0000","last_clean":"2023-12-16T01:25:57.579147+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:25:57.579147+0000","last_undegraded":"2023-12-16T01:25:57.579147+0000","last_fullsized":"2023-12-16T01:25:57.579147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970220+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:25:54.970220+0000","last_peered":"2023-12-16T01:25:54.970220+0000","last_clean":"2023-12-16T01:25:54.970220+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:25:54.970220+0000","last_undegraded":"2023-12-16T01:25:54.970220+0000","last_fullsized":"2023-12-16T01:25:54.970220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951806+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:25:54.951806+0000","last_peered":"2023-12-16T01:25:54.951806+0000","last_clean":"2023-12-16T01:25:54.951806+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:25:54.951806+0000","last_undegraded":"2023-12-16T01:25:54.951806+0000","last_fullsized":"2023-12-16T01:25:54.951806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026955+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:25:56.026955+0000","last_peered":"2023-12-16T01:25:56.026955+0000","last_clean":"2023-12-16T01:25:56.026955+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:25:56.026955+0000","last_undegraded":"2023-12-16T01:25:56.026955+0000","last_fullsized":"2023-12-16T01:25:56.026955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977424+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:25:54.977424+0000","last_peered":"2023-12-16T01:25:54.977424+0000","last_clean":"2023-12-16T01:25:54.977424+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:25:54.977424+0000","last_undegraded":"2023-12-16T01:25:54.977424+0000","last_fullsized":"2023-12-16T01:25:54.977424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:26:11.837618+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:26:11.837618+0000","last_peered":"2023-12-16T01:26:11.837618+0000","last_clean":"2023-12-16T01:26:11.837618+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:26:11.837618+0000","last_undegraded":"2023-12-16T01:26:11.837618+0000","last_fullsized":"2023-12-16T01:26:11.837618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022069+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:25:56.022069+0000","last_peered":"2023-12-16T01:25:56.022069+0000","last_clean":"2023-12-16T01:25:56.022069+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:25:56.022069+0000","last_undegraded":"2023-12-16T01:25:56.022069+0000","last_fullsized":"2023-12-16T01:25:56.022069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976897+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:25:54.976897+0000","last_peered":"2023-12-16T01:25:54.976897+0000","last_clean":"2023-12-16T01:25:54.976897+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:25:54.976897+0000","last_undegraded":"2023-12-16T01:25:54.976897+0000","last_fullsized":"2023-12-16T01:25:54.976897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951776+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:25:54.951776+0000","last_peered":"2023-12-16T01:25:54.951776+0000","last_clean":"2023-12-16T01:25:54.951776+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:25:54.951776+0000","last_undegraded":"2023-12-16T01:25:54.951776+0000","last_fullsized":"2023-12-16T01:25:54.951776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578353+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:25:57.578353+0000","last_peered":"2023-12-16T01:25:57.578353+0000","last_clean":"2023-12-16T01:25:57.578353+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:25:57.578353+0000","last_undegraded":"2023-12-16T01:25:57.578353+0000","last_fullsized":"2023-12-16T01:25:57.578353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976082+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:25:54.976082+0000","last_peered":"2023-12-16T01:25:54.976082+0000","last_clean":"2023-12-16T01:25:54.976082+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:25:54.976082+0000","last_undegraded":"2023-12-16T01:25:54.976082+0000","last_fullsized":"2023-12-16T01:25:54.976082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976614+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:25:54.976614+0000","last_peered":"2023-12-16T01:25:54.976614+0000","last_clean":"2023-12-16T01:25:54.976614+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:25:54.976614+0000","last_undegraded":"2023-12-16T01:25:54.976614+0000","last_fullsized":"2023-12-16T01:25:54.976614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579450+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:25:57.579450+0000","last_peered":"2023-12-16T01:25:57.579450+0000","last_clean":"2023-12-16T01:25:57.579450+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:25:57.579450+0000","last_undegraded":"2023-12-16T01:25:57.579450+0000","last_fullsized":"2023-12-16T01:25:57.579450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892462+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:25:54.892462+0000","last_peered":"2023-12-16T01:25:54.892462+0000","last_clean":"2023-12-16T01:25:54.892462+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:25:54.892462+0000","last_undegraded":"2023-12-16T01:25:54.892462+0000","last_fullsized":"2023-12-16T01:25:54.892462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975435+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:25:54.975435+0000","last_peered":"2023-12-16T01:25:54.975435+0000","last_clean":"2023-12-16T01:25:54.975435+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:25:54.975435+0000","last_undegraded":"2023-12-16T01:25:54.975435+0000","last_fullsized":"2023-12-16T01:25:54.975435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022372+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:25:56.022372+0000","last_peered":"2023-12-16T01:25:56.022372+0000","last_clean":"2023-12-16T01:25:56.022372+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:25:56.022372+0000","last_undegraded":"2023-12-16T01:25:56.022372+0000","last_fullsized":"2023-12-16T01:25:56.022372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022142+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:25:56.022142+0000","last_peered":"2023-12-16T01:25:56.022142+0000","last_clean":"2023-12-16T01:25:56.022142+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:25:56.022142+0000","last_undegraded":"2023-12-16T01:25:56.022142+0000","last_fullsized":"2023-12-16T01:25:56.022142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956110+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:25:54.956110+0000","last_peered":"2023-12-16T01:25:54.956110+0000","last_clean":"2023-12-16T01:25:54.956110+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:25:54.956110+0000","last_undegraded":"2023-12-16T01:25:54.956110+0000","last_fullsized":"2023-12-16T01:25:54.956110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979677+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:25:54.979677+0000","last_peered":"2023-12-16T01:25:54.979677+0000","last_clean":"2023-12-16T01:25:54.979677+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:25:54.979677+0000","last_undegraded":"2023-12-16T01:25:54.979677+0000","last_fullsized":"2023-12-16T01:25:54.979677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027139+0000","last_change":"2023-12-16T01:25:54.987548+0000","last_active":"2023-12-16T01:25:56.027139+0000","last_peered":"2023-12-16T01:25:56.027139+0000","last_clean":"2023-12-16T01:25:56.027139+0000","last_became_active":"2023-12-16T01:25:54.986234+0000","last_became_peered":"2023-12-16T01:25:54.986234+0000","last_unstale":"2023-12-16T01:25:56.027139+0000","last_undegraded":"2023-12-16T01:25:56.027139+0000","last_fullsized":"2023-12-16T01:25:56.027139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:33:01.262692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972408+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:25:54.972408+0000","last_peered":"2023-12-16T01:25:54.972408+0000","last_clean":"2023-12-16T01:25:54.972408+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:25:54.972408+0000","last_undegraded":"2023-12-16T01:25:54.972408+0000","last_fullsized":"2023-12-16T01:25:54.972408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970035+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:25:54.970035+0000","last_peered":"2023-12-16T01:25:54.970035+0000","last_clean":"2023-12-16T01:25:54.970035+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:25:54.970035+0000","last_undegraded":"2023-12-16T01:25:54.970035+0000","last_fullsized":"2023-12-16T01:25:54.970035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980404+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:25:54.980404+0000","last_peered":"2023-12-16T01:25:54.980404+0000","last_clean":"2023-12-16T01:25:54.980404+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:25:54.980404+0000","last_undegraded":"2023-12-16T01:25:54.980404+0000","last_fullsized":"2023-12-16T01:25:54.980404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955624+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:25:54.955624+0000","last_peered":"2023-12-16T01:25:54.955624+0000","last_clean":"2023-12-16T01:25:54.955624+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:25:54.955624+0000","last_undegraded":"2023-12-16T01:25:54.955624+0000","last_fullsized":"2023-12-16T01:25:54.955624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022214+0000","last_change":"2023-12-16T01:25:54.978408+0000","last_active":"2023-12-16T01:25:56.022214+0000","last_peered":"2023-12-16T01:25:56.022214+0000","last_clean":"2023-12-16T01:25:56.022214+0000","last_became_active":"2023-12-16T01:25:54.978056+0000","last_became_peered":"2023-12-16T01:25:54.978056+0000","last_unstale":"2023-12-16T01:25:56.022214+0000","last_undegraded":"2023-12-16T01:25:56.022214+0000","last_fullsized":"2023-12-16T01:25:56.022214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:32.801898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975724+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:25:54.975724+0000","last_peered":"2023-12-16T01:25:54.975724+0000","last_clean":"2023-12-16T01:25:54.975724+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:25:54.975724+0000","last_undegraded":"2023-12-16T01:25:54.975724+0000","last_fullsized":"2023-12-16T01:25:54.975724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972490+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:25:54.972490+0000","last_peered":"2023-12-16T01:25:54.972490+0000","last_clean":"2023-12-16T01:25:54.972490+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:25:54.972490+0000","last_undegraded":"2023-12-16T01:25:54.972490+0000","last_fullsized":"2023-12-16T01:25:54.972490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578258+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:25:57.578258+0000","last_peered":"2023-12-16T01:25:57.578258+0000","last_clean":"2023-12-16T01:25:57.578258+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:25:57.578258+0000","last_undegraded":"2023-12-16T01:25:57.578258+0000","last_fullsized":"2023-12-16T01:25:57.578258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891580+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:25:54.891580+0000","last_peered":"2023-12-16T01:25:54.891580+0000","last_clean":"2023-12-16T01:25:54.891580+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:25:54.891580+0000","last_undegraded":"2023-12-16T01:25:54.891580+0000","last_fullsized":"2023-12-16T01:25:54.891580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951407+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:25:54.951407+0000","last_peered":"2023-12-16T01:25:54.951407+0000","last_clean":"2023-12-16T01:25:54.951407+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:25:54.951407+0000","last_undegraded":"2023-12-16T01:25:54.951407+0000","last_fullsized":"2023-12-16T01:25:54.951407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980175+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:25:54.980175+0000","last_peered":"2023-12-16T01:25:54.980175+0000","last_clean":"2023-12-16T01:25:54.980175+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:25:54.980175+0000","last_undegraded":"2023-12-16T01:25:54.980175+0000","last_fullsized":"2023-12-16T01:25:54.980175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975633+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:25:54.975633+0000","last_peered":"2023-12-16T01:25:54.975633+0000","last_clean":"2023-12-16T01:25:54.975633+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:25:54.975633+0000","last_undegraded":"2023-12-16T01:25:54.975633+0000","last_fullsized":"2023-12-16T01:25:54.975633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970596+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:25:54.970596+0000","last_peered":"2023-12-16T01:25:54.970596+0000","last_clean":"2023-12-16T01:25:54.970596+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:25:54.970596+0000","last_undegraded":"2023-12-16T01:25:54.970596+0000","last_fullsized":"2023-12-16T01:25:54.970596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970559+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:25:54.970559+0000","last_peered":"2023-12-16T01:25:54.970559+0000","last_clean":"2023-12-16T01:25:54.970559+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:25:54.970559+0000","last_undegraded":"2023-12-16T01:25:54.970559+0000","last_fullsized":"2023-12-16T01:25:54.970559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892380+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:25:54.892380+0000","last_peered":"2023-12-16T01:25:54.892380+0000","last_clean":"2023-12-16T01:25:54.892380+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:25:54.892380+0000","last_undegraded":"2023-12-16T01:25:54.892380+0000","last_fullsized":"2023-12-16T01:25:54.892380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975934+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:25:54.975934+0000","last_peered":"2023-12-16T01:25:54.975934+0000","last_clean":"2023-12-16T01:25:54.975934+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:25:54.975934+0000","last_undegraded":"2023-12-16T01:25:54.975934+0000","last_fullsized":"2023-12-16T01:25:54.975934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979591+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:25:54.979591+0000","last_peered":"2023-12-16T01:25:54.979591+0000","last_clean":"2023-12-16T01:25:54.979591+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:25:54.979591+0000","last_undegraded":"2023-12-16T01:25:54.979591+0000","last_fullsized":"2023-12-16T01:25:54.979591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972206+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:25:54.972206+0000","last_peered":"2023-12-16T01:25:54.972206+0000","last_clean":"2023-12-16T01:25:54.972206+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:25:54.972206+0000","last_undegraded":"2023-12-16T01:25:54.972206+0000","last_fullsized":"2023-12-16T01:25:54.972206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972426+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:25:54.972426+0000","last_peered":"2023-12-16T01:25:54.972426+0000","last_clean":"2023-12-16T01:25:54.972426+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:25:54.972426+0000","last_undegraded":"2023-12-16T01:25:54.972426+0000","last_fullsized":"2023-12-16T01:25:54.972426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955509+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:25:54.955509+0000","last_peered":"2023-12-16T01:25:54.955509+0000","last_clean":"2023-12-16T01:25:54.955509+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:25:54.955509+0000","last_undegraded":"2023-12-16T01:25:54.955509+0000","last_fullsized":"2023-12-16T01:25:54.955509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981955+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:25:54.981955+0000","last_peered":"2023-12-16T01:25:54.981955+0000","last_clean":"2023-12-16T01:25:54.981955+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:25:54.981955+0000","last_undegraded":"2023-12-16T01:25:54.981955+0000","last_fullsized":"2023-12-16T01:25:54.981955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976900+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:25:54.976900+0000","last_peered":"2023-12-16T01:25:54.976900+0000","last_clean":"2023-12-16T01:25:54.976900+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:25:54.976900+0000","last_undegraded":"2023-12-16T01:25:54.976900+0000","last_fullsized":"2023-12-16T01:25:54.976900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.952066+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:25:54.952066+0000","last_peered":"2023-12-16T01:25:54.952066+0000","last_clean":"2023-12-16T01:25:54.952066+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:25:54.952066+0000","last_undegraded":"2023-12-16T01:25:54.952066+0000","last_fullsized":"2023-12-16T01:25:54.952066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977633+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:25:54.977633+0000","last_peered":"2023-12-16T01:25:54.977633+0000","last_clean":"2023-12-16T01:25:54.977633+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:25:54.977633+0000","last_undegraded":"2023-12-16T01:25:54.977633+0000","last_fullsized":"2023-12-16T01:25:54.977633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979510+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:25:54.979510+0000","last_peered":"2023-12-16T01:25:54.979510+0000","last_clean":"2023-12-16T01:25:54.979510+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:25:54.979510+0000","last_undegraded":"2023-12-16T01:25:54.979510+0000","last_fullsized":"2023-12-16T01:25:54.979510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972127+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:25:54.972127+0000","last_peered":"2023-12-16T01:25:54.972127+0000","last_clean":"2023-12-16T01:25:54.972127+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:25:54.972127+0000","last_undegraded":"2023-12-16T01:25:54.972127+0000","last_fullsized":"2023-12-16T01:25:54.972127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970095+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:25:54.970095+0000","last_peered":"2023-12-16T01:25:54.970095+0000","last_clean":"2023-12-16T01:25:54.970095+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:25:54.970095+0000","last_undegraded":"2023-12-16T01:25:54.970095+0000","last_fullsized":"2023-12-16T01:25:54.970095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970463+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:25:54.970463+0000","last_peered":"2023-12-16T01:25:54.970463+0000","last_clean":"2023-12-16T01:25:54.970463+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:25:54.970463+0000","last_undegraded":"2023-12-16T01:25:54.970463+0000","last_fullsized":"2023-12-16T01:25:54.970463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981872+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:25:54.981872+0000","last_peered":"2023-12-16T01:25:54.981872+0000","last_clean":"2023-12-16T01:25:54.981872+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:25:54.981872+0000","last_undegraded":"2023-12-16T01:25:54.981872+0000","last_fullsized":"2023-12-16T01:25:54.981872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977430+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:25:54.977430+0000","last_peered":"2023-12-16T01:25:54.977430+0000","last_clean":"2023-12-16T01:25:54.977430+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:25:54.977430+0000","last_undegraded":"2023-12-16T01:25:54.977430+0000","last_fullsized":"2023-12-16T01:25:54.977430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976471+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:25:54.976471+0000","last_peered":"2023-12-16T01:25:54.976471+0000","last_clean":"2023-12-16T01:25:54.976471+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:25:54.976471+0000","last_undegraded":"2023-12-16T01:25:54.976471+0000","last_fullsized":"2023-12-16T01:25:54.976471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975246+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:25:54.975246+0000","last_peered":"2023-12-16T01:25:54.975246+0000","last_clean":"2023-12-16T01:25:54.975246+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:25:54.975246+0000","last_undegraded":"2023-12-16T01:25:54.975246+0000","last_fullsized":"2023-12-16T01:25:54.975246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970321+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:25:54.970321+0000","last_peered":"2023-12-16T01:25:54.970321+0000","last_clean":"2023-12-16T01:25:54.970321+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:25:54.970321+0000","last_undegraded":"2023-12-16T01:25:54.970321+0000","last_fullsized":"2023-12-16T01:25:54.970321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978094+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:25:54.978094+0000","last_peered":"2023-12-16T01:25:54.978094+0000","last_clean":"2023-12-16T01:25:54.978094+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:25:54.978094+0000","last_undegraded":"2023-12-16T01:25:54.978094+0000","last_fullsized":"2023-12-16T01:25:54.978094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892077+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:25:54.892077+0000","last_peered":"2023-12-16T01:25:54.892077+0000","last_clean":"2023-12-16T01:25:54.892077+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:25:54.892077+0000","last_undegraded":"2023-12-16T01:25:54.892077+0000","last_fullsized":"2023-12-16T01:25:54.892077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980139+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:25:54.980139+0000","last_peered":"2023-12-16T01:25:54.980139+0000","last_clean":"2023-12-16T01:25:54.980139+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:25:54.980139+0000","last_undegraded":"2023-12-16T01:25:54.980139+0000","last_fullsized":"2023-12-16T01:25:54.980139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891999+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:25:54.891999+0000","last_peered":"2023-12-16T01:25:54.891999+0000","last_clean":"2023-12-16T01:25:54.891999+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:25:54.891999+0000","last_undegraded":"2023-12-16T01:25:54.891999+0000","last_fullsized":"2023-12-16T01:25:54.891999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975363+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:25:54.975363+0000","last_peered":"2023-12-16T01:25:54.975363+0000","last_clean":"2023-12-16T01:25:54.975363+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:25:54.975363+0000","last_undegraded":"2023-12-16T01:25:54.975363+0000","last_fullsized":"2023-12-16T01:25:54.975363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975981+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:25:54.975981+0000","last_peered":"2023-12-16T01:25:54.975981+0000","last_clean":"2023-12-16T01:25:54.975981+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:25:54.975981+0000","last_undegraded":"2023-12-16T01:25:54.975981+0000","last_fullsized":"2023-12-16T01:25:54.975981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978584+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:25:54.978584+0000","last_peered":"2023-12-16T01:25:54.978584+0000","last_clean":"2023-12-16T01:25:54.978584+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:25:54.978584+0000","last_undegraded":"2023-12-16T01:25:54.978584+0000","last_fullsized":"2023-12-16T01:25:54.978584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":698014,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":112066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":697992,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:26:18.972 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:26:19.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 Processor -- start 2023-12-16T01:26:19.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 -- start start 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff038153890 0x7ff03815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff038153c70 0x7ff0380c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03815a700 con 0x7ff0380ceef0 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380ca870 con 0x7ff038153890 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.106+0000 7ff03d8cf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff038159af0 con 0x7ff038153c70 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.107+0000 7ff036ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff038153890 0x7ff03815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.107+0000 7ff0367fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff038153c70 0x7ff0380c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.107+0000 7ff036ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff038153890 0x7ff03815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36320/0 (socket says 172.21.15.107:36320) 2023-12-16T01:26:19.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.107+0000 7ff036ffd640 1 -- 172.21.15.107:0/3038610851 learned_addr learned my addr 172.21.15.107:0/3038610851 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:19.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.109+0000 7ff036ffd640 1 -- 172.21.15.107:0/3038610851 >> v2:172.21.15.157:3300/0 conn(0x7ff038153c70 msgr2=0x7ff0380c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:19.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.109+0000 7ff036ffd640 1 --2- 172.21.15.107:0/3038610851 >> v2:172.21.15.157:3300/0 conn(0x7ff038153c70 0x7ff0380c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.109+0000 7ff036ffd640 1 -- 172.21.15.107:0/3038610851 >> v1:172.21.15.157:6789/0 conn(0x7ff0380ceef0 legacy=0x7ff03815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:19.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.109+0000 7ff036ffd640 1 -- 172.21.15.107:0/3038610851 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038159dd0 con 0x7ff038153890 2023-12-16T01:26:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.111+0000 7ff036ffd640 1 --2- 172.21.15.107:0/3038610851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153890 0x7ff03815d950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0380c6290 tx=0x7ff02c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467411bac2a0de46 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:19.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.113+0000 7ff035ffb640 1 -- 172.21.15.107:0/3038610851 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c030860 con 0x7ff038153890 2023-12-16T01:26:19.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.115+0000 7ff035ffb640 1 -- 172.21.15.107:0/3038610851 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0309c0 con 0x7ff038153890 2023-12-16T01:26:19.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.115+0000 7ff035ffb640 1 -- 172.21.15.107:0/3038610851 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c030d50 con 0x7ff038153890 2023-12-16T01:26:19.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 -- 172.21.15.107:0/3038610851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153890 msgr2=0x7ff03815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/3038610851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153890 0x7ff03815d950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0380c6290 tx=0x7ff02c02b9a0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 -- 172.21.15.107:0/3038610851 shutdown_connections 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/3038610851 >> v2:172.21.15.157:3300/0 conn(0x7ff038153c70 0x7ff0380c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/3038610851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153890 0x7ff03815d950 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 -- 172.21.15.107:0/3038610851 >> 172.21.15.107:0/3038610851 conn(0x7ff03806ba00 msgr2=0x7ff03806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 -- 172.21.15.107:0/3038610851 shutdown_connections 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.116+0000 7ff03d8cf640 1 -- 172.21.15.107:0/3038610851 wait complete. 2023-12-16T01:26:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.117+0000 7ff03d8cf640 1 Processor -- start 2023-12-16T01:26:19.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.117+0000 7ff03d8cf640 1 -- start start 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff03d8cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0380ceef0 0x7ff0380c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff03d8cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff038153890 0x7ff0381f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff03d8cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 0x7ff038148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff03d8cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0381f2890 con 0x7ff038153c70 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff03d8cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0381f2b30 con 0x7ff038153890 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff03d8cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380c5d30 con 0x7ff0380ceef0 2023-12-16T01:26:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff0377fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 0x7ff038148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff0377fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 0x7ff038148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36336/0 (socket says 172.21.15.107:36336) 2023-12-16T01:26:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff0377fe640 1 -- 172.21.15.107:0/1682597600 learned_addr learned my addr 172.21.15.107:0/1682597600 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff0367fc640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff038153890 0x7ff0381f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.118+0000 7ff036ffd640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0380ceef0 0x7ff0380c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.121+0000 7ff0377fe640 1 -- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0380ceef0 msgr2=0x7ff0380c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.121+0000 7ff0377fe640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0380ceef0 0x7ff0380c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.121+0000 7ff0377fe640 1 -- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff038153890 msgr2=0x7ff0381f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.121+0000 7ff0377fe640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff038153890 0x7ff0381f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.121+0000 7ff0377fe640 1 -- 172.21.15.107:0/1682597600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0094d0 con 0x7ff038153c70 2023-12-16T01:26:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.124+0000 7ff0377fe640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 0x7ff038148c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff03000b970 tx=0x7ff03000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:19.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.126+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000cb40 con 0x7ff038153c70 2023-12-16T01:26:19.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.126+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0380cd9c0 con 0x7ff038153c70 2023-12-16T01:26:19.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.126+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0380cdf80 con 0x7ff038153c70 2023-12-16T01:26:19.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.127+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff038067500 con 0x7ff038153c70 2023-12-16T01:26:19.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.127+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000cca0 con 0x7ff038153c70 2023-12-16T01:26:19.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.127+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030003b70 con 0x7ff038153c70 2023-12-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.372+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff030003cd0 con 0x7ff038153c70 2023-12-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.372+0000 7ff01ffff640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff02406ae40 0x7ff02406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.373+0000 7ff036ffd640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff02406ae40 0x7ff02406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.373+0000 7ff036ffd640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff02406ae40 0x7ff02406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff02c036000 tx=0x7ff02c008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:19.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.386+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff030058790 con 0x7ff038153c70 2023-12-16T01:26:19.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.386+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff030054ad0 con 0x7ff038153c70 2023-12-16T01:26:19.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.553+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0381597a0 con 0x7ff02406ae40 2023-12-16T01:26:19.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.562+0000 7ff01ffff640 1 -- 172.21.15.107:0/1682597600 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345323 (secure 0 0 0) 0x7ff02c030660 con 0x7ff02406ae40 2023-12-16T01:26:19.566 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff02406ae40 msgr2=0x7ff02406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff02406ae40 0x7ff02406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff02c036000 tx=0x7ff02c008030 comp rx=0 tx=0).stop 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 msgr2=0x7ff038148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 0x7ff038148c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff03000b970 tx=0x7ff03000be30 comp rx=0 tx=0).stop 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 shutdown_connections 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff038153c70 0x7ff038148c20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff02406ae40 0x7ff02406d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff038153890 0x7ff0381f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 --2- 172.21.15.107:0/1682597600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0380ceef0 0x7ff0380c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 >> 172.21.15.107:0/1682597600 conn(0x7ff03806ba00 msgr2=0x7ff03815ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:19.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 shutdown_connections 2023-12-16T01:26:19.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.565+0000 7ff03d8cf640 1 -- 172.21.15.107:0/1682597600 wait complete. 2023-12-16T01:26:19.576 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-12-16T01:26:17.718131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235144,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739576,"statfs":{"total":773094113280,"available":772853325824,"internally_reserved":0,"allocated":2392064,"data_stored":2050444,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002617"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956050+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:25:54.956050+0000","last_peered":"2023-12-16T01:25:54.956050+0000","last_clean":"2023-12-16T01:25:54.956050+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:25:54.956050+0000","last_undegraded":"2023-12-16T01:25:54.956050+0000","last_fullsized":"2023-12-16T01:25:54.956050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976062+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:25:54.976062+0000","last_peered":"2023-12-16T01:25:54.976062+0000","last_clean":"2023-12-16T01:25:54.976062+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:25:54.976062+0000","last_undegraded":"2023-12-16T01:25:54.976062+0000","last_fullsized":"2023-12-16T01:25:54.976062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579762+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:25:57.579762+0000","last_peered":"2023-12-16T01:25:57.579762+0000","last_clean":"2023-12-16T01:25:57.579762+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:25:57.579762+0000","last_undegraded":"2023-12-16T01:25:57.579762+0000","last_fullsized":"2023-12-16T01:25:57.579762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976137+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:25:54.976137+0000","last_peered":"2023-12-16T01:25:54.976137+0000","last_clean":"2023-12-16T01:25:54.976137+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:25:54.976137+0000","last_undegraded":"2023-12-16T01:25:54.976137+0000","last_fullsized":"2023-12-16T01:25:54.976137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976018+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:25:54.976018+0000","last_peered":"2023-12-16T01:25:54.976018+0000","last_clean":"2023-12-16T01:25:54.976018+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:25:54.976018+0000","last_undegraded":"2023-12-16T01:25:54.976018+0000","last_fullsized":"2023-12-16T01:25:54.976018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.577950+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:25:57.577950+0000","last_peered":"2023-12-16T01:25:57.577950+0000","last_clean":"2023-12-16T01:25:57.577950+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:25:57.577950+0000","last_undegraded":"2023-12-16T01:25:57.577950+0000","last_fullsized":"2023-12-16T01:25:57.577950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977537+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:25:54.977537+0000","last_peered":"2023-12-16T01:25:54.977537+0000","last_clean":"2023-12-16T01:25:54.977537+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:25:54.977537+0000","last_undegraded":"2023-12-16T01:25:54.977537+0000","last_fullsized":"2023-12-16T01:25:54.977537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976272+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:25:54.976272+0000","last_peered":"2023-12-16T01:25:54.976272+0000","last_clean":"2023-12-16T01:25:54.976272+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:25:54.976272+0000","last_undegraded":"2023-12-16T01:25:54.976272+0000","last_fullsized":"2023-12-16T01:25:54.976272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578559+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:25:57.578559+0000","last_peered":"2023-12-16T01:25:57.578559+0000","last_clean":"2023-12-16T01:25:57.578559+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:25:57.578559+0000","last_undegraded":"2023-12-16T01:25:57.578559+0000","last_fullsized":"2023-12-16T01:25:57.578559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982296+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:25:54.982296+0000","last_peered":"2023-12-16T01:25:54.982296+0000","last_clean":"2023-12-16T01:25:54.982296+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:25:54.982296+0000","last_undegraded":"2023-12-16T01:25:54.982296+0000","last_fullsized":"2023-12-16T01:25:54.982296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976753+0000","last_change":"2023-12-16T01:25:49.153869+0000","last_active":"2023-12-16T01:25:54.976753+0000","last_peered":"2023-12-16T01:25:54.976753+0000","last_clean":"2023-12-16T01:25:54.976753+0000","last_became_active":"2023-12-16T01:25:49.153613+0000","last_became_peered":"2023-12-16T01:25:49.153613+0000","last_unstale":"2023-12-16T01:25:54.976753+0000","last_undegraded":"2023-12-16T01:25:54.976753+0000","last_fullsized":"2023-12-16T01:25:54.976753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:05.868096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578151+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:25:57.578151+0000","last_peered":"2023-12-16T01:25:57.578151+0000","last_clean":"2023-12-16T01:25:57.578151+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:25:57.578151+0000","last_undegraded":"2023-12-16T01:25:57.578151+0000","last_fullsized":"2023-12-16T01:25:57.578151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980257+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:25:54.980257+0000","last_peered":"2023-12-16T01:25:54.980257+0000","last_clean":"2023-12-16T01:25:54.980257+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:25:54.980257+0000","last_undegraded":"2023-12-16T01:25:54.980257+0000","last_fullsized":"2023-12-16T01:25:54.980257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977097+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:25:54.977097+0000","last_peered":"2023-12-16T01:25:54.977097+0000","last_clean":"2023-12-16T01:25:54.977097+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:25:54.977097+0000","last_undegraded":"2023-12-16T01:25:54.977097+0000","last_fullsized":"2023-12-16T01:25:54.977097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026894+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:25:56.026894+0000","last_peered":"2023-12-16T01:25:56.026894+0000","last_clean":"2023-12-16T01:25:56.026894+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:25:56.026894+0000","last_undegraded":"2023-12-16T01:25:56.026894+0000","last_fullsized":"2023-12-16T01:25:56.026894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951884+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:25:54.951884+0000","last_peered":"2023-12-16T01:25:54.951884+0000","last_clean":"2023-12-16T01:25:54.951884+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:25:54.951884+0000","last_undegraded":"2023-12-16T01:25:54.951884+0000","last_fullsized":"2023-12-16T01:25:54.951884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970306+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:25:54.970306+0000","last_peered":"2023-12-16T01:25:54.970306+0000","last_clean":"2023-12-16T01:25:54.970306+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:25:54.970306+0000","last_undegraded":"2023-12-16T01:25:54.970306+0000","last_fullsized":"2023-12-16T01:25:54.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.351491+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:25:56.351491+0000","last_peered":"2023-12-16T01:25:56.351491+0000","last_clean":"2023-12-16T01:25:56.351491+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:25:56.351491+0000","last_undegraded":"2023-12-16T01:25:56.351491+0000","last_fullsized":"2023-12-16T01:25:56.351491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955406+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:25:54.955406+0000","last_peered":"2023-12-16T01:25:54.955406+0000","last_clean":"2023-12-16T01:25:54.955406+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:25:54.955406+0000","last_undegraded":"2023-12-16T01:25:54.955406+0000","last_fullsized":"2023-12-16T01:25:54.955406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956170+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:25:54.956170+0000","last_peered":"2023-12-16T01:25:54.956170+0000","last_clean":"2023-12-16T01:25:54.956170+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:25:54.956170+0000","last_undegraded":"2023-12-16T01:25:54.956170+0000","last_fullsized":"2023-12-16T01:25:54.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578850+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:25:57.578850+0000","last_peered":"2023-12-16T01:25:57.578850+0000","last_clean":"2023-12-16T01:25:57.578850+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:25:57.578850+0000","last_undegraded":"2023-12-16T01:25:57.578850+0000","last_fullsized":"2023-12-16T01:25:57.578850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977333+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:25:54.977333+0000","last_peered":"2023-12-16T01:25:54.977333+0000","last_clean":"2023-12-16T01:25:54.977333+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:25:54.977333+0000","last_undegraded":"2023-12-16T01:25:54.977333+0000","last_fullsized":"2023-12-16T01:25:54.977333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977386+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:25:54.977386+0000","last_peered":"2023-12-16T01:25:54.977386+0000","last_clean":"2023-12-16T01:25:54.977386+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:25:54.977386+0000","last_undegraded":"2023-12-16T01:25:54.977386+0000","last_fullsized":"2023-12-16T01:25:54.977386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578376+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:25:57.578376+0000","last_peered":"2023-12-16T01:25:57.578376+0000","last_clean":"2023-12-16T01:25:57.578376+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:25:57.578376+0000","last_undegraded":"2023-12-16T01:25:57.578376+0000","last_fullsized":"2023-12-16T01:25:57.578376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955709+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:25:54.955709+0000","last_peered":"2023-12-16T01:25:54.955709+0000","last_clean":"2023-12-16T01:25:54.955709+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:25:54.955709+0000","last_undegraded":"2023-12-16T01:25:54.955709+0000","last_fullsized":"2023-12-16T01:25:54.955709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977705+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:25:54.977705+0000","last_peered":"2023-12-16T01:25:54.977705+0000","last_clean":"2023-12-16T01:25:54.977705+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:25:54.977705+0000","last_undegraded":"2023-12-16T01:25:54.977705+0000","last_fullsized":"2023-12-16T01:25:54.977705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578057+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:25:57.578057+0000","last_peered":"2023-12-16T01:25:57.578057+0000","last_clean":"2023-12-16T01:25:57.578057+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:25:57.578057+0000","last_undegraded":"2023-12-16T01:25:57.578057+0000","last_fullsized":"2023-12-16T01:25:57.578057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955950+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:25:54.955950+0000","last_peered":"2023-12-16T01:25:54.955950+0000","last_clean":"2023-12-16T01:25:54.955950+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:25:54.955950+0000","last_undegraded":"2023-12-16T01:25:54.955950+0000","last_fullsized":"2023-12-16T01:25:54.955950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955800+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:25:54.955800+0000","last_peered":"2023-12-16T01:25:54.955800+0000","last_clean":"2023-12-16T01:25:54.955800+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:25:54.955800+0000","last_undegraded":"2023-12-16T01:25:54.955800+0000","last_fullsized":"2023-12-16T01:25:54.955800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.021931+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:25:56.021931+0000","last_peered":"2023-12-16T01:25:56.021931+0000","last_clean":"2023-12-16T01:25:56.021931+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:25:56.021931+0000","last_undegraded":"2023-12-16T01:25:56.021931+0000","last_fullsized":"2023-12-16T01:25:56.021931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970664+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:25:54.970664+0000","last_peered":"2023-12-16T01:25:54.970664+0000","last_clean":"2023-12-16T01:25:54.970664+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:25:54.970664+0000","last_undegraded":"2023-12-16T01:25:54.970664+0000","last_fullsized":"2023-12-16T01:25:54.970664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976974+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:25:54.976974+0000","last_peered":"2023-12-16T01:25:54.976974+0000","last_clean":"2023-12-16T01:25:54.976974+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:25:54.976974+0000","last_undegraded":"2023-12-16T01:25:54.976974+0000","last_fullsized":"2023-12-16T01:25:54.976974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579763+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:25:57.579763+0000","last_peered":"2023-12-16T01:25:57.579763+0000","last_clean":"2023-12-16T01:25:57.579763+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:25:57.579763+0000","last_undegraded":"2023-12-16T01:25:57.579763+0000","last_fullsized":"2023-12-16T01:25:57.579763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892101+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:25:54.892101+0000","last_peered":"2023-12-16T01:25:54.892101+0000","last_clean":"2023-12-16T01:25:54.892101+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:25:54.892101+0000","last_undegraded":"2023-12-16T01:25:54.892101+0000","last_fullsized":"2023-12-16T01:25:54.892101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975270+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:25:54.975270+0000","last_peered":"2023-12-16T01:25:54.975270+0000","last_clean":"2023-12-16T01:25:54.975270+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:25:54.975270+0000","last_undegraded":"2023-12-16T01:25:54.975270+0000","last_fullsized":"2023-12-16T01:25:54.975270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578675+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:25:57.578675+0000","last_peered":"2023-12-16T01:25:57.578675+0000","last_clean":"2023-12-16T01:25:57.578675+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:25:57.578675+0000","last_undegraded":"2023-12-16T01:25:57.578675+0000","last_fullsized":"2023-12-16T01:25:57.578675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980017+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:25:54.980017+0000","last_peered":"2023-12-16T01:25:54.980017+0000","last_clean":"2023-12-16T01:25:54.980017+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:25:54.980017+0000","last_undegraded":"2023-12-16T01:25:54.980017+0000","last_fullsized":"2023-12-16T01:25:54.980017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980559+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:25:54.980559+0000","last_peered":"2023-12-16T01:25:54.980559+0000","last_clean":"2023-12-16T01:25:54.980559+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:25:54.980559+0000","last_undegraded":"2023-12-16T01:25:54.980559+0000","last_fullsized":"2023-12-16T01:25:54.980559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579261+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:25:57.579261+0000","last_peered":"2023-12-16T01:25:57.579261+0000","last_clean":"2023-12-16T01:25:57.579261+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:25:57.579261+0000","last_undegraded":"2023-12-16T01:25:57.579261+0000","last_fullsized":"2023-12-16T01:25:57.579261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970408+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:25:54.970408+0000","last_peered":"2023-12-16T01:25:54.970408+0000","last_clean":"2023-12-16T01:25:54.970408+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:25:54.970408+0000","last_undegraded":"2023-12-16T01:25:54.970408+0000","last_fullsized":"2023-12-16T01:25:54.970408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951593+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:25:54.951593+0000","last_peered":"2023-12-16T01:25:54.951593+0000","last_clean":"2023-12-16T01:25:54.951593+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:25:54.951593+0000","last_undegraded":"2023-12-16T01:25:54.951593+0000","last_fullsized":"2023-12-16T01:25:54.951593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579088+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:25:57.579088+0000","last_peered":"2023-12-16T01:25:57.579088+0000","last_clean":"2023-12-16T01:25:57.579088+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:25:57.579088+0000","last_undegraded":"2023-12-16T01:25:57.579088+0000","last_fullsized":"2023-12-16T01:25:57.579088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.969719+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:25:54.969719+0000","last_peered":"2023-12-16T01:25:54.969719+0000","last_clean":"2023-12-16T01:25:54.969719+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:25:54.969719+0000","last_undegraded":"2023-12-16T01:25:54.969719+0000","last_fullsized":"2023-12-16T01:25:54.969719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979749+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:25:54.979749+0000","last_peered":"2023-12-16T01:25:54.979749+0000","last_clean":"2023-12-16T01:25:54.979749+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:25:54.979749+0000","last_undegraded":"2023-12-16T01:25:54.979749+0000","last_fullsized":"2023-12-16T01:25:54.979749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578972+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:25:57.578972+0000","last_peered":"2023-12-16T01:25:57.578972+0000","last_clean":"2023-12-16T01:25:57.578972+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:25:57.578972+0000","last_undegraded":"2023-12-16T01:25:57.578972+0000","last_fullsized":"2023-12-16T01:25:57.578972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956071+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:25:54.956071+0000","last_peered":"2023-12-16T01:25:54.956071+0000","last_clean":"2023-12-16T01:25:54.956071+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:25:54.956071+0000","last_undegraded":"2023-12-16T01:25:54.956071+0000","last_fullsized":"2023-12-16T01:25:54.956071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977169+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:25:54.977169+0000","last_peered":"2023-12-16T01:25:54.977169+0000","last_clean":"2023-12-16T01:25:54.977169+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:25:54.977169+0000","last_undegraded":"2023-12-16T01:25:54.977169+0000","last_fullsized":"2023-12-16T01:25:54.977169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972956+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:25:54.972956+0000","last_peered":"2023-12-16T01:25:54.972956+0000","last_clean":"2023-12-16T01:25:54.972956+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:25:54.972956+0000","last_undegraded":"2023-12-16T01:25:54.972956+0000","last_fullsized":"2023-12-16T01:25:54.972956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027129+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:25:56.027129+0000","last_peered":"2023-12-16T01:25:56.027129+0000","last_clean":"2023-12-16T01:25:56.027129+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:25:56.027129+0000","last_undegraded":"2023-12-16T01:25:56.027129+0000","last_fullsized":"2023-12-16T01:25:56.027129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976823+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:25:54.976823+0000","last_peered":"2023-12-16T01:25:54.976823+0000","last_clean":"2023-12-16T01:25:54.976823+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:25:54.976823+0000","last_undegraded":"2023-12-16T01:25:54.976823+0000","last_fullsized":"2023-12-16T01:25:54.976823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970729+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:25:54.970729+0000","last_peered":"2023-12-16T01:25:54.970729+0000","last_clean":"2023-12-16T01:25:54.970729+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:25:54.970729+0000","last_undegraded":"2023-12-16T01:25:54.970729+0000","last_fullsized":"2023-12-16T01:25:54.970729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578266+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:25:57.578266+0000","last_peered":"2023-12-16T01:25:57.578266+0000","last_clean":"2023-12-16T01:25:57.578266+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:25:57.578266+0000","last_undegraded":"2023-12-16T01:25:57.578266+0000","last_fullsized":"2023-12-16T01:25:57.578266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982032+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:25:54.982032+0000","last_peered":"2023-12-16T01:25:54.982032+0000","last_clean":"2023-12-16T01:25:54.982032+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:25:54.982032+0000","last_undegraded":"2023-12-16T01:25:54.982032+0000","last_fullsized":"2023-12-16T01:25:54.982032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975450+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:25:54.975450+0000","last_peered":"2023-12-16T01:25:54.975450+0000","last_clean":"2023-12-16T01:25:54.975450+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:25:54.975450+0000","last_undegraded":"2023-12-16T01:25:54.975450+0000","last_fullsized":"2023-12-16T01:25:54.975450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579099+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:25:57.579099+0000","last_peered":"2023-12-16T01:25:57.579099+0000","last_clean":"2023-12-16T01:25:57.579099+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:25:57.579099+0000","last_undegraded":"2023-12-16T01:25:57.579099+0000","last_fullsized":"2023-12-16T01:25:57.579099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978727+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:25:54.978727+0000","last_peered":"2023-12-16T01:25:54.978727+0000","last_clean":"2023-12-16T01:25:54.978727+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:25:54.978727+0000","last_undegraded":"2023-12-16T01:25:54.978727+0000","last_fullsized":"2023-12-16T01:25:54.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955761+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:25:54.955761+0000","last_peered":"2023-12-16T01:25:54.955761+0000","last_clean":"2023-12-16T01:25:54.955761+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:25:54.955761+0000","last_undegraded":"2023-12-16T01:25:54.955761+0000","last_fullsized":"2023-12-16T01:25:54.955761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026421+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:25:56.026421+0000","last_peered":"2023-12-16T01:25:56.026421+0000","last_clean":"2023-12-16T01:25:56.026421+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:25:56.026421+0000","last_undegraded":"2023-12-16T01:25:56.026421+0000","last_fullsized":"2023-12-16T01:25:56.026421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892557+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:25:54.892557+0000","last_peered":"2023-12-16T01:25:54.892557+0000","last_clean":"2023-12-16T01:25:54.892557+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:25:54.892557+0000","last_undegraded":"2023-12-16T01:25:54.892557+0000","last_fullsized":"2023-12-16T01:25:54.892557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978933+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:25:54.978933+0000","last_peered":"2023-12-16T01:25:54.978933+0000","last_clean":"2023-12-16T01:25:54.978933+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:25:54.978933+0000","last_undegraded":"2023-12-16T01:25:54.978933+0000","last_fullsized":"2023-12-16T01:25:54.978933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578693+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:25:57.578693+0000","last_peered":"2023-12-16T01:25:57.578693+0000","last_clean":"2023-12-16T01:25:57.578693+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:25:57.578693+0000","last_undegraded":"2023-12-16T01:25:57.578693+0000","last_fullsized":"2023-12-16T01:25:57.578693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977264+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:25:54.977264+0000","last_peered":"2023-12-16T01:25:54.977264+0000","last_clean":"2023-12-16T01:25:54.977264+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:25:54.977264+0000","last_undegraded":"2023-12-16T01:25:54.977264+0000","last_fullsized":"2023-12-16T01:25:54.977264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955494+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:25:54.955494+0000","last_peered":"2023-12-16T01:25:54.955494+0000","last_clean":"2023-12-16T01:25:54.955494+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:25:54.955494+0000","last_undegraded":"2023-12-16T01:25:54.955494+0000","last_fullsized":"2023-12-16T01:25:54.955494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579484+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:25:57.579484+0000","last_peered":"2023-12-16T01:25:57.579484+0000","last_clean":"2023-12-16T01:25:57.579484+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:25:57.579484+0000","last_undegraded":"2023-12-16T01:25:57.579484+0000","last_fullsized":"2023-12-16T01:25:57.579484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972813+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:25:54.972813+0000","last_peered":"2023-12-16T01:25:54.972813+0000","last_clean":"2023-12-16T01:25:54.972813+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:25:54.972813+0000","last_undegraded":"2023-12-16T01:25:54.972813+0000","last_fullsized":"2023-12-16T01:25:54.972813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978171+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:25:54.978171+0000","last_peered":"2023-12-16T01:25:54.978171+0000","last_clean":"2023-12-16T01:25:54.978171+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:25:54.978171+0000","last_undegraded":"2023-12-16T01:25:54.978171+0000","last_fullsized":"2023-12-16T01:25:54.978171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579434+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:25:57.579434+0000","last_peered":"2023-12-16T01:25:57.579434+0000","last_clean":"2023-12-16T01:25:57.579434+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:25:57.579434+0000","last_undegraded":"2023-12-16T01:25:57.579434+0000","last_fullsized":"2023-12-16T01:25:57.579434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977003+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:25:54.977003+0000","last_peered":"2023-12-16T01:25:54.977003+0000","last_clean":"2023-12-16T01:25:54.977003+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:25:54.977003+0000","last_undegraded":"2023-12-16T01:25:54.977003+0000","last_fullsized":"2023-12-16T01:25:54.977003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980482+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:25:54.980482+0000","last_peered":"2023-12-16T01:25:54.980482+0000","last_clean":"2023-12-16T01:25:54.980482+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:25:54.980482+0000","last_undegraded":"2023-12-16T01:25:54.980482+0000","last_fullsized":"2023-12-16T01:25:54.980482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579147+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:25:57.579147+0000","last_peered":"2023-12-16T01:25:57.579147+0000","last_clean":"2023-12-16T01:25:57.579147+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:25:57.579147+0000","last_undegraded":"2023-12-16T01:25:57.579147+0000","last_fullsized":"2023-12-16T01:25:57.579147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970220+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:25:54.970220+0000","last_peered":"2023-12-16T01:25:54.970220+0000","last_clean":"2023-12-16T01:25:54.970220+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:25:54.970220+0000","last_undegraded":"2023-12-16T01:25:54.970220+0000","last_fullsized":"2023-12-16T01:25:54.970220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951806+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:25:54.951806+0000","last_peered":"2023-12-16T01:25:54.951806+0000","last_clean":"2023-12-16T01:25:54.951806+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:25:54.951806+0000","last_undegraded":"2023-12-16T01:25:54.951806+0000","last_fullsized":"2023-12-16T01:25:54.951806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026955+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:25:56.026955+0000","last_peered":"2023-12-16T01:25:56.026955+0000","last_clean":"2023-12-16T01:25:56.026955+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:25:56.026955+0000","last_undegraded":"2023-12-16T01:25:56.026955+0000","last_fullsized":"2023-12-16T01:25:56.026955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977424+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:25:54.977424+0000","last_peered":"2023-12-16T01:25:54.977424+0000","last_clean":"2023-12-16T01:25:54.977424+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:25:54.977424+0000","last_undegraded":"2023-12-16T01:25:54.977424+0000","last_fullsized":"2023-12-16T01:25:54.977424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:26:11.837618+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:26:11.837618+0000","last_peered":"2023-12-16T01:26:11.837618+0000","last_clean":"2023-12-16T01:26:11.837618+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:26:11.837618+0000","last_undegraded":"2023-12-16T01:26:11.837618+0000","last_fullsized":"2023-12-16T01:26:11.837618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022069+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:25:56.022069+0000","last_peered":"2023-12-16T01:25:56.022069+0000","last_clean":"2023-12-16T01:25:56.022069+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:25:56.022069+0000","last_undegraded":"2023-12-16T01:25:56.022069+0000","last_fullsized":"2023-12-16T01:25:56.022069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976897+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:25:54.976897+0000","last_peered":"2023-12-16T01:25:54.976897+0000","last_clean":"2023-12-16T01:25:54.976897+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:25:54.976897+0000","last_undegraded":"2023-12-16T01:25:54.976897+0000","last_fullsized":"2023-12-16T01:25:54.976897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951776+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:25:54.951776+0000","last_peered":"2023-12-16T01:25:54.951776+0000","last_clean":"2023-12-16T01:25:54.951776+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:25:54.951776+0000","last_undegraded":"2023-12-16T01:25:54.951776+0000","last_fullsized":"2023-12-16T01:25:54.951776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578353+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:25:57.578353+0000","last_peered":"2023-12-16T01:25:57.578353+0000","last_clean":"2023-12-16T01:25:57.578353+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:25:57.578353+0000","last_undegraded":"2023-12-16T01:25:57.578353+0000","last_fullsized":"2023-12-16T01:25:57.578353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976082+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:25:54.976082+0000","last_peered":"2023-12-16T01:25:54.976082+0000","last_clean":"2023-12-16T01:25:54.976082+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:25:54.976082+0000","last_undegraded":"2023-12-16T01:25:54.976082+0000","last_fullsized":"2023-12-16T01:25:54.976082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976614+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:25:54.976614+0000","last_peered":"2023-12-16T01:25:54.976614+0000","last_clean":"2023-12-16T01:25:54.976614+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:25:54.976614+0000","last_undegraded":"2023-12-16T01:25:54.976614+0000","last_fullsized":"2023-12-16T01:25:54.976614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579450+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:25:57.579450+0000","last_peered":"2023-12-16T01:25:57.579450+0000","last_clean":"2023-12-16T01:25:57.579450+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:25:57.579450+0000","last_undegraded":"2023-12-16T01:25:57.579450+0000","last_fullsized":"2023-12-16T01:25:57.579450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892462+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:25:54.892462+0000","last_peered":"2023-12-16T01:25:54.892462+0000","last_clean":"2023-12-16T01:25:54.892462+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:25:54.892462+0000","last_undegraded":"2023-12-16T01:25:54.892462+0000","last_fullsized":"2023-12-16T01:25:54.892462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975435+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:25:54.975435+0000","last_peered":"2023-12-16T01:25:54.975435+0000","last_clean":"2023-12-16T01:25:54.975435+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:25:54.975435+0000","last_undegraded":"2023-12-16T01:25:54.975435+0000","last_fullsized":"2023-12-16T01:25:54.975435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022372+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:25:56.022372+0000","last_peered":"2023-12-16T01:25:56.022372+0000","last_clean":"2023-12-16T01:25:56.022372+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:25:56.022372+0000","last_undegraded":"2023-12-16T01:25:56.022372+0000","last_fullsized":"2023-12-16T01:25:56.022372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022142+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:25:56.022142+0000","last_peered":"2023-12-16T01:25:56.022142+0000","last_clean":"2023-12-16T01:25:56.022142+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:25:56.022142+0000","last_undegraded":"2023-12-16T01:25:56.022142+0000","last_fullsized":"2023-12-16T01:25:56.022142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956110+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:25:54.956110+0000","last_peered":"2023-12-16T01:25:54.956110+0000","last_clean":"2023-12-16T01:25:54.956110+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:25:54.956110+0000","last_undegraded":"2023-12-16T01:25:54.956110+0000","last_fullsized":"2023-12-16T01:25:54.956110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979677+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:25:54.979677+0000","last_peered":"2023-12-16T01:25:54.979677+0000","last_clean":"2023-12-16T01:25:54.979677+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:25:54.979677+0000","last_undegraded":"2023-12-16T01:25:54.979677+0000","last_fullsized":"2023-12-16T01:25:54.979677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027139+0000","last_change":"2023-12-16T01:25:54.987548+0000","last_active":"2023-12-16T01:25:56.027139+0000","last_peered":"2023-12-16T01:25:56.027139+0000","last_clean":"2023-12-16T01:25:56.027139+0000","last_became_active":"2023-12-16T01:25:54.986234+0000","last_became_peered":"2023-12-16T01:25:54.986234+0000","last_unstale":"2023-12-16T01:25:56.027139+0000","last_undegraded":"2023-12-16T01:25:56.027139+0000","last_fullsized":"2023-12-16T01:25:56.027139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:33:01.262692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972408+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:25:54.972408+0000","last_peered":"2023-12-16T01:25:54.972408+0000","last_clean":"2023-12-16T01:25:54.972408+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:25:54.972408+0000","last_undegraded":"2023-12-16T01:25:54.972408+0000","last_fullsized":"2023-12-16T01:25:54.972408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970035+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:25:54.970035+0000","last_peered":"2023-12-16T01:25:54.970035+0000","last_clean":"2023-12-16T01:25:54.970035+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:25:54.970035+0000","last_undegraded":"2023-12-16T01:25:54.970035+0000","last_fullsized":"2023-12-16T01:25:54.970035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980404+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:25:54.980404+0000","last_peered":"2023-12-16T01:25:54.980404+0000","last_clean":"2023-12-16T01:25:54.980404+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:25:54.980404+0000","last_undegraded":"2023-12-16T01:25:54.980404+0000","last_fullsized":"2023-12-16T01:25:54.980404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955624+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:25:54.955624+0000","last_peered":"2023-12-16T01:25:54.955624+0000","last_clean":"2023-12-16T01:25:54.955624+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:25:54.955624+0000","last_undegraded":"2023-12-16T01:25:54.955624+0000","last_fullsized":"2023-12-16T01:25:54.955624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022214+0000","last_change":"2023-12-16T01:25:54.978408+0000","last_active":"2023-12-16T01:25:56.022214+0000","last_peered":"2023-12-16T01:25:56.022214+0000","last_clean":"2023-12-16T01:25:56.022214+0000","last_became_active":"2023-12-16T01:25:54.978056+0000","last_became_peered":"2023-12-16T01:25:54.978056+0000","last_unstale":"2023-12-16T01:25:56.022214+0000","last_undegraded":"2023-12-16T01:25:56.022214+0000","last_fullsized":"2023-12-16T01:25:56.022214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:32.801898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975724+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:25:54.975724+0000","last_peered":"2023-12-16T01:25:54.975724+0000","last_clean":"2023-12-16T01:25:54.975724+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:25:54.975724+0000","last_undegraded":"2023-12-16T01:25:54.975724+0000","last_fullsized":"2023-12-16T01:25:54.975724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972490+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:25:54.972490+0000","last_peered":"2023-12-16T01:25:54.972490+0000","last_clean":"2023-12-16T01:25:54.972490+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:25:54.972490+0000","last_undegraded":"2023-12-16T01:25:54.972490+0000","last_fullsized":"2023-12-16T01:25:54.972490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578258+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:25:57.578258+0000","last_peered":"2023-12-16T01:25:57.578258+0000","last_clean":"2023-12-16T01:25:57.578258+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:25:57.578258+0000","last_undegraded":"2023-12-16T01:25:57.578258+0000","last_fullsized":"2023-12-16T01:25:57.578258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891580+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:25:54.891580+0000","last_peered":"2023-12-16T01:25:54.891580+0000","last_clean":"2023-12-16T01:25:54.891580+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:25:54.891580+0000","last_undegraded":"2023-12-16T01:25:54.891580+0000","last_fullsized":"2023-12-16T01:25:54.891580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951407+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:25:54.951407+0000","last_peered":"2023-12-16T01:25:54.951407+0000","last_clean":"2023-12-16T01:25:54.951407+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:25:54.951407+0000","last_undegraded":"2023-12-16T01:25:54.951407+0000","last_fullsized":"2023-12-16T01:25:54.951407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980175+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:25:54.980175+0000","last_peered":"2023-12-16T01:25:54.980175+0000","last_clean":"2023-12-16T01:25:54.980175+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:25:54.980175+0000","last_undegraded":"2023-12-16T01:25:54.980175+0000","last_fullsized":"2023-12-16T01:25:54.980175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975633+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:25:54.975633+0000","last_peered":"2023-12-16T01:25:54.975633+0000","last_clean":"2023-12-16T01:25:54.975633+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:25:54.975633+0000","last_undegraded":"2023-12-16T01:25:54.975633+0000","last_fullsized":"2023-12-16T01:25:54.975633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970596+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:25:54.970596+0000","last_peered":"2023-12-16T01:25:54.970596+0000","last_clean":"2023-12-16T01:25:54.970596+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:25:54.970596+0000","last_undegraded":"2023-12-16T01:25:54.970596+0000","last_fullsized":"2023-12-16T01:25:54.970596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970559+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:25:54.970559+0000","last_peered":"2023-12-16T01:25:54.970559+0000","last_clean":"2023-12-16T01:25:54.970559+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:25:54.970559+0000","last_undegraded":"2023-12-16T01:25:54.970559+0000","last_fullsized":"2023-12-16T01:25:54.970559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892380+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:25:54.892380+0000","last_peered":"2023-12-16T01:25:54.892380+0000","last_clean":"2023-12-16T01:25:54.892380+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:25:54.892380+0000","last_undegraded":"2023-12-16T01:25:54.892380+0000","last_fullsized":"2023-12-16T01:25:54.892380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975934+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:25:54.975934+0000","last_peered":"2023-12-16T01:25:54.975934+0000","last_clean":"2023-12-16T01:25:54.975934+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:25:54.975934+0000","last_undegraded":"2023-12-16T01:25:54.975934+0000","last_fullsized":"2023-12-16T01:25:54.975934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979591+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:25:54.979591+0000","last_peered":"2023-12-16T01:25:54.979591+0000","last_clean":"2023-12-16T01:25:54.979591+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:25:54.979591+0000","last_undegraded":"2023-12-16T01:25:54.979591+0000","last_fullsized":"2023-12-16T01:25:54.979591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972206+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:25:54.972206+0000","last_peered":"2023-12-16T01:25:54.972206+0000","last_clean":"2023-12-16T01:25:54.972206+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:25:54.972206+0000","last_undegraded":"2023-12-16T01:25:54.972206+0000","last_fullsized":"2023-12-16T01:25:54.972206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972426+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:25:54.972426+0000","last_peered":"2023-12-16T01:25:54.972426+0000","last_clean":"2023-12-16T01:25:54.972426+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:25:54.972426+0000","last_undegraded":"2023-12-16T01:25:54.972426+0000","last_fullsized":"2023-12-16T01:25:54.972426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955509+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:25:54.955509+0000","last_peered":"2023-12-16T01:25:54.955509+0000","last_clean":"2023-12-16T01:25:54.955509+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:25:54.955509+0000","last_undegraded":"2023-12-16T01:25:54.955509+0000","last_fullsized":"2023-12-16T01:25:54.955509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981955+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:25:54.981955+0000","last_peered":"2023-12-16T01:25:54.981955+0000","last_clean":"2023-12-16T01:25:54.981955+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:25:54.981955+0000","last_undegraded":"2023-12-16T01:25:54.981955+0000","last_fullsized":"2023-12-16T01:25:54.981955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976900+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:25:54.976900+0000","last_peered":"2023-12-16T01:25:54.976900+0000","last_clean":"2023-12-16T01:25:54.976900+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:25:54.976900+0000","last_undegraded":"2023-12-16T01:25:54.976900+0000","last_fullsized":"2023-12-16T01:25:54.976900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.952066+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:25:54.952066+0000","last_peered":"2023-12-16T01:25:54.952066+0000","last_clean":"2023-12-16T01:25:54.952066+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:25:54.952066+0000","last_undegraded":"2023-12-16T01:25:54.952066+0000","last_fullsized":"2023-12-16T01:25:54.952066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977633+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:25:54.977633+0000","last_peered":"2023-12-16T01:25:54.977633+0000","last_clean":"2023-12-16T01:25:54.977633+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:25:54.977633+0000","last_undegraded":"2023-12-16T01:25:54.977633+0000","last_fullsized":"2023-12-16T01:25:54.977633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979510+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:25:54.979510+0000","last_peered":"2023-12-16T01:25:54.979510+0000","last_clean":"2023-12-16T01:25:54.979510+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:25:54.979510+0000","last_undegraded":"2023-12-16T01:25:54.979510+0000","last_fullsized":"2023-12-16T01:25:54.979510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972127+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:25:54.972127+0000","last_peered":"2023-12-16T01:25:54.972127+0000","last_clean":"2023-12-16T01:25:54.972127+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:25:54.972127+0000","last_undegraded":"2023-12-16T01:25:54.972127+0000","last_fullsized":"2023-12-16T01:25:54.972127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970095+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:25:54.970095+0000","last_peered":"2023-12-16T01:25:54.970095+0000","last_clean":"2023-12-16T01:25:54.970095+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:25:54.970095+0000","last_undegraded":"2023-12-16T01:25:54.970095+0000","last_fullsized":"2023-12-16T01:25:54.970095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970463+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:25:54.970463+0000","last_peered":"2023-12-16T01:25:54.970463+0000","last_clean":"2023-12-16T01:25:54.970463+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:25:54.970463+0000","last_undegraded":"2023-12-16T01:25:54.970463+0000","last_fullsized":"2023-12-16T01:25:54.970463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981872+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:25:54.981872+0000","last_peered":"2023-12-16T01:25:54.981872+0000","last_clean":"2023-12-16T01:25:54.981872+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:25:54.981872+0000","last_undegraded":"2023-12-16T01:25:54.981872+0000","last_fullsized":"2023-12-16T01:25:54.981872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977430+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:25:54.977430+0000","last_peered":"2023-12-16T01:25:54.977430+0000","last_clean":"2023-12-16T01:25:54.977430+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:25:54.977430+0000","last_undegraded":"2023-12-16T01:25:54.977430+0000","last_fullsized":"2023-12-16T01:25:54.977430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976471+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:25:54.976471+0000","last_peered":"2023-12-16T01:25:54.976471+0000","last_clean":"2023-12-16T01:25:54.976471+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:25:54.976471+0000","last_undegraded":"2023-12-16T01:25:54.976471+0000","last_fullsized":"2023-12-16T01:25:54.976471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975246+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:25:54.975246+0000","last_peered":"2023-12-16T01:25:54.975246+0000","last_clean":"2023-12-16T01:25:54.975246+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:25:54.975246+0000","last_undegraded":"2023-12-16T01:25:54.975246+0000","last_fullsized":"2023-12-16T01:25:54.975246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970321+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:25:54.970321+0000","last_peered":"2023-12-16T01:25:54.970321+0000","last_clean":"2023-12-16T01:25:54.970321+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:25:54.970321+0000","last_undegraded":"2023-12-16T01:25:54.970321+0000","last_fullsized":"2023-12-16T01:25:54.970321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978094+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:25:54.978094+0000","last_peered":"2023-12-16T01:25:54.978094+0000","last_clean":"2023-12-16T01:25:54.978094+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:25:54.978094+0000","last_undegraded":"2023-12-16T01:25:54.978094+0000","last_fullsized":"2023-12-16T01:25:54.978094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892077+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:25:54.892077+0000","last_peered":"2023-12-16T01:25:54.892077+0000","last_clean":"2023-12-16T01:25:54.892077+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:25:54.892077+0000","last_undegraded":"2023-12-16T01:25:54.892077+0000","last_fullsized":"2023-12-16T01:25:54.892077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980139+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:25:54.980139+0000","last_peered":"2023-12-16T01:25:54.980139+0000","last_clean":"2023-12-16T01:25:54.980139+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:25:54.980139+0000","last_undegraded":"2023-12-16T01:25:54.980139+0000","last_fullsized":"2023-12-16T01:25:54.980139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891999+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:25:54.891999+0000","last_peered":"2023-12-16T01:25:54.891999+0000","last_clean":"2023-12-16T01:25:54.891999+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:25:54.891999+0000","last_undegraded":"2023-12-16T01:25:54.891999+0000","last_fullsized":"2023-12-16T01:25:54.891999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975363+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:25:54.975363+0000","last_peered":"2023-12-16T01:25:54.975363+0000","last_clean":"2023-12-16T01:25:54.975363+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:25:54.975363+0000","last_undegraded":"2023-12-16T01:25:54.975363+0000","last_fullsized":"2023-12-16T01:25:54.975363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975981+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:25:54.975981+0000","last_peered":"2023-12-16T01:25:54.975981+0000","last_clean":"2023-12-16T01:25:54.975981+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:25:54.975981+0000","last_undegraded":"2023-12-16T01:25:54.975981+0000","last_fullsized":"2023-12-16T01:25:54.975981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978584+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:25:54.978584+0000","last_peered":"2023-12-16T01:25:54.978584+0000","last_clean":"2023-12-16T01:25:54.978584+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:25:54.978584+0000","last_undegraded":"2023-12-16T01:25:54.978584+0000","last_fullsized":"2023-12-16T01:25:54.978584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":698014,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":112066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":697992,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:26:19.581 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T01:26:19.581 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T01:26:19.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-16T01:26:19.581 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-16T01:26:19.582 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-16T01:26:19.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.715+0000 7f11a38c9640 1 Processor -- start 2023-12-16T01:26:19.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.715+0000 7f11a38c9640 1 -- start start 2023-12-16T01:26:19.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.716+0000 7f11a38c9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f119c153890 0x7f119c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.716+0000 7f11a38c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f119c0ceef0 0x7f119c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.716+0000 7f11a38c9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c15a700 con 0x7f119c153c70 2023-12-16T01:26:19.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.716+0000 7f11a38c9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c0cf840 con 0x7f119c0ceef0 2023-12-16T01:26:19.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.716+0000 7f11a38c9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c0ca870 con 0x7f119c153890 2023-12-16T01:26:19.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.717+0000 7f11a1665640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f119c153890 0x7f119c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.717+0000 7f11a1665640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f119c153890 0x7f119c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47294/0 (socket says 172.21.15.107:47294) 2023-12-16T01:26:19.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.717+0000 7f11a1665640 1 -- 172.21.15.107:0/3012511628 learned_addr learned my addr 172.21.15.107:0/3012511628 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:19.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.720+0000 7f11a1e66640 1 --2- 172.21.15.107:0/3012511628 >> v2:172.21.15.107:3300/0 conn(0x7f119c0ceef0 0x7f119c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.720+0000 7f11a1665640 1 -- 172.21.15.107:0/3012511628 >> v2:172.21.15.107:3300/0 conn(0x7f119c0ceef0 msgr2=0x7f119c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:19.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.720+0000 7f11a1665640 1 --2- 172.21.15.107:0/3012511628 >> v2:172.21.15.107:3300/0 conn(0x7f119c0ceef0 0x7f119c0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.720+0000 7f11a1665640 1 -- 172.21.15.107:0/3012511628 >> v1:172.21.15.157:6789/0 conn(0x7f119c153c70 legacy=0x7f119c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:19.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.720+0000 7f11a1665640 1 -- 172.21.15.107:0/3012511628 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c159af0 con 0x7f119c153890 2023-12-16T01:26:19.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.723+0000 7f11a1665640 1 --2- 172.21.15.107:0/3012511628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c153890 0x7f119c15d950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f119c0ccaa0 tx=0x7f119802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5725927b6ad2ea30 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:19.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f118ffff640 1 -- 172.21.15.107:0/3012511628 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198030860 con 0x7f119c153890 2023-12-16T01:26:19.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f118ffff640 1 -- 172.21.15.107:0/3012511628 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11980309c0 con 0x7f119c153890 2023-12-16T01:26:19.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f118ffff640 1 -- 172.21.15.107:0/3012511628 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198030d50 con 0x7f119c153890 2023-12-16T01:26:19.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 -- 172.21.15.107:0/3012511628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c153890 msgr2=0x7f119c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 --2- 172.21.15.107:0/3012511628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c153890 0x7f119c15d950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f119c0ccaa0 tx=0x7f119802b9a0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 -- 172.21.15.107:0/3012511628 shutdown_connections 2023-12-16T01:26:19.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 --2- 172.21.15.107:0/3012511628 >> v2:172.21.15.107:3300/0 conn(0x7f119c0ceef0 0x7f119c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 --2- 172.21.15.107:0/3012511628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c153890 0x7f119c15d950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 -- 172.21.15.107:0/3012511628 >> 172.21.15.107:0/3012511628 conn(0x7f119c06ba00 msgr2=0x7f119c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:19.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 -- 172.21.15.107:0/3012511628 shutdown_connections 2023-12-16T01:26:19.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.727+0000 7f11a38c9640 1 -- 172.21.15.107:0/3012511628 wait complete. 2023-12-16T01:26:19.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 Processor -- start 2023-12-16T01:26:19.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 -- start start 2023-12-16T01:26:19.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 0x7f119c146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f119c153890 0x7f119c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119c153c70 0x7f119c144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0b3e50 con 0x7f119c153c70 2023-12-16T01:26:19.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c1554a0 con 0x7f119c0ceef0 2023-12-16T01:26:19.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.729+0000 7f11a38c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c156f50 con 0x7f119c153890 2023-12-16T01:26:19.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.730+0000 7f11a1665640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 0x7f119c146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.730+0000 7f11a0e64640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f119c153890 0x7f119c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.730+0000 7f11a1665640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 0x7f119c146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47306/0 (socket says 172.21.15.107:47306) 2023-12-16T01:26:19.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.730+0000 7f11a1665640 1 -- 172.21.15.107:0/2676583899 learned_addr learned my addr 172.21.15.107:0/2676583899 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:19.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.733+0000 7f11a1665640 1 -- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f119c153890 msgr2=0x7f119c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.733+0000 7f11a1665640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f119c153890 0x7f119c156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.733+0000 7f11a1665640 1 -- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119c153c70 msgr2=0x7f119c144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:19.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.733+0000 7f11a1665640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119c153c70 0x7f119c144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:19.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.733+0000 7f11a1665640 1 -- 172.21.15.107:0/2676583899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980094d0 con 0x7f119c0ceef0 2023-12-16T01:26:19.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.736+0000 7f11a1665640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 0x7f119c146640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:19.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.739+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198030830 con 0x7f119c0ceef0 2023-12-16T01:26:19.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.739+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198043400 con 0x7f119c0ceef0 2023-12-16T01:26:19.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.739+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980437b0 con 0x7f119c0ceef0 2023-12-16T01:26:19.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.739+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c154130 con 0x7f119c0ceef0 2023-12-16T01:26:19.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.740+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c155130 con 0x7f119c0ceef0 2023-12-16T01:26:19.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.740+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c154f20 con 0x7f119c0ceef0 2023-12-16T01:26:19.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.758+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1198043910 con 0x7f119c0ceef0 2023-12-16T01:26:19.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.759+0000 7f118dffb640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f118006ae70 0x7f118006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:19.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.759+0000 7f11a0e64640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f118006ae70 0x7f118006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:19.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.759+0000 7f11a0e64640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f118006ae70 0x7f118006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f119c1492e0 tx=0x7f1190007e30 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:19.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:19.762+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f119803e070 con 0x7f119c0ceef0 2023-12-16T01:26:20.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.015+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1198078480 con 0x7f119c0ceef0 2023-12-16T01:26:20.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.240+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f119c067500 con 0x7f119c0ceef0 2023-12-16T01:26:20.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.386+0000 7f118dffb640 1 -- 172.21.15.107:0/2676583899 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) v1 ==== 74+0+171040 (secure 0 0 0) 0x7f119807baa0 con 0x7f119c0ceef0 2023-12-16T01:26:20.389 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f118006ae70 msgr2=0x7f118006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f118006ae70 0x7f118006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f119c1492e0 tx=0x7f1190007e30 comp rx=0 tx=0).stop 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 msgr2=0x7f119c146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 0x7f119c146640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198004730 comp rx=0 tx=0).stop 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 shutdown_connections 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119c153c70 0x7f119c144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f119c153890 0x7f119c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f118006ae70 0x7f118006d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 --2- 172.21.15.107:0/2676583899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f119c0ceef0 0x7f119c146640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 >> 172.21.15.107:0/2676583899 conn(0x7f119c06ba00 msgr2=0x7f119c157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 shutdown_connections 2023-12-16T01:26:20.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.389+0000 7f11a38c9640 1 -- 172.21.15.107:0/2676583899 wait complete. 2023-12-16T01:26:20.401 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":7,"active_gid":4182,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":3457421284},{"type":"v1","addr":"172.21.15.107:6833","nonce":3457421284}]},"active_addr":"172.21.15.107:6833/3457421284","active_change":"2023-12-16T01:25:29.428487+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":11,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":570163039}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2881280751}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3505030968}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":857893584}]}]} 2023-12-16T01:26:20.405 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-16T01:26:20.405 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-16T01:26:20.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:20.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.504+0000 7f558ab9e640 1 Processor -- start 2023-12-16T01:26:20.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.504+0000 7f558ab9e640 1 -- start start 2023-12-16T01:26:20.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.505+0000 7f558ab9e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5584153be0 0x7f5584159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:20.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.505+0000 7f558ab9e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f558406fa00 0x7f55840c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:20.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.505+0000 7f558ab9e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5584153fc0 con 0x7f55840c5e60 2023-12-16T01:26:20.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.505+0000 7f558ab9e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840c3340 con 0x7f5584153be0 2023-12-16T01:26:20.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.505+0000 7f558ab9e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558406b7b0 con 0x7f558406fa00 2023-12-16T01:26:20.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.505+0000 7f558893a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5584153be0 0x7f5584159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:20.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.506+0000 7f558893a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5584153be0 0x7f5584159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41282/0 (socket says 172.21.15.107:41282) 2023-12-16T01:26:20.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.506+0000 7f558893a640 1 -- 172.21.15.107:0/2384775380 learned_addr learned my addr 172.21.15.107:0/2384775380 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:20.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.508+0000 7f558893a640 1 -- 172.21.15.107:0/2384775380 >> v2:172.21.15.157:3300/0 conn(0x7f558406fa00 msgr2=0x7f55840c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:20.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.508+0000 7f558893a640 1 --2- 172.21.15.107:0/2384775380 >> v2:172.21.15.157:3300/0 conn(0x7f558406fa00 0x7f55840c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.508+0000 7f558893a640 1 -- 172.21.15.107:0/2384775380 >> v1:172.21.15.157:6789/0 conn(0x7f55840c5e60 legacy=0x7f558406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:20.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.508+0000 7f558893a640 1 -- 172.21.15.107:0/2384775380 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558406ba90 con 0x7f5584153be0 2023-12-16T01:26:20.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.511+0000 7f558893a640 1 --2- 172.21.15.107:0/2384775380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 0x7f5584159890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55840610b0 tx=0x7f557802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de5a1f0663fa3cf server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:20.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.521+0000 7f55837fe640 1 -- 172.21.15.107:0/2384775380 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578031870 con 0x7f5584153be0 2023-12-16T01:26:20.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.521+0000 7f55837fe640 1 -- 172.21.15.107:0/2384775380 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55780319d0 con 0x7f5584153be0 2023-12-16T01:26:20.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.521+0000 7f55837fe640 1 -- 172.21.15.107:0/2384775380 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578031d60 con 0x7f5584153be0 2023-12-16T01:26:20.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 -- 172.21.15.107:0/2384775380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 msgr2=0x7f5584159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:20.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2384775380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 0x7f5584159890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55840610b0 tx=0x7f557802b910 comp rx=0 tx=0).stop 2023-12-16T01:26:20.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 -- 172.21.15.107:0/2384775380 shutdown_connections 2023-12-16T01:26:20.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2384775380 >> v2:172.21.15.157:3300/0 conn(0x7f558406fa00 0x7f55840c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2384775380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 0x7f5584159890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 -- 172.21.15.107:0/2384775380 >> 172.21.15.107:0/2384775380 conn(0x7f55840c7f60 msgr2=0x7f55840c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:20.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 -- 172.21.15.107:0/2384775380 shutdown_connections 2023-12-16T01:26:20.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.522+0000 7f558ab9e640 1 -- 172.21.15.107:0/2384775380 wait complete. 2023-12-16T01:26:20.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.523+0000 7f558ab9e640 1 Processor -- start 2023-12-16T01:26:20.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.523+0000 7f558ab9e640 1 -- start start 2023-12-16T01:26:20.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.524+0000 7f558ab9e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 0x7f558414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:20.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.524+0000 7f558ab9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55840c5e60 0x7f5584144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:20.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.524+0000 7f558ab9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 0x7f558414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:20.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.524+0000 7f558ab9e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841f0750 con 0x7f5584153be0 2023-12-16T01:26:20.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.524+0000 7f558ab9e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841ef8a0 con 0x7f558406fa00 2023-12-16T01:26:20.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.524+0000 7f558ab9e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55841efad0 con 0x7f55840c5e60 2023-12-16T01:26:20.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.525+0000 7f558893a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 0x7f558414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:20.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.525+0000 7f5583fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55840c5e60 0x7f5584144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:20.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.525+0000 7f558893a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 0x7f558414b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47316/0 (socket says 172.21.15.107:47316) 2023-12-16T01:26:20.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.525+0000 7f558893a640 1 -- 172.21.15.107:0/2315944175 learned_addr learned my addr 172.21.15.107:0/2315944175 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:20.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.529+0000 7f5583fff640 1 -- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 msgr2=0x7f558414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:20.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.529+0000 7f5583fff640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 0x7f558414b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.529+0000 7f5583fff640 1 -- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 msgr2=0x7f558414a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:20.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.529+0000 7f5583fff640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 0x7f558414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:20.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.529+0000 7f5583fff640 1 -- 172.21.15.107:0/2315944175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780094d0 con 0x7f55840c5e60 2023-12-16T01:26:20.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.529+0000 7f558893a640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 0x7f558414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:20.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.531+0000 7f5583fff640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55840c5e60 0x7f5584144030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f557000b420 tx=0x7f557000b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:20.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.586+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011830 con 0x7f55840c5e60 2023-12-16T01:26:20.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.586+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570011990 con 0x7f55840c5e60 2023-12-16T01:26:20.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.586+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55841efdb0 con 0x7f55840c5e60 2023-12-16T01:26:20.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.586+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011d40 con 0x7f55840c5e60 2023-12-16T01:26:20.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.586+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55841f0370 con 0x7f55840c5e60 2023-12-16T01:26:20.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.587+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584152700 con 0x7f55840c5e60 2023-12-16T01:26:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.607+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f557001b460 con 0x7f55840c5e60 2023-12-16T01:26:20.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.607+0000 7f55817fa640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f556806aec0 0x7f556806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:20.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.607+0000 7f558893a640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f556806aec0 0x7f556806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:20.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.607+0000 7f558893a640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f556806aec0 0x7f556806d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f557802b950 tx=0x7f557803c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:20.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.836+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5570059240 con 0x7f55840c5e60 2023-12-16T01:26:20.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:20.847+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5570054e80 con 0x7f55840c5e60 2023-12-16T01:26:21.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.020+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5584067500 con 0x7f55840c5e60 2023-12-16T01:26:21.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.070+0000 7f55817fa640 1 -- 172.21.15.107:0/2315944175 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7f55700584a0 con 0x7f55840c5e60 2023-12-16T01:26:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:21.071 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.071+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f556806aec0 msgr2=0x7f556806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.071+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f556806aec0 0x7f556806d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f557802b950 tx=0x7f557803c040 comp rx=0 tx=0).stop 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.071+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55840c5e60 msgr2=0x7f5584144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55840c5e60 0x7f5584144030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f557000b420 tx=0x7f557000b8e0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 shutdown_connections 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5584153be0 0x7f558414a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55840c5e60 0x7f5584144030 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f556806aec0 0x7f556806d380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 --2- 172.21.15.107:0/2315944175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f558406fa00 0x7f558414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 >> 172.21.15.107:0/2315944175 conn(0x7f55840c7f60 msgr2=0x7f55840c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 shutdown_connections 2023-12-16T01:26:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.072+0000 7f558ab9e640 1 -- 172.21.15.107:0/2315944175 wait complete. 2023-12-16T01:26:21.084 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-16T01:26:21.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:21.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.182+0000 7ff61bfde640 1 Processor -- start 2023-12-16T01:26:21.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.182+0000 7ff61bfde640 1 -- start start 2023-12-16T01:26:21.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.183+0000 7ff61bfde640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6141504e0 0x7ff61406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.183+0000 7ff61bfde640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff6140c7190 0x7ff61406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.183+0000 7ff61bfde640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140c5f60 con 0x7ff6140c7700 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.183+0000 7ff61bfde640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6140c2c60 con 0x7ff6140c7190 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.183+0000 7ff61bfde640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140c2f20 con 0x7ff6141504e0 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.184+0000 7ff61a57b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff6140c7700 0x7ff6140c7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57418/0 (socket says 172.21.15.107:57418) 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.184+0000 7ff61a57b640 1 -- 172.21.15.107:0/490910844 learned_addr learned my addr 172.21.15.107:0/490910844 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.184+0000 7ff619d7a640 1 --2- 172.21.15.107:0/490910844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6141504e0 0x7ff61406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.184+0000 7ff619579640 1 --2- 172.21.15.107:0/490910844 >> v2:172.21.15.157:3300/0 conn(0x7ff6140c7190 0x7ff61406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.186+0000 7ff618d78640 1 -- 172.21.15.107:0/490910844 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980704078 0 0) 0x7ff6140c5f60 con 0x7ff6140c7700 2023-12-16T01:26:21.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.186+0000 7ff618d78640 1 -- 172.21.15.107:0/490910844 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff600003520 con 0x7ff6140c7700 2023-12-16T01:26:21.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.186+0000 7ff619d7a640 1 -- 172.21.15.107:0/490910844 >> v2:172.21.15.157:3300/0 conn(0x7ff6140c7190 msgr2=0x7ff61406e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.186+0000 7ff619d7a640 1 --2- 172.21.15.107:0/490910844 >> v2:172.21.15.157:3300/0 conn(0x7ff6140c7190 0x7ff61406e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.186+0000 7ff619d7a640 1 -- 172.21.15.107:0/490910844 >> v1:172.21.15.107:6789/0 conn(0x7ff6140c7700 legacy=0x7ff6140c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.186+0000 7ff619d7a640 1 -- 172.21.15.107:0/490910844 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140c61b0 con 0x7ff6141504e0 2023-12-16T01:26:21.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.189+0000 7ff619d7a640 1 --2- 172.21.15.107:0/490910844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6141504e0 0x7ff61406e1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff610009d90 tx=0x7ff61002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c00b494349cf146 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.192+0000 7ff618d78640 1 -- 172.21.15.107:0/490910844 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61002cbc0 con 0x7ff6141504e0 2023-12-16T01:26:21.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.192+0000 7ff618d78640 1 -- 172.21.15.107:0/490910844 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61002cd20 con 0x7ff6141504e0 2023-12-16T01:26:21.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.192+0000 7ff618d78640 1 -- 172.21.15.107:0/490910844 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610034660 con 0x7ff6141504e0 2023-12-16T01:26:21.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 -- 172.21.15.107:0/490910844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6141504e0 msgr2=0x7ff61406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 --2- 172.21.15.107:0/490910844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6141504e0 0x7ff61406e1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff610009d90 tx=0x7ff61002be10 comp rx=0 tx=0).stop 2023-12-16T01:26:21.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 -- 172.21.15.107:0/490910844 shutdown_connections 2023-12-16T01:26:21.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 --2- 172.21.15.107:0/490910844 >> v2:172.21.15.157:3300/0 conn(0x7ff6140c7190 0x7ff61406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 --2- 172.21.15.107:0/490910844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6141504e0 0x7ff61406e1a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 -- 172.21.15.107:0/490910844 >> 172.21.15.107:0/490910844 conn(0x7ff6140cbef0 msgr2=0x7ff6140cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 -- 172.21.15.107:0/490910844 shutdown_connections 2023-12-16T01:26:21.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.193+0000 7ff61bfde640 1 -- 172.21.15.107:0/490910844 wait complete. 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.194+0000 7ff61bfde640 1 Processor -- start 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.194+0000 7ff61bfde640 1 -- start start 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61bfde640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6140c7190 0x7ff614159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61bfde640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6140c7700 0x7ff614147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61bfde640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 0x7ff614143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61bfde640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141eca10 con 0x7ff6141504e0 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61bfde640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141585a0 con 0x7ff6140c7190 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61bfde640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff614158840 con 0x7ff6140c7700 2023-12-16T01:26:21.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.195+0000 7ff61a57b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 0x7ff614143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.196+0000 7ff61a57b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 0x7ff614143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41310/0 (socket says 172.21.15.107:41310) 2023-12-16T01:26:21.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.196+0000 7ff61a57b640 1 -- 172.21.15.107:0/4114629706 learned_addr learned my addr 172.21.15.107:0/4114629706 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.196+0000 7ff619d7a640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6140c7190 0x7ff614159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.196+0000 7ff619579640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6140c7700 0x7ff614147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.199+0000 7ff61a57b640 1 -- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6140c7700 msgr2=0x7ff614147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.199+0000 7ff61a57b640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6140c7700 0x7ff614147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.199+0000 7ff61a57b640 1 -- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6140c7190 msgr2=0x7ff614159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.199+0000 7ff61a57b640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6140c7190 0x7ff614159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.199+0000 7ff61a57b640 1 -- 172.21.15.107:0/4114629706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009a70 con 0x7ff6141504e0 2023-12-16T01:26:21.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.201+0000 7ff61a57b640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 0x7ff614143840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c430 tx=0x7ff60c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.203+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c005ce0 con 0x7ff6141504e0 2023-12-16T01:26:21.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.203+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff614158b20 con 0x7ff6141504e0 2023-12-16T01:26:21.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.203+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6141590e0 con 0x7ff6141504e0 2023-12-16T01:26:21.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.204+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6141ecb80 con 0x7ff6141504e0 2023-12-16T01:26:21.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.205+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c005e40 con 0x7ff6141504e0 2023-12-16T01:26:21.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.205+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c007ea0 con 0x7ff6141504e0 2023-12-16T01:26:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.451+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff60c007270 con 0x7ff6141504e0 2023-12-16T01:26:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.451+0000 7ff60a7fc640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff5f806ae70 0x7ff5f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.451+0000 7ff619d7a640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff5f806ae70 0x7ff5f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.451+0000 7ff619d7a640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff5f806ae70 0x7ff5f806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff610036000 tx=0x7ff610030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.463+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff60c058070 con 0x7ff6141504e0 2023-12-16T01:26:21.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.463+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff60c057e40 con 0x7ff6141504e0 2023-12-16T01:26:21.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.636+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6141ecb50 con 0x7ff6141504e0 2023-12-16T01:26:21.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.672+0000 7ff60a7fc640 1 -- 172.21.15.107:0/4114629706 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7ff60c017090 con 0x7ff6141504e0 2023-12-16T01:26:21.674 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:21.674 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:21.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff5f806ae70 msgr2=0x7ff5f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff5f806ae70 0x7ff5f806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff610036000 tx=0x7ff610030000 comp rx=0 tx=0).stop 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 msgr2=0x7ff614143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 0x7ff614143840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c430 tx=0x7ff60c00c8f0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 shutdown_connections 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6141504e0 0x7ff614143840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6140c7700 0x7ff614147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff5f806ae70 0x7ff5f806d330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 --2- 172.21.15.107:0/4114629706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6140c7190 0x7ff614159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 >> 172.21.15.107:0/4114629706 conn(0x7ff6140cbef0 msgr2=0x7ff61406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 shutdown_connections 2023-12-16T01:26:21.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.674+0000 7ff61bfde640 1 -- 172.21.15.107:0/4114629706 wait complete. 2023-12-16T01:26:21.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-16T01:26:21.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-16T01:26:21.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-16T01:26:21.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-16T01:26:21.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-16T01:26:21.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-16T01:26:21.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-16T01:26:21.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-16T01:26:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.871+0000 7f673101a640 1 Processor -- start 2023-12-16T01:26:21.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.871+0000 7f673101a640 1 -- start start 2023-12-16T01:26:21.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f673101a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f672c157840 0x7f672c0c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f673101a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c161c20 con 0x7f672c1617f0 2023-12-16T01:26:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f673101a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c15dd90 con 0x7f672c071d60 2023-12-16T01:26:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f673101a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c15dff0 con 0x7f672c157840 2023-12-16T01:26:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.872+0000 7f447cc15640 1 Processor -- start 2023-12-16T01:26:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.872+0000 7f447cc15640 1 -- start start 2023-12-16T01:26:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f447cc15640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f44780721d0 0x7f4478071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f447cc15640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f44780c24d0 0x7f4478071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f447cc15640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447806be00 con 0x7f447814fd60 2023-12-16T01:26:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f447cc15640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780c77c0 con 0x7f44780c24d0 2023-12-16T01:26:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.873+0000 7f447cc15640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780c7aa0 con 0x7f44780721d0 2023-12-16T01:26:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f6730819640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f672c1617f0 0x7f672c0c73f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57422/0 (socket says 172.21.15.107:57422) 2023-12-16T01:26:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f6730819640 1 -- 172.21.15.107:0/1827925183 learned_addr learned my addr 172.21.15.107:0/1827925183 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f672bfff640 1 --2- 172.21.15.107:0/1827925183 >> v2:172.21.15.157:3300/0 conn(0x7f672c157840 0x7f672c0c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f4476d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f44780c24d0 0x7f4478071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f4475d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f44780721d0 0x7f4478071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f4476d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f44780c24d0 0x7f4478071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41320/0 (socket says 172.21.15.107:41320) 2023-12-16T01:26:21.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.875+0000 7f4476d9d640 1 -- 172.21.15.107:0/4157737224 learned_addr learned my addr 172.21.15.107:0/4157737224 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.879+0000 7f4476d9d640 1 -- 172.21.15.107:0/4157737224 >> v2:172.21.15.157:3300/0 conn(0x7f44780721d0 msgr2=0x7f4478071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.879+0000 7f4476d9d640 1 --2- 172.21.15.107:0/4157737224 >> v2:172.21.15.157:3300/0 conn(0x7f44780721d0 0x7f4478071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.879+0000 7f4476d9d640 1 -- 172.21.15.107:0/4157737224 >> v1:172.21.15.107:6789/0 conn(0x7f447814fd60 legacy=0x7f4478159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.880+0000 7f4476d9d640 1 -- 172.21.15.107:0/4157737224 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780c7d80 con 0x7f44780c24d0 2023-12-16T01:26:21.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.882+0000 7f4f45bd7640 1 Processor -- start 2023-12-16T01:26:21.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.882+0000 7f8817506640 1 Processor -- start 2023-12-16T01:26:21.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.882+0000 7f4f45bd7640 1 -- start start 2023-12-16T01:26:21.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.882+0000 7f8817506640 1 -- start start 2023-12-16T01:26:21.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f8817506640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f88080e3770 0x7f880804be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f8817506640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8808045420 con 0x7f88080dd390 2023-12-16T01:26:21.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f8817506640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8808045fa0 con 0x7f880804ba30 2023-12-16T01:26:21.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f8817506640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808046b40 con 0x7f88080e3770 2023-12-16T01:26:21.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.883+0000 7f4f45bd7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f380dd3c0 0x7f4f38046460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.883+0000 7f4f45bd7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 0x7f4f3804be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.883+0000 7f4f45bd7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4f380e3090 0x7f4f380e3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f4f45bd7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f38045450 con 0x7f4f380dd3c0 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f4f45bd7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f38045fd0 con 0x7f4f380e3090 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f4f45bd7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380dd7a0 con 0x7f4f3804ba60 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f672bfff640 1 -- 172.21.15.107:0/1827925183 >> v1:172.21.15.157:6789/0 conn(0x7f672c071d60 legacy=0x7f672c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f672bfff640 1 -- 172.21.15.107:0/1827925183 >> v1:172.21.15.107:6789/0 conn(0x7f672c1617f0 legacy=0x7f672c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.884+0000 7f672bfff640 1 -- 172.21.15.107:0/1827925183 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c15e2d0 con 0x7f672c157840 2023-12-16T01:26:21.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.885+0000 7f4f3effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 0x7f4f3804be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.885+0000 7f4f3effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 0x7f4f3804be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33390/0 (socket says 172.21.15.107:33390) 2023-12-16T01:26:21.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.885+0000 7f4f3effd640 1 -- 172.21.15.107:0/3451292146 learned_addr learned my addr 172.21.15.107:0/3451292146 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.885+0000 7f4f3f7fe640 1 --2- 172.21.15.107:0/3451292146 >> v2:172.21.15.107:3300/0 conn(0x7f4f380dd3c0 0x7f4f38046460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.888+0000 7f4476d9d640 1 --2- 172.21.15.107:0/4157737224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780c24d0 0x7f4478071b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44780c9440 tx=0x7f447002e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a9735ad903f5b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.888+0000 7f4f3effd640 1 -- 172.21.15.107:0/3451292146 >> v2:172.21.15.157:3300/0 conn(0x7f4f380e3090 msgr2=0x7f4f380e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.888+0000 7f4f3effd640 1 --2- 172.21.15.107:0/3451292146 >> v2:172.21.15.157:3300/0 conn(0x7f4f380e3090 0x7f4f380e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.888+0000 7f4f3effd640 1 -- 172.21.15.107:0/3451292146 >> v2:172.21.15.107:3300/0 conn(0x7f4f380dd3c0 msgr2=0x7f4f38046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.888+0000 7f4f3effd640 1 --2- 172.21.15.107:0/3451292146 >> v2:172.21.15.107:3300/0 conn(0x7f4f380dd3c0 0x7f4f38046460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.888+0000 7f4f3effd640 1 -- 172.21.15.107:0/3451292146 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380e3e90 con 0x7f4f3804ba60 2023-12-16T01:26:21.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.890+0000 7f672bfff640 1 --2- 172.21.15.107:0/1827925183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 0x7f672c0c59f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f671c0097a0 tx=0x7f671c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f368e0db076fe30 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.890+0000 7f8815d03640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f880804ba30 0x7f88080e3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:34932/0 (socket says 172.21.15.107:34932) 2023-12-16T01:26:21.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.890+0000 7f8815d03640 1 -- 172.21.15.107:0/1095902268 learned_addr learned my addr 172.21.15.107:0/1095902268 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:21.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.890+0000 7f4f3effd640 1 --2- 172.21.15.107:0/3451292146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 0x7f4f3804be80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f38033e70 tx=0x7f4f2c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b68218d7551e92 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.891+0000 7f8816d05640 1 --2- 172.21.15.107:0/1095902268 >> v2:172.21.15.157:3300/0 conn(0x7f88080e3770 0x7f880804be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.893+0000 7f0b4a42e640 1 Processor -- start 2023-12-16T01:26:21.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.893+0000 7f0b4a42e640 1 -- start start 2023-12-16T01:26:21.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.894+0000 7f4f3e7fc640 1 -- 172.21.15.107:0/3451292146 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c031870 con 0x7f4f3804ba60 2023-12-16T01:26:21.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.894+0000 7fd2626e0640 1 Processor -- start 2023-12-16T01:26:21.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.894+0000 7f4f3e7fc640 1 -- 172.21.15.107:0/3451292146 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0319d0 con 0x7f4f3804ba60 2023-12-16T01:26:21.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f0b4a42e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0b3c0dd5f0 0x7f0b3c0def50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7fd2626e0640 1 -- start start 2023-12-16T01:26:21.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f0b4a42e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 0x7f0b3c0df490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.894+0000 7f4f3e7fc640 1 -- 172.21.15.107:0/3451292146 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c031d60 con 0x7f4f3804ba60 2023-12-16T01:26:21.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f0b4a42e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0092a0 con 0x7f0b3c0d5df0 2023-12-16T01:26:21.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f0b4a42e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c0d61d0 con 0x7f0b3c0dd5f0 2023-12-16T01:26:21.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f0b4a42e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c04cbe0 con 0x7f0b3c04c630 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 -- 172.21.15.107:0/3451292146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 msgr2=0x7f4f3804be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/3451292146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 0x7f4f3804be80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f38033e70 tx=0x7f4f2c02b910 comp rx=0 tx=0).stop 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 -- 172.21.15.107:0/3451292146 shutdown_connections 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/3451292146 >> v2:172.21.15.157:3300/0 conn(0x7f4f380e3090 0x7f4f380e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/3451292146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f3804ba60 0x7f4f3804be80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/3451292146 >> v2:172.21.15.107:3300/0 conn(0x7f4f380dd3c0 0x7f4f38046460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 -- 172.21.15.107:0/3451292146 >> 172.21.15.107:0/3451292146 conn(0x7f4f38050180 msgr2=0x7f4f38050590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.895+0000 7f4f45bd7640 1 -- 172.21.15.107:0/3451292146 shutdown_connections 2023-12-16T01:26:21.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.896+0000 7f4f45bd7640 1 -- 172.21.15.107:0/3451292146 wait complete. 2023-12-16T01:26:21.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.896+0000 7fd2626e0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 0x7fd25c159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.896+0000 7fd2626e0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd25c0c24d0 0x7fd25c159560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.896+0000 7fd2626e0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c06be00 con 0x7fd25c0721d0 2023-12-16T01:26:21.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.896+0000 7fd2626e0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0c77c0 con 0x7fd25c0c24d0 2023-12-16T01:26:21.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.896+0000 7fd2626e0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0c7aa0 con 0x7fd25c14fd60 2023-12-16T01:26:21.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.897+0000 7f0b49c2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 0x7f0b3c0df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7f4f45bd7640 1 Processor -- start 2023-12-16T01:26:21.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7fd25bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 0x7fd25c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7f8815502640 1 -- 172.21.15.107:0/1095902268 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057792190 0 0) 0x7f8808045fa0 con 0x7f880804ba30 2023-12-16T01:26:21.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7f8815502640 1 -- 172.21.15.107:0/1095902268 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc003520 con 0x7f880804ba30 2023-12-16T01:26:21.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7f4f45bd7640 1 -- start start 2023-12-16T01:26:21.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7f0b49c2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 0x7f0b3c0df490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33396/0 (socket says 172.21.15.107:33396) 2023-12-16T01:26:21.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3971037913 learned_addr learned my addr 172.21.15.107:0/3971037913 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7fd25bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 0x7fd25c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33402/0 (socket says 172.21.15.107:33402) 2023-12-16T01:26:21.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.898+0000 7fd25bfff640 1 -- 172.21.15.107:0/2767386341 learned_addr learned my addr 172.21.15.107:0/2767386341 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7fd260c7d640 1 --2- 172.21.15.107:0/2767386341 >> v2:172.21.15.107:3300/0 conn(0x7fd25c0c24d0 0x7fd25c159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7f4f45bd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f3804ba60 0x7f4f380cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7f4f45bd7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380dd3c0 0x7f4f380b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7f4f45bd7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f380e3090 0x7f4f380cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7f4f45bd7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380b7ed0 con 0x7f4f3804ba60 2023-12-16T01:26:21.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7f4f45bd7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380ccd90 con 0x7f4f380e3090 2023-12-16T01:26:21.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.899+0000 7f4f45bd7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3804f3e0 con 0x7f4f380dd3c0 2023-12-16T01:26:21.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.900+0000 7f1ed39a9640 1 Processor -- start 2023-12-16T01:26:21.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.900+0000 7f1ed39a9640 1 -- start start 2023-12-16T01:26:21.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f8816d05640 1 -- 172.21.15.107:0/1095902268 >> v1:172.21.15.157:6789/0 conn(0x7f880804ba30 legacy=0x7f88080e3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f8816d05640 1 -- 172.21.15.107:0/1095902268 >> v1:172.21.15.107:6789/0 conn(0x7f88080dd390 legacy=0x7f8808046430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f1ed39a9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1ecc1516c0 0x7f1ecc15b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f1ed39a9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0c79f0 0x7f1ecc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f1ed39a9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc158440 con 0x7f1ecc0ca280 2023-12-16T01:26:21.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f1ed39a9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c3c50 con 0x7f1ecc1516c0 2023-12-16T01:26:21.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f1ed39a9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc15b950 con 0x7f1ecc0c79f0 2023-12-16T01:26:21.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f8816d05640 1 -- 172.21.15.107:0/1095902268 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080dd770 con 0x7f88080e3770 2023-12-16T01:26:21.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f672affd640 1 -- 172.21.15.107:0/1827925183 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0317c0 con 0x7f672c157840 2023-12-16T01:26:21.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f672affd640 1 -- 172.21.15.107:0/1827925183 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c031920 con 0x7f672c157840 2023-12-16T01:26:21.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.901+0000 7f672affd640 1 -- 172.21.15.107:0/1827925183 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c031cf0 con 0x7f672c157840 2023-12-16T01:26:21.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3971037913 >> v2:172.21.15.157:3300/0 conn(0x7f0b3c0dd5f0 msgr2=0x7f0b3c0def50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f0b49c2d640 1 --2- 172.21.15.107:0/3971037913 >> v2:172.21.15.157:3300/0 conn(0x7f0b3c0dd5f0 0x7f0b3c0def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3971037913 >> v1:172.21.15.157:6789/0 conn(0x7f0b3c0d5df0 legacy=0x7f0b3c0dcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3971037913 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c04e970 con 0x7f0b3c04c630 2023-12-16T01:26:21.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 -- 172.21.15.107:0/1827925183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 msgr2=0x7f672c0c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 --2- 172.21.15.107:0/1827925183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 0x7f672c0c59f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f671c0097a0 tx=0x7f671c02b860 comp rx=0 tx=0).stop 2023-12-16T01:26:21.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 -- 172.21.15.107:0/1827925183 shutdown_connections 2023-12-16T01:26:21.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 --2- 172.21.15.107:0/1827925183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 0x7f672c0c59f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 -- 172.21.15.107:0/1827925183 >> 172.21.15.107:0/1827925183 conn(0x7f672c06a500 msgr2=0x7f672c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 -- 172.21.15.107:0/1827925183 shutdown_connections 2023-12-16T01:26:21.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.902+0000 7f673101a640 1 -- 172.21.15.107:0/1827925183 wait complete. 2023-12-16T01:26:21.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.904+0000 7f673101a640 1 Processor -- start 2023-12-16T01:26:21.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.904+0000 7fd25bfff640 1 -- 172.21.15.107:0/2767386341 >> v2:172.21.15.107:3300/0 conn(0x7fd25c0c24d0 msgr2=0x7fd25c159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.904+0000 7fd25bfff640 1 --2- 172.21.15.107:0/2767386341 >> v2:172.21.15.107:3300/0 conn(0x7fd25c0c24d0 0x7fd25c159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.904+0000 7fd25bfff640 1 -- 172.21.15.107:0/2767386341 >> v1:172.21.15.107:6789/0 conn(0x7fd25c0721d0 legacy=0x7fd25c071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.904+0000 7fd25bfff640 1 -- 172.21.15.107:0/2767386341 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0c7d80 con 0x7fd25c14fd60 2023-12-16T01:26:21.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.904+0000 7f673101a640 1 -- start start 2023-12-16T01:26:21.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f4f3effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380dd3c0 0x7f4f380b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f673101a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f672c071d60 0x7f672c15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f673101a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 0x7f672c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f4f3ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f380e3090 0x7f4f380cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f673101a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f672c1617f0 0x7f672c1f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f673101a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1f7ad0 con 0x7f672c1617f0 2023-12-16T01:26:21.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f673101a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1589b0 con 0x7f672c157840 2023-12-16T01:26:21.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.905+0000 7f673101a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1f6c40 con 0x7f672c071d60 2023-12-16T01:26:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.906+0000 7f4f3effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380dd3c0 0x7f4f380b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33418/0 (socket says 172.21.15.107:33418) 2023-12-16T01:26:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.906+0000 7f4f3effd640 1 -- 172.21.15.107:0/1504745435 learned_addr learned my addr 172.21.15.107:0/1504745435 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.907+0000 7f0b49c2d640 1 --2- 172.21.15.107:0/3971037913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 0x7f0b3c0df490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0b4402cee0 tx=0x7f0b440a6340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92dc79b9463a44c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.909+0000 7fd25bfff640 1 --2- 172.21.15.107:0/2767386341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 0x7fd25c159020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd24400bb00 tx=0x7fd24402dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238cb8d0494083e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.909+0000 7f447559a640 1 -- 172.21.15.107:0/4157737224 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447002ecb0 con 0x7f44780c24d0 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.909+0000 7f447559a640 1 -- 172.21.15.107:0/4157737224 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447002ee10 con 0x7f44780c24d0 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.909+0000 7f447559a640 1 -- 172.21.15.107:0/4157737224 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470036610 con 0x7f44780c24d0 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 -- 172.21.15.107:0/4157737224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780c24d0 msgr2=0x7f4478071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 --2- 172.21.15.107:0/4157737224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780c24d0 0x7f4478071b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44780c9440 tx=0x7f447002e110 comp rx=0 tx=0).stop 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 -- 172.21.15.107:0/4157737224 shutdown_connections 2023-12-16T01:26:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 --2- 172.21.15.107:0/4157737224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780c24d0 0x7f4478071b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 --2- 172.21.15.107:0/4157737224 >> v2:172.21.15.157:3300/0 conn(0x7f44780721d0 0x7f4478071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 -- 172.21.15.107:0/4157737224 >> 172.21.15.107:0/4157737224 conn(0x7f44780c80b0 msgr2=0x7f44780c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 -- 172.21.15.107:0/4157737224 shutdown_connections 2023-12-16T01:26:21.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f447cc15640 1 -- 172.21.15.107:0/4157737224 wait complete. 2023-12-16T01:26:21.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f4f3f7fe640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f3804ba60 0x7f4f380cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.910+0000 7f1ed1745640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1ecc1516c0 0x7f1ecc15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f4f3effd640 1 -- 172.21.15.107:0/1504745435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f380e3090 msgr2=0x7f4f380cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f4f3effd640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f380e3090 0x7f4f380cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f447cc15640 1 Processor -- start 2023-12-16T01:26:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f4f3effd640 1 -- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f3804ba60 msgr2=0x7f4f380cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f4f3effd640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f3804ba60 0x7f4f380cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f4f3effd640 1 -- 172.21.15.107:0/1504745435 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0094d0 con 0x7f4f380dd3c0 2023-12-16T01:26:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.911+0000 7f447cc15640 1 -- start start 2023-12-16T01:26:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f1ed1745640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1ecc1516c0 0x7f1ecc15b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41376/0 (socket says 172.21.15.107:41376) 2023-12-16T01:26:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f1ed1745640 1 -- 172.21.15.107:0/3657435318 learned_addr learned my addr 172.21.15.107:0/3657435318 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f447cc15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780721d0 0x7f44781f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f447cc15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44780c24d0 0x7f44781435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f447cc15640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f447814fd60 0x7f447806f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f447cc15640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44781f37c0 con 0x7f44780721d0 2023-12-16T01:26:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f447cc15640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c9ef0 con 0x7f447814fd60 2023-12-16T01:26:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.912+0000 7f447cc15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780ca7d0 con 0x7f44780c24d0 2023-12-16T01:26:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.916+0000 7f0b3bfff640 1 -- 172.21.15.107:0/3971037913 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440ae640 con 0x7f0b3c04c630 2023-12-16T01:26:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.916+0000 7fd25affd640 1 -- 172.21.15.107:0/2767386341 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24402ec50 con 0x7fd25c14fd60 2023-12-16T01:26:21.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.917+0000 7f1ed1745640 1 -- 172.21.15.107:0/3657435318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0c79f0 msgr2=0x7f1ecc070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.917+0000 7f1ed1745640 1 --2- 172.21.15.107:0/3657435318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0c79f0 0x7f1ecc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.917+0000 7f1ed1745640 1 -- 172.21.15.107:0/3657435318 >> v1:172.21.15.107:6789/0 conn(0x7f1ecc0ca280 legacy=0x7f1ecc0c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.917+0000 7f1ed1745640 1 -- 172.21.15.107:0/3657435318 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc157550 con 0x7f1ecc1516c0 2023-12-16T01:26:21.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.919+0000 7fd25affd640 1 -- 172.21.15.107:0/2767386341 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244032070 con 0x7fd25c14fd60 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.919+0000 7fd25affd640 1 -- 172.21.15.107:0/2767386341 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24402ec50 con 0x7fd25c14fd60 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 -- 172.21.15.107:0/2767386341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 msgr2=0x7fd25c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 --2- 172.21.15.107:0/2767386341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 0x7fd25c159020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd24400bb00 tx=0x7fd24402dea0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 -- 172.21.15.107:0/2767386341 shutdown_connections 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 --2- 172.21.15.107:0/2767386341 >> v2:172.21.15.107:3300/0 conn(0x7fd25c0c24d0 0x7fd25c159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 --2- 172.21.15.107:0/2767386341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c14fd60 0x7fd25c159020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 -- 172.21.15.107:0/2767386341 >> 172.21.15.107:0/2767386341 conn(0x7fd25c0c80b0 msgr2=0x7fd25c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 -- 172.21.15.107:0/2767386341 shutdown_connections 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.920+0000 7fd2626e0640 1 -- 172.21.15.107:0/2767386341 wait complete. 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.922+0000 7fd2626e0640 1 Processor -- start 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.922+0000 7fd2626e0640 1 -- start start 2023-12-16T01:26:21.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.923+0000 7fd2626e0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd25c0721d0 0x7fd25c158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.923+0000 7fd2626e0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c0c24d0 0x7fd25c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.923+0000 7fd2626e0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd25c14fd60 0x7fd25c1f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.923+0000 7fd2626e0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c158620 con 0x7fd25c14fd60 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.923+0000 7fd2626e0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c1eff10 con 0x7fd25c0721d0 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.923+0000 7fd2626e0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c1ef600 con 0x7fd25c0c24d0 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.924+0000 7f0b3bfff640 1 -- 172.21.15.107:0/3971037913 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440ae7e0 con 0x7f0b3c04c630 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.924+0000 7f0b3bfff640 1 -- 172.21.15.107:0/3971037913 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440aec10 con 0x7f0b3c04c630 2023-12-16T01:26:21.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.924+0000 7f672bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f672c071d60 0x7f672c15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.924+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3971037913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 msgr2=0x7f0b3c0df490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.924+0000 7f0b4a42e640 1 --2- 172.21.15.107:0/3971037913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 0x7f0b3c0df490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0b4402cee0 tx=0x7f0b440a6340 comp rx=0 tx=0).stop 2023-12-16T01:26:21.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3971037913 shutdown_connections 2023-12-16T01:26:21.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f0b4a42e640 1 --2- 172.21.15.107:0/3971037913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c04c630 0x7f0b3c0df490 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f0b4a42e640 1 --2- 172.21.15.107:0/3971037913 >> v2:172.21.15.157:3300/0 conn(0x7f0b3c0dd5f0 0x7f0b3c0def50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3971037913 >> 172.21.15.107:0/3971037913 conn(0x7f0b3c04dd00 msgr2=0x7f0b3c04e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3971037913 shutdown_connections 2023-12-16T01:26:21.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3971037913 wait complete. 2023-12-16T01:26:21.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f672bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f672c071d60 0x7f672c15c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33436/0 (socket says 172.21.15.107:33436) 2023-12-16T01:26:21.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f672bfff640 1 -- 172.21.15.107:0/629377747 learned_addr learned my addr 172.21.15.107:0/629377747 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f4475d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44780c24d0 0x7f44781435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f1ed1745640 1 --2- 172.21.15.107:0/3657435318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc15b410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892b1672b2f36cd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f4475d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44780c24d0 0x7f44781435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33446/0 (socket says 172.21.15.107:33446) 2023-12-16T01:26:21.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.925+0000 7f4475d9b640 1 -- 172.21.15.107:0/1498858686 learned_addr learned my addr 172.21.15.107:0/1498858686 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.926+0000 7f0b4a42e640 1 Processor -- start 2023-12-16T01:26:21.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.926+0000 7f0b4a42e640 1 -- start start 2023-12-16T01:26:21.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7fc9e200e640 1 Processor -- start 2023-12-16T01:26:21.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7fc9e200e640 1 -- start start 2023-12-16T01:26:21.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f6730819640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f672c1617f0 0x7f672c1f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f4f3effd640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380dd3c0 0x7f4f380b7990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f0b4a42e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b3c04c630 0x7f0b3c04a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f0b4a42e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b3c0d5df0 0x7f0b3c0d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f0b4a42e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c0dd5f0 0x7f0b3c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7fc9e200e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc9dc0612b0 0x7fc9dc15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f0b4a42e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0dba60 con 0x7f0b3c04c630 2023-12-16T01:26:21.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f0b4a42e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0d9020 con 0x7f0b3c0d5df0 2023-12-16T01:26:21.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.927+0000 7f0b4a42e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0dc340 con 0x7f0b3c0dd5f0 2023-12-16T01:26:21.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.928+0000 7fc9e200e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc15d050 0x7fc9dc15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.928+0000 7fc9e200e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc072580 con 0x7fc9dc14ffe0 2023-12-16T01:26:21.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.928+0000 7fc9e200e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc072050 con 0x7fc9dc0612b0 2023-12-16T01:26:21.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.928+0000 7fc9e200e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06afd0 con 0x7fc9dc15d050 2023-12-16T01:26:21.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.931+0000 7f672bfff640 1 -- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 msgr2=0x7f672c157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.931+0000 7f672bfff640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f672c157840 0x7f672c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.931+0000 7f672bfff640 1 -- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f672c1617f0 msgr2=0x7f672c1f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.931+0000 7f672bfff640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f672c1617f0 0x7f672c1f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.931+0000 7f672bfff640 1 -- 172.21.15.107:0/629377747 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009400 con 0x7f672c071d60 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.932+0000 7f1ec3fff640 1 -- 172.21.15.107:0/3657435318 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8031640 con 0x7f1ecc1516c0 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.932+0000 7f1ec3fff640 1 -- 172.21.15.107:0/3657435318 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80317a0 con 0x7f1ecc1516c0 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.932+0000 7f1ec3fff640 1 -- 172.21.15.107:0/3657435318 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8031b30 con 0x7f1ecc1516c0 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3657435318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc1516c0 msgr2=0x7f1ecc15b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 --2- 172.21.15.107:0/3657435318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc15b410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec802b8f0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3657435318 shutdown_connections 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 --2- 172.21.15.107:0/3657435318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0c79f0 0x7f1ecc070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 --2- 172.21.15.107:0/3657435318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc15b410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3657435318 >> 172.21.15.107:0/3657435318 conn(0x7f1ecc06a8f0 msgr2=0x7f1ecc06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3657435318 shutdown_connections 2023-12-16T01:26:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.933+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3657435318 wait complete. 2023-12-16T01:26:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.934+0000 7f4476d9d640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f447814fd60 0x7f447806f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.935+0000 7f1ed39a9640 1 Processor -- start 2023-12-16T01:26:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.935+0000 7f1ed39a9640 1 -- start start 2023-12-16T01:26:21.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.936+0000 7f1ed39a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc0c79f0 0x7f1ecc15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.936+0000 7f1ed39a9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0ca280 0x7f1ecc14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.937+0000 7f1ed39a9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.937+0000 7f1ed39a9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c7340 con 0x7f1ecc0c79f0 2023-12-16T01:26:21.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.937+0000 7f1ed39a9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc159f10 con 0x7f1ecc1516c0 2023-12-16T01:26:21.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.937+0000 7f1ed39a9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1590c0 con 0x7f1ecc0ca280 2023-12-16T01:26:21.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7fd260c7d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd25c14fd60 0x7fd25c1f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7fd25bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd25c0721d0 0x7fd25c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7f4475d9b640 1 -- 172.21.15.107:0/1498858686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f447814fd60 msgr2=0x7f447806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7f4475d9b640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f447814fd60 0x7f447806f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7f4475d9b640 1 -- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780721d0 msgr2=0x7f44781f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7f4475d9b640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780721d0 0x7f44781f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.939+0000 7f4475d9b640 1 -- 172.21.15.107:0/1498858686 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009b30 con 0x7f44780c24d0 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.940+0000 7fd25bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd25c0721d0 0x7fd25c158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47416/0 (socket says 172.21.15.107:47416) 2023-12-16T01:26:21.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.940+0000 7fd25bfff640 1 -- 172.21.15.107:0/2686425982 learned_addr learned my addr 172.21.15.107:0/2686425982 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.940+0000 7f8816d05640 1 --2- 172.21.15.107:0/1095902268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88080e3770 0x7f880804be50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88000097a0 tx=0x7f880002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea19e4ffebaef444 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.940+0000 7f672bfff640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f672c071d60 0x7f672c15c890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f671c0098c0 tx=0x7f671c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.941+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c03abe0 con 0x7f4f380dd3c0 2023-12-16T01:26:21.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.941+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c03ad60 con 0x7f4f380dd3c0 2023-12-16T01:26:21.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.941+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c044630 con 0x7f4f380dd3c0 2023-12-16T01:26:21.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.941+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f380cca60 con 0x7f4f380dd3c0 2023-12-16T01:26:21.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.941+0000 7f0b49c2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c0dd5f0 0x7f0b3c0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.941+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3804f940 con 0x7f4f380dd3c0 2023-12-16T01:26:21.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.942+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f380351b0 con 0x7f4f380dd3c0 2023-12-16T01:26:21.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.942+0000 7f0b49c2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c0dd5f0 0x7f0b3c0cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33474/0 (socket says 172.21.15.107:33474) 2023-12-16T01:26:21.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.942+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3080009867 learned_addr learned my addr 172.21.15.107:0/3080009867 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.946+0000 7f4475d9b640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44780c24d0 0x7f44781435a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f446c00d620 tx=0x7f446c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.946+0000 7fd25b7fe640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c0c24d0 0x7fd25c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.949+0000 7f0b48c2b640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b3c0d5df0 0x7f0b3c0d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.949+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3080009867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b3c0d5df0 msgr2=0x7f0b3c0d6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.949+0000 7f0b49c2d640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b3c0d5df0 0x7f0b3c0d6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.949+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b3c04c630 msgr2=0x7f0b3c04a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.949+0000 7f0b49c2d640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b3c04c630 0x7f0b3c04a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.949+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3080009867 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c0d8690 con 0x7f0b3c0dd5f0 2023-12-16T01:26:21.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.951+0000 7fd25bfff640 1 -- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c0c24d0 msgr2=0x7fd25c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.951+0000 7fd25bfff640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd25c0c24d0 0x7fd25c06ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.951+0000 7fd25bfff640 1 -- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd25c14fd60 msgr2=0x7fd25c1f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.951+0000 7fd25bfff640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd25c14fd60 0x7fd25c1f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.951+0000 7fd25bfff640 1 -- 172.21.15.107:0/2686425982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24400b760 con 0x7fd25c0721d0 2023-12-16T01:26:21.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.953+0000 7f8815502640 1 -- 172.21.15.107:0/1095902268 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800030610 con 0x7f88080e3770 2023-12-16T01:26:21.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.953+0000 7f8815502640 1 -- 172.21.15.107:0/1095902268 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8800030770 con 0x7f88080e3770 2023-12-16T01:26:21.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.953+0000 7f8815502640 1 -- 172.21.15.107:0/1095902268 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800030b00 con 0x7f88080e3770 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 -- 172.21.15.107:0/1095902268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88080e3770 msgr2=0x7f880804be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 --2- 172.21.15.107:0/1095902268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88080e3770 0x7f880804be50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88000097a0 tx=0x7f880002b960 comp rx=0 tx=0).stop 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 -- 172.21.15.107:0/1095902268 shutdown_connections 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 --2- 172.21.15.107:0/1095902268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88080e3770 0x7f880804be50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 -- 172.21.15.107:0/1095902268 >> 172.21.15.107:0/1095902268 conn(0x7f8808050150 msgr2=0x7f8808050560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 -- 172.21.15.107:0/1095902268 shutdown_connections 2023-12-16T01:26:21.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.954+0000 7f8817506640 1 -- 172.21.15.107:0/1095902268 wait complete. 2023-12-16T01:26:21.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.955+0000 7f8817506640 1 Processor -- start 2023-12-16T01:26:21.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 -- start start 2023-12-16T01:26:21.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c011870 con 0x7f44780c24d0 2023-12-16T01:26:21.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c0119d0 con 0x7f44780c24d0 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f447cc15640 1 -- 172.21.15.107:0/1498858686 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44781f3170 con 0x7f44780c24d0 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c011d80 con 0x7f44780c24d0 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f447cc15640 1 -- 172.21.15.107:0/1498858686 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44780ca4e0 con 0x7f44780c24d0 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880804ba30 0x7f8808006780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88080dd390 0x7f88080e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88080e3770 0x7f88080e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080df070 con 0x7f88080dd390 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080e05a0 con 0x7f880804ba30 2023-12-16T01:26:21.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.956+0000 7f8817506640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080e0160 con 0x7f88080e3770 2023-12-16T01:26:21.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.957+0000 7fd25bfff640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd25c0721d0 0x7fd25c158890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd244000c00 tx=0x7fd2440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.957+0000 7f447cc15640 1 -- 172.21.15.107:0/1498858686 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f447806baa0 con 0x7f44780c24d0 2023-12-16T01:26:21.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.957+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc15d050 0x7fc9dc15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.958+0000 7f0b49c2d640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c0dd5f0 0x7f0b3c0cba10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b4406a160 tx=0x7f0b44069710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.959+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc15d050 0x7fc9dc15d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33488/0 (socket says 172.21.15.107:33488) 2023-12-16T01:26:21.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.959+0000 7fc9dbfff640 1 -- 172.21.15.107:0/3689957148 learned_addr learned my addr 172.21.15.107:0/3689957148 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.959+0000 7f1ed1f46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.961+0000 7f1ed1f46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47432/0 (socket says 172.21.15.107:47432) 2023-12-16T01:26:21.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.961+0000 7f1ed1f46640 1 -- 172.21.15.107:0/3335525873 learned_addr learned my addr 172.21.15.107:0/3335525873 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.961+0000 7f1ed1745640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc0c79f0 0x7f1ecc15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.961+0000 7f8816504640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880804ba30 0x7f8808006780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.962+0000 7f8816504640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880804ba30 0x7f8808006780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47444/0 (socket says 172.21.15.107:47444) 2023-12-16T01:26:21.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.962+0000 7f8816504640 1 -- 172.21.15.107:0/3710708178 learned_addr learned my addr 172.21.15.107:0/3710708178 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:21.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.963+0000 7fc9daffd640 1 --2- 172.21.15.107:0/3689957148 >> v2:172.21.15.107:3300/0 conn(0x7fc9dc0612b0 0x7fc9dc15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.964+0000 7f8815d03640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88080dd390 0x7f88080e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.965+0000 7f1ed1f46640 1 -- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0ca280 msgr2=0x7f1ecc14a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.965+0000 7f1ed1f46640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ecc0ca280 0x7f1ecc14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.965+0000 7f1ed1f46640 1 -- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc0c79f0 msgr2=0x7f1ecc15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.965+0000 7f1ed1f46640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ecc0c79f0 0x7f1ecc15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.965+0000 7f1ed1f46640 1 -- 172.21.15.107:0/3335525873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80094d0 con 0x7f1ecc1516c0 2023-12-16T01:26:21.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.969+0000 7fc9daffd640 1 -- 172.21.15.107:0/3689957148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc15d050 msgr2=0x7fc9dc15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:21.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.969+0000 7fc9daffd640 1 --2- 172.21.15.107:0/3689957148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc15d050 0x7fc9dc15d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.969+0000 7fc9daffd640 1 -- 172.21.15.107:0/3689957148 >> v1:172.21.15.107:6789/0 conn(0x7fc9dc14ffe0 legacy=0x7fc9dc06b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.969+0000 7fc9daffd640 1 -- 172.21.15.107:0/3689957148 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc1503c0 con 0x7fc9dc0612b0 2023-12-16T01:26:21.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.971+0000 7f8816504640 1 -- 172.21.15.107:0/3710708178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88080e3770 msgr2=0x7f88080e1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.971+0000 7f8816504640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88080e3770 0x7f88080e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.971+0000 7f8816504640 1 -- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88080dd390 msgr2=0x7f88080e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.971+0000 7f8816504640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88080dd390 0x7f88080e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.971+0000 7f8816504640 1 -- 172.21.15.107:0/3710708178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009400 con 0x7f880804ba30 2023-12-16T01:26:21.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.972+0000 7f1ed1f46640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc1560c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4004960 tx=0x7f1ec400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.975+0000 7f8816504640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880804ba30 0x7f8808006780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c480 tx=0x7f880c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.981+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0052d0 con 0x7f880804ba30 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c005430 con 0x7f880804ba30 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c012870 con 0x7f880804ba30 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88080de110 con 0x7f880804ba30 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080de6d0 con 0x7f880804ba30 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24402ec50 con 0x7fd25c0721d0 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2440375c0 con 0x7fd25c0721d0 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244037750 con 0x7fd25c0721d0 2023-12-16T01:26:21.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c1f3620 con 0x7fd25c0721d0 2023-12-16T01:26:21.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.982+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c1ef8c0 con 0x7fd25c0721d0 2023-12-16T01:26:21.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.983+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8808045670 con 0x7f880804ba30 2023-12-16T01:26:21.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.983+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd25c153780 con 0x7fd25c0721d0 2023-12-16T01:26:21.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.986+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f446c007450 con 0x7f44780c24d0 2023-12-16T01:26:21.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.986+0000 7f4466ffd640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f445806ae40 0x7f445806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.986+0000 7f447659c640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f445806ae40 0x7f445806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.986+0000 7f447659c640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f445806ae40 0x7f445806d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4468009650 tx=0x7f4468006ba0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.987+0000 7fc9daffd640 1 --2- 172.21.15.107:0/3689957148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc0612b0 0x7fc9dc15cb10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00097a0 tx=0x7fc9d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b490d18c4f65c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.992+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f446c058b70 con 0x7f44780c24d0 2023-12-16T01:26:21.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.992+0000 7f4466ffd640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f4458074300 0x7f4458076740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:21.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.992+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 --> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4458076e10 con 0x7f4458074300 2023-12-16T01:26:21.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.992+0000 7f4476d9d640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f4458074300 0x7f4458076740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:21.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.992+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f446c054eb0 con 0x7f44780c24d0 2023-12-16T01:26:21.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.992+0000 7f4476d9d640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f4458074300 0x7f4458076740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:21.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.993+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== osd.3 v2:172.21.15.107:6800/2440758538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4458076e10 con 0x7f4458074300 2023-12-16T01:26:21.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.997+0000 7fc9da7fc640 1 -- 172.21.15.107:0/3689957148 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0031830 con 0x7fc9dc0612b0 2023-12-16T01:26:21.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.997+0000 7fc9da7fc640 1 -- 172.21.15.107:0/3689957148 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0031990 con 0x7fc9dc0612b0 2023-12-16T01:26:21.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.997+0000 7fc9da7fc640 1 -- 172.21.15.107:0/3689957148 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0031d20 con 0x7fc9dc0612b0 2023-12-16T01:26:21.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.997+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c032c10 con 0x7f672c071d60 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c032d90 con 0x7f672c071d60 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7f673101a640 1 -- 172.21.15.107:0/629377747 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c15a8b0 con 0x7f672c071d60 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c045640 con 0x7f672c071d60 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7f673101a640 1 -- 172.21.15.107:0/629377747 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c1f7130 con 0x7f672c071d60 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 -- 172.21.15.107:0/3689957148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc0612b0 msgr2=0x7fc9dc15cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 --2- 172.21.15.107:0/3689957148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc0612b0 0x7fc9dc15cb10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00097a0 tx=0x7fc9d002b8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 -- 172.21.15.107:0/3689957148 shutdown_connections 2023-12-16T01:26:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 --2- 172.21.15.107:0/3689957148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc15d050 0x7fc9dc15d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 --2- 172.21.15.107:0/3689957148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc0612b0 0x7fc9dc15cb10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 -- 172.21.15.107:0/3689957148 >> 172.21.15.107:0/3689957148 conn(0x7fc9dc0cb3f0 msgr2=0x7fc9dc0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.998+0000 7fc9e200e640 1 -- 172.21.15.107:0/3689957148 shutdown_connections 2023-12-16T01:26:22.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.999+0000 7fc9e200e640 1 -- 172.21.15.107:0/3689957148 wait complete. 2023-12-16T01:26:22.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:21.999+0000 7f673101a640 1 -- 172.21.15.107:0/629377747 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f672c160ff0 con 0x7f672c071d60 2023-12-16T01:26:22.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.000+0000 7fc9e200e640 1 Processor -- start 2023-12-16T01:26:22.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.001+0000 7fc9e200e640 1 -- start start 2023-12-16T01:26:22.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.001+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440adb60 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.001+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440adcc0 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.001+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c0d7b10 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.001+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440b9620 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.001+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c0d80d0 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7fc9e200e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0612b0 0x7fc9dc1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7fc9e200e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc14ffe0 0x7fc9dc0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b3c046900 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7fc9e200e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc15d050 0x7fc9dc0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7fc9e200e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc159a00 con 0x7fc9dc15d050 2023-12-16T01:26:22.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7fc9e200e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc159e50 con 0x7fc9dc0612b0 2023-12-16T01:26:22.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.002+0000 7fc9e200e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc157700 con 0x7fc9dc14ffe0 2023-12-16T01:26:22.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.003+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc15d050 0x7fc9dc0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.003+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc15d050 0x7fc9dc0c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41418/0 (socket says 172.21.15.107:41418) 2023-12-16T01:26:22.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.003+0000 7fc9dbfff640 1 -- 172.21.15.107:0/3603444530 learned_addr learned my addr 172.21.15.107:0/3603444530 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.004+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f880c0129d0 con 0x7f880804ba30 2023-12-16T01:26:22.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.005+0000 7f8806ffd640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f87f406ae90 0x7f87f406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.005+0000 7f8815d03640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f87f406ae90 0x7f87f406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.005+0000 7f8815d03640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f87f406ae90 0x7f87f406d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8810064180 tx=0x7f8810068b80 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.006+0000 7fc9dbfff640 1 -- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc14ffe0 msgr2=0x7fc9dc0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.006+0000 7fc9dbfff640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc14ffe0 0x7fc9dc0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.006+0000 7fc9dbfff640 1 -- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0612b0 msgr2=0x7fc9dc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.007+0000 7fc9dbfff640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0612b0 0x7fc9dc1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.007+0000 7fc9dbfff640 1 -- 172.21.15.107:0/3603444530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0009400 con 0x7fc9dc15d050 2023-12-16T01:26:22.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.009+0000 7f447cc15640 1 -- 172.21.15.107:0/1498858686 --> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44780c2e30 con 0x7f4458074300 2023-12-16T01:26:22.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.009+0000 7fc9dbfff640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc15d050 0x7fc9dc0c75a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009d90 tx=0x7fc9d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.009+0000 7f4466ffd640 1 -- 172.21.15.107:0/1498858686 <== osd.3 v2:172.21.15.107:6800/2440758538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f447000e140 con 0x7f4458074300 2023-12-16T01:26:22.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.009+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f4458074300 msgr2=0x7f4458076740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.009+0000 7f4464ff9640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f4458074300 0x7f4458076740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.009+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f880c058f20 con 0x7f880804ba30 2023-12-16T01:26:22.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f445806ae40 msgr2=0x7f445806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f445806ae40 0x7f445806d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4468009650 tx=0x7f4468006ba0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44780c24d0 msgr2=0x7f44781435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 --2- 172.21.15.107:0/1498858686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44780c24d0 0x7f44781435a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f446c00d620 tx=0x7f446c00dae0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4476d9d640 1 -- 172.21.15.107:0/1498858686 reap_dead start 2023-12-16T01:26:22.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f8806ffd640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f87f40743c0 0x7f87f4076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 --> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87f4076ed0 con 0x7f87f40743c0 2023-12-16T01:26:22.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 shutdown_connections 2023-12-16T01:26:22.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 >> 172.21.15.107:0/1498858686 conn(0x7f44780c80b0 msgr2=0x7f44780715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f8816d05640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f87f40743c0 0x7f87f4076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 shutdown_connections 2023-12-16T01:26:22.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f4464ff9640 1 -- 172.21.15.107:0/1498858686 wait complete. 2023-12-16T01:26:22.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.010+0000 7f8816d05640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f87f40743c0 0x7f87f4076800 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.011+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880c054b60 con 0x7f880804ba30 2023-12-16T01:26:22.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.011+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== osd.2 v2:172.21.15.107:6809/1376588586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f87f4076ed0 con 0x7f87f40743c0 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.011+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400cd20 con 0x7fc9dc15d050 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.011+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc0c7020 con 0x7fc9dc15d050 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.012+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc0c8970 con 0x7fc9dc15d050 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.012+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9dc0c5ae0 con 0x7fc9dc15d050 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.014+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400aa50 con 0x7f1ecc1516c0 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.014+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec400abb0 con 0x7f1ecc1516c0 2023-12-16T01:26:22.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.014+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc158b00 con 0x7f1ecc1516c0 2023-12-16T01:26:22.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.014+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400ce60 con 0x7f1ecc1516c0 2023-12-16T01:26:22.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.014+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc159ba0 con 0x7f1ecc1516c0 2023-12-16T01:26:22.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.015+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0c5ae0 con 0x7fc9dc15d050 2023-12-16T01:26:22.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.015+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4003b90 con 0x7fc9dc15d050 2023-12-16T01:26:22.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.015+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ecc0aff70 con 0x7f1ecc1516c0 2023-12-16T01:26:22.027 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:22.027 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T01:26:22.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.033+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 --> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88080e3e60 con 0x7f87f40743c0 2023-12-16T01:26:22.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.033+0000 7f8806ffd640 1 -- 172.21.15.107:0/3710708178 <== osd.2 v2:172.21.15.107:6809/1376588586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8800040040 con 0x7f87f40743c0 2023-12-16T01:26:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.033+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f87f40743c0 msgr2=0x7f87f4076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f87f40743c0 0x7f87f4076800 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f87f406ae90 msgr2=0x7f87f406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f87f406ae90 0x7f87f406d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8810064180 tx=0x7f8810068b80 comp rx=0 tx=0).stop 2023-12-16T01:26:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880804ba30 msgr2=0x7f8808006780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 --2- 172.21.15.107:0/3710708178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880804ba30 0x7f8808006780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c480 tx=0x7f880c00c940 comp rx=0 tx=0).stop 2023-12-16T01:26:22.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8816d05640 1 -- 172.21.15.107:0/3710708178 reap_dead start 2023-12-16T01:26:22.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 shutdown_connections 2023-12-16T01:26:22.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 >> 172.21.15.107:0/3710708178 conn(0x7f8808050150 msgr2=0x7f880804e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 shutdown_connections 2023-12-16T01:26:22.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.034+0000 7f8817506640 1 -- 172.21.15.107:0/3710708178 wait complete. 2023-12-16T01:26:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.039+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4f2c044790 con 0x7f4f380dd3c0 2023-12-16T01:26:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.039+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc9d4003cf0 con 0x7fc9dc15d050 2023-12-16T01:26:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.039+0000 7fc9c3fff640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc9c806ae40 0x7fc9c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.039+0000 7f4f2bfff640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4f2406ae90 0x7f4f2406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.039+0000 7fc9db7fe640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc9c806ae40 0x7fc9c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.039+0000 7f4f3f7fe640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4f2406ae90 0x7f4f2406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.040+0000 7f4f3f7fe640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4f2406ae90 0x7f4f2406d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009aa0 tx=0x7f4f34009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.040+0000 7fc9db7fe640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc9c806ae40 0x7fc9c806d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc000f60 tx=0x7fc9cc0079d0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.042+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9d400ce80 con 0x7fc9dc15d050 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.043+0000 7fc9c3fff640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7fc9c8074380 0x7fc9c80767c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.043+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 --> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9c8076e90 con 0x7fc9c8074380 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.043+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9d4055a00 con 0x7fc9dc15d050 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.043+0000 7fc9daffd640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7fc9c8074380 0x7fc9c80767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.043+0000 7fc9daffd640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7fc9c8074380 0x7fc9c80767c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.044+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== osd.7 v2:172.21.15.157:6810/1425748971 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc9c8076e90 con 0x7fc9c8074380 2023-12-16T01:26:22.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.045+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f2c02d040 con 0x7f4f380dd3c0 2023-12-16T01:26:22.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.045+0000 7f4f2bfff640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7f4f240743d0 0x7f4f24076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.045+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 --> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f24076ee0 con 0x7f4f240743d0 2023-12-16T01:26:22.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.045+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f2c077860 con 0x7f4f380dd3c0 2023-12-16T01:26:22.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.045+0000 7f4f3ffff640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7f4f240743d0 0x7f4f24076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.046+0000 7f4f3ffff640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7f4f240743d0 0x7f4f24076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.048 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:22.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T01:26:22.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.047+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== osd.1 v2:172.21.15.107:6808/2478942825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4f24076ee0 con 0x7f4f240743d0 2023-12-16T01:26:22.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.056+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd2440378b0 con 0x7fd25c0721d0 2023-12-16T01:26:22.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.056+0000 7fd258ff9640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd23c06ae40 0x7fd23c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.056+0000 7fd25b7fe640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd23c06ae40 0x7fd23c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.057+0000 7fd25b7fe640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd23c06ae40 0x7fd23c06d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd25c159fd0 tx=0x7fd24c0094d0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.061+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 --> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9dc06a980 con 0x7fc9c8074380 2023-12-16T01:26:22.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.061+0000 7fc9c3fff640 1 -- 172.21.15.107:0/3603444530 <== osd.7 v2:172.21.15.157:6810/1425748971 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc9d0031b00 con 0x7fc9c8074380 2023-12-16T01:26:22.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.061+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd24407bce0 con 0x7fd25c0721d0 2023-12-16T01:26:22.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.061+0000 7fd258ff9640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7fd23c074300 0x7fd23c076740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.061+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 --> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd23c076e10 con 0x7fd23c074300 2023-12-16T01:26:22.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.061+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7fc9c8074380 msgr2=0x7fc9c80767c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7fc9c8074380 0x7fc9c80767c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd244077920 con 0x7fd25c0721d0 2023-12-16T01:26:22.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc9c806ae40 msgr2=0x7fc9c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc9c806ae40 0x7fc9c806d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc000f60 tx=0x7fc9cc0079d0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fd260c7d640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7fd23c074300 0x7fd23c076740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc15d050 msgr2=0x7fc9dc0c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 --2- 172.21.15.107:0/3603444530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9dc15d050 0x7fc9dc0c75a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009d90 tx=0x7fc9d400c490 comp rx=0 tx=0).stop 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9dbfff640 1 -- 172.21.15.107:0/3603444530 reap_dead start 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 shutdown_connections 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 >> 172.21.15.107:0/3603444530 conn(0x7fc9dc0cb3f0 msgr2=0x7fc9dc15c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 shutdown_connections 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fc9e200e640 1 -- 172.21.15.107:0/3603444530 wait complete. 2023-12-16T01:26:22.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.062+0000 7fd260c7d640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7fd23c074300 0x7fd23c076740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.063+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== osd.4 v2:172.21.15.157:6800/2128955220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd23c076e10 con 0x7fd23c074300 2023-12-16T01:26:22.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.065+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 --> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f38045c60 con 0x7f4f240743d0 2023-12-16T01:26:22.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.065+0000 7f4f2bfff640 1 -- 172.21.15.107:0/1504745435 <== osd.1 v2:172.21.15.107:6808/2478942825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f4004ed60 con 0x7f4f240743d0 2023-12-16T01:26:22.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7f4f240743d0 msgr2=0x7f4f24076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7f4f240743d0 0x7f4f24076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4f2406ae90 msgr2=0x7f4f2406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4f2406ae90 0x7f4f2406d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009aa0 tx=0x7f4f34009190 comp rx=0 tx=0).stop 2023-12-16T01:26:22.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380dd3c0 msgr2=0x7f4f380b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 --2- 172.21.15.107:0/1504745435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380dd3c0 0x7f4f380b7990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c0046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f3ffff640 1 -- 172.21.15.107:0/1504745435 reap_dead start 2023-12-16T01:26:22.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 shutdown_connections 2023-12-16T01:26:22.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.067+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 >> 172.21.15.107:0/1504745435 conn(0x7f4f38050180 msgr2=0x7f4f38006120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.068+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0b440b5040 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.069+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 shutdown_connections 2023-12-16T01:26:22.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.069+0000 7f4f45bd7640 1 -- 172.21.15.107:0/1504745435 wait complete. 2023-12-16T01:26:22.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.069+0000 7f0b39ffb640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b2806ae90 0x7f0b2806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.069+0000 7f0b4942c640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b2806ae90 0x7f0b2806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.070+0000 7f0b4942c640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b2806ae90 0x7f0b2806d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009650 tx=0x7f0b40006ba0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.076+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b440adeb0 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.076+0000 7f0b39ffb640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f0b280743d0 0x7f0b28076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.076+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 --> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b28076ee0 con 0x7f0b280743d0 2023-12-16T01:26:22.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.076+0000 7f0b48c2b640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f0b280743d0 0x7f0b28076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.077+0000 7f0b48c2b640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f0b280743d0 0x7f0b28076810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.078+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== osd.0 v2:172.21.15.107:6824/1495769768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0b28076ee0 con 0x7f0b280743d0 2023-12-16T01:26:22.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.079+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b440f1060 con 0x7f0b3c0dd5f0 2023-12-16T01:26:22.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.079+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1ec4011560 con 0x7f1ecc1516c0 2023-12-16T01:26:22.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.080+0000 7f1ec1ffb640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1eb006ae70 0x7f1eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.080+0000 7f1ed1745640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1eb006ae70 0x7f1eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.081+0000 7f1ed1745640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1eb006ae70 0x7f1eb006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8036000 tx=0x7f1ec803c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.083 INFO:teuthology.orchestra.run.smithi107.stdout:60129542157 2023-12-16T01:26:22.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T01:26:22.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.083+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ec405c440 con 0x7f1ecc1516c0 2023-12-16T01:26:22.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.083+0000 7f1ec1ffb640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f1eb0074330 0x7f1eb0076770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.083+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 --> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1eb0076e40 con 0x7f1eb0074330 2023-12-16T01:26:22.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.083+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec4058780 con 0x7f1ecc1516c0 2023-12-16T01:26:22.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.083+0000 7f1ed0f44640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f1eb0074330 0x7f1eb0076770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.084+0000 7f1ed0f44640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f1eb0074330 0x7f1eb0076770 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.084+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 --> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd25c06baa0 con 0x7fd23c074300 2023-12-16T01:26:22.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.085+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== osd.5 v2:172.21.15.157:6824/3619027731 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1eb0076e40 con 0x7f1eb0074330 2023-12-16T01:26:22.087 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:22.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.086+0000 7fd258ff9640 1 -- 172.21.15.107:0/2686425982 <== osd.4 v2:172.21.15.157:6800/2128955220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd254009340 con 0x7fd23c074300 2023-12-16T01:26:22.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T01:26:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.087+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7fd23c074300 msgr2=0x7fd23c076740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.087+0000 7fd2626e0640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7fd23c074300 0x7fd23c076740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd23c06ae40 msgr2=0x7fd23c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd2626e0640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd23c06ae40 0x7fd23c06d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd25c159fd0 tx=0x7fd24c0094d0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd25c0721d0 msgr2=0x7fd25c158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd2626e0640 1 --2- 172.21.15.107:0/2686425982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd25c0721d0 0x7fd25c158890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd244000c00 tx=0x7fd2440046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd260c7d640 1 -- 172.21.15.107:0/2686425982 reap_dead start 2023-12-16T01:26:22.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 shutdown_connections 2023-12-16T01:26:22.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.091+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 >> 172.21.15.107:0/2686425982 conn(0x7fd25c0c80b0 msgr2=0x7fd25c0c5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.092+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 shutdown_connections 2023-12-16T01:26:22.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.092+0000 7fd2626e0640 1 -- 172.21.15.107:0/2686425982 wait complete. 2023-12-16T01:26:22.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.095+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f671c04e440 con 0x7f672c071d60 2023-12-16T01:26:22.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.096+0000 7f6728ff9640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f671806ae90 0x7f671806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.096+0000 7f672b7fe640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f671806ae90 0x7f671806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.097+0000 7f672b7fe640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f671806ae90 0x7f671806d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6720000f60 tx=0x7f67200079b0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.099+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f671c07b490 con 0x7f672c071d60 2023-12-16T01:26:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.099+0000 7f6728ff9640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7f6718074450 0x7f6718076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.099+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 --> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6718076f60 con 0x7f6718074450 2023-12-16T01:26:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.099+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f671c031d90 con 0x7f672c071d60 2023-12-16T01:26:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.099+0000 7f6730819640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7f6718074450 0x7f6718076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.100+0000 7f6730819640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7f6718074450 0x7f6718076890 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.101+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== osd.6 v2:172.21.15.157:6808/3584434830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6718076f60 con 0x7f6718074450 2023-12-16T01:26:22.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.104+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 --> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b3c008c50 con 0x7f0b280743d0 2023-12-16T01:26:22.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.105+0000 7f0b39ffb640 1 -- 172.21.15.107:0/3080009867 <== osd.0 v2:172.21.15.107:6824/1495769768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b3400a380 con 0x7f0b280743d0 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f0b280743d0 msgr2=0x7f0b28076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f0b280743d0 0x7f0b28076810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b2806ae90 msgr2=0x7f0b2806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0b2806ae90 0x7f0b2806d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009650 tx=0x7f0b40006ba0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c0dd5f0 msgr2=0x7f0b3c0cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 --2- 172.21.15.107:0/3080009867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b3c0dd5f0 0x7f0b3c0cba10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b4406a160 tx=0x7f0b44069710 comp rx=0 tx=0).stop 2023-12-16T01:26:22.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b49c2d640 1 -- 172.21.15.107:0/3080009867 reap_dead start 2023-12-16T01:26:22.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 shutdown_connections 2023-12-16T01:26:22.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 >> 172.21.15.107:0/3080009867 conn(0x7f0b3c04dd00 msgr2=0x7f0b3c0d3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 shutdown_connections 2023-12-16T01:26:22.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.106+0000 7f0b4a42e640 1 -- 172.21.15.107:0/3080009867 wait complete. 2023-12-16T01:26:22.113 INFO:teuthology.orchestra.run.smithi107.stdout:60129542157 2023-12-16T01:26:22.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T01:26:22.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.117+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 --> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ecc157b10 con 0x7f1eb0074330 2023-12-16T01:26:22.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.117+0000 7f1ec1ffb640 1 -- 172.21.15.107:0/3335525873 <== osd.5 v2:172.21.15.157:6824/3619027731 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ebc009840 con 0x7f1eb0074330 2023-12-16T01:26:22.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.118+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f1eb0074330 msgr2=0x7f1eb0076770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.118+0000 7f1ed39a9640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f1eb0074330 0x7f1eb0076770 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.119+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1eb006ae70 msgr2=0x7f1eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.119+0000 7f1ed39a9640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1eb006ae70 0x7f1eb006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8036000 tx=0x7f1ec803c040 comp rx=0 tx=0).stop 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.119+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc1516c0 msgr2=0x7f1ecc1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.119+0000 7f1ed39a9640 1 --2- 172.21.15.107:0/3335525873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ecc1516c0 0x7f1ecc1560c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4004960 tx=0x7f1ec400cc10 comp rx=0 tx=0).stop 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.119+0000 7f1ed1f46640 1 -- 172.21.15.107:0/3335525873 reap_dead start 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.120+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 shutdown_connections 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.120+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 >> 172.21.15.107:0/3335525873 conn(0x7f1ecc06a8f0 msgr2=0x7f1ecc0c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.120+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 shutdown_connections 2023-12-16T01:26:22.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.120+0000 7f1ed39a9640 1 -- 172.21.15.107:0/3335525873 wait complete. 2023-12-16T01:26:22.125 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:22.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T01:26:22.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.133+0000 7f673101a640 1 -- 172.21.15.107:0/629377747 --> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f672c160d10 con 0x7f6718074450 2023-12-16T01:26:22.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.134+0000 7f6728ff9640 1 -- 172.21.15.107:0/629377747 <== osd.6 v2:172.21.15.157:6808/3584434830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6724001e60 con 0x7f6718074450 2023-12-16T01:26:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.135+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7f6718074450 msgr2=0x7f6718076890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.135+0000 7f67127fc640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7f6718074450 0x7f6718076890 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.135+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f671806ae90 msgr2=0x7f671806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.135+0000 7f67127fc640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f671806ae90 0x7f671806d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6720000f60 tx=0x7f67200079b0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.135+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f672c071d60 msgr2=0x7f672c15c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.135+0000 7f67127fc640 1 --2- 172.21.15.107:0/629377747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f672c071d60 0x7f672c15c890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f671c0098c0 tx=0x7f671c0046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.136+0000 7f6730819640 1 -- 172.21.15.107:0/629377747 reap_dead start 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.136+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 shutdown_connections 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.136+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 >> 172.21.15.107:0/629377747 conn(0x7f672c06a500 msgr2=0x7f672c070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.136+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 shutdown_connections 2023-12-16T01:26:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.136+0000 7f67127fc640 1 -- 172.21.15.107:0/629377747 wait complete. 2023-12-16T01:26:22.141 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:22.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T01:26:22.159 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:22.160 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T01:26:22.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.193+0000 7f7f93743640 1 Processor -- start 2023-12-16T01:26:22.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.193+0000 7f7f93743640 1 -- start start 2023-12-16T01:26:22.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.194+0000 7f7f93743640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7f8c0c9de0 0x7f7f8c157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.194+0000 7f7f93743640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f8c06fd90 0x7f7f8c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.194+0000 7f7f93743640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c15b830 con 0x7f7f8c0c9a00 2023-12-16T01:26:22.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.194+0000 7f7f93743640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c1578d0 con 0x7f7f8c06fd90 2023-12-16T01:26:22.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.194+0000 7f7f93743640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c157bb0 con 0x7f7f8c0c9de0 2023-12-16T01:26:22.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.195+0000 7f7f914df640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7f8c0c9a00 0x7f7f8c15b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57474/0 (socket says 172.21.15.107:57474) 2023-12-16T01:26:22.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.195+0000 7f7f914df640 1 -- 172.21.15.107:0/2664716546 learned_addr learned my addr 172.21.15.107:0/2664716546 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:22.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.195+0000 7f7f90cde640 1 --2- 172.21.15.107:0/2664716546 >> v2:172.21.15.157:3300/0 conn(0x7f7f8c0c9de0 0x7f7f8c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.198+0000 7f7f91ce0640 1 --2- 172.21.15.107:0/2664716546 >> v2:172.21.15.107:3300/0 conn(0x7f7f8c06fd90 0x7f7f8c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.202+0000 7f7f90cde640 1 -- 172.21.15.107:0/2664716546 >> v2:172.21.15.107:3300/0 conn(0x7f7f8c06fd90 msgr2=0x7f7f8c0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.202+0000 7f7f90cde640 1 --2- 172.21.15.107:0/2664716546 >> v2:172.21.15.107:3300/0 conn(0x7f7f8c06fd90 0x7f7f8c0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.202+0000 7f7f90cde640 1 -- 172.21.15.107:0/2664716546 >> v1:172.21.15.107:6789/0 conn(0x7f7f8c0c9a00 legacy=0x7f7f8c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.202+0000 7f7f90cde640 1 -- 172.21.15.107:0/2664716546 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c157e90 con 0x7f7f8c0c9de0 2023-12-16T01:26:22.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.206+0000 7f7f90cde640 1 --2- 172.21.15.107:0/2664716546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9de0 0x7f7f8c157290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c071760 tx=0x7f7f7c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bddc0348774cae9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.210+0000 7f7f83fff640 1 -- 172.21.15.107:0/2664716546 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c030840 con 0x7f7f8c0c9de0 2023-12-16T01:26:22.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.210+0000 7f7f83fff640 1 -- 172.21.15.107:0/2664716546 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c0309a0 con 0x7f7f8c0c9de0 2023-12-16T01:26:22.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.210+0000 7f7f83fff640 1 -- 172.21.15.107:0/2664716546 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c030d70 con 0x7f7f8c0c9de0 2023-12-16T01:26:22.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.211+0000 7f7f93743640 1 -- 172.21.15.107:0/2664716546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9de0 msgr2=0x7f7f8c157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.211+0000 7f7f93743640 1 --2- 172.21.15.107:0/2664716546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9de0 0x7f7f8c157290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c071760 tx=0x7f7f7c02b980 comp rx=0 tx=0).stop 2023-12-16T01:26:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.212+0000 7f7f93743640 1 -- 172.21.15.107:0/2664716546 shutdown_connections 2023-12-16T01:26:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.212+0000 7f7f93743640 1 --2- 172.21.15.107:0/2664716546 >> v2:172.21.15.107:3300/0 conn(0x7f7f8c06fd90 0x7f7f8c0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.212+0000 7f7f93743640 1 --2- 172.21.15.107:0/2664716546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9de0 0x7f7f8c157290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.212+0000 7f7f93743640 1 -- 172.21.15.107:0/2664716546 >> 172.21.15.107:0/2664716546 conn(0x7f7f8c070bb0 msgr2=0x7f7f8c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.212+0000 7f7f93743640 1 -- 172.21.15.107:0/2664716546 shutdown_connections 2023-12-16T01:26:22.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.212+0000 7f7f93743640 1 -- 172.21.15.107:0/2664716546 wait complete. 2023-12-16T01:26:22.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.214+0000 7f7f93743640 1 Processor -- start 2023-12-16T01:26:22.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.214+0000 7f7f93743640 1 -- start start 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.215+0000 7f7f93743640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 0x7f7f8c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.215+0000 7f7f93743640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9a00 0x7f7f8c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.215+0000 7f7f93743640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7f8c0c9de0 0x7f7f8c0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.215+0000 7f7f93743640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c8d80 con 0x7f7f8c06fd90 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.215+0000 7f7f93743640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c1fc450 con 0x7f7f8c0c9a00 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.215+0000 7f7f93743640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c157380 con 0x7f7f8c0c9de0 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.216+0000 7f7f914df640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 0x7f7f8c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.216+0000 7f7f91ce0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7f8c0c9de0 0x7f7f8c0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.217+0000 7f7f914df640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 0x7f7f8c06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41436/0 (socket says 172.21.15.107:41436) 2023-12-16T01:26:22.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.217+0000 7f7f914df640 1 -- 172.21.15.107:0/20462996 learned_addr learned my addr 172.21.15.107:0/20462996 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.220+0000 7feeaa056640 1 Processor -- start 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.220+0000 7feeaa056640 1 -- start start 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.222+0000 7feeaa056640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feea40727b0 0x7feea4171b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.222+0000 7feeaa056640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea408ae00 con 0x7feea4166cc0 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.222+0000 7feeaa056640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40cb7c0 con 0x7feea4160480 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.222+0000 7feeaa056640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea41671b0 con 0x7feea40727b0 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.222+0000 7feea37fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7feea4160480 0x7feea40711e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:34950/0 (socket says 172.21.15.107:34950) 2023-12-16T01:26:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.222+0000 7feea37fe640 1 -- 172.21.15.107:0/1222635630 learned_addr learned my addr 172.21.15.107:0/1222635630 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.225+0000 7f7f914df640 1 -- 172.21.15.107:0/20462996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7f8c0c9de0 msgr2=0x7f7f8c0c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.225+0000 7f7f914df640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7f8c0c9de0 0x7f7f8c0c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.225+0000 7f7f914df640 1 -- 172.21.15.107:0/20462996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9a00 msgr2=0x7f7f8c159a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T01:26:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.225+0000 7f7f914df640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9a00 0x7f7f8c159a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.225+0000 7f7f914df640 1 -- 172.21.15.107:0/20462996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009400 con 0x7f7f8c06fd90 2023-12-16T01:26:22.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.229+0000 7feea3fff640 1 --2- 172.21.15.107:0/1222635630 >> v2:172.21.15.107:3300/0 conn(0x7feea40727b0 0x7feea4171b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.230+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723112630 0 0) 0x7feea40cb7c0 con 0x7feea4160480 2023-12-16T01:26:22.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.230+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee8c003440 con 0x7feea4160480 2023-12-16T01:26:22.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.233+0000 7f7f914df640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 0x7f7f8c06d060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800c4a0 tx=0x7f7f8800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969663969 0 0) 0x7fee8c003440 con 0x7feea4160480 2023-12-16T01:26:22.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 >> v2:172.21.15.107:3300/0 conn(0x7feea40727b0 msgr2=0x7feea4171b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 --2- 172.21.15.107:0/1222635630 >> v2:172.21.15.107:3300/0 conn(0x7feea40727b0 0x7feea4171b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 >> v1:172.21.15.107:6789/0 conn(0x7feea4166cc0 legacy=0x7feea4169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40caf60 con 0x7feea4160480 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7fee9c001690 con 0x7feea4160480 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 >> v1:172.21.15.157:6789/0 conn(0x7feea4160480 legacy=0x7feea40711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee8c003a60 0x7fee8c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee8c008950 0x7fee8c00ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee8c00b680 0x7fee8c00db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea41671b0 con 0x7fee8c003a60 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c00e420 con 0x7fee8c00b680 2023-12-16T01:26:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.234+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c00e5e0 con 0x7fee8c008950 2023-12-16T01:26:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.237+0000 7feea2ffd640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee8c008950 0x7fee8c00ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.237+0000 7feea3fff640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee8c00b680 0x7fee8c00db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea2ffd640 1 -- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee8c00b680 msgr2=0x7fee8c00db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea2ffd640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee8c00b680 0x7fee8c00db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea2ffd640 1 -- 172.21.15.107:0/1222635630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee8c003a60 msgr2=0x7fee8c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea2ffd640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee8c003a60 0x7fee8c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea2ffd640 1 -- 172.21.15.107:0/1222635630 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40caf60 con 0x7fee8c008950 2023-12-16T01:26:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea3fff640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee8c00b680 0x7fee8c00db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.243+0000 7feea3fff640 1 -- 172.21.15.107:0/1222635630 reap_dead start 2023-12-16T01:26:22.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.250+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88005ce0 con 0x7f7f8c06fd90 2023-12-16T01:26:22.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.250+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88005e40 con 0x7f7f8c06fd90 2023-12-16T01:26:22.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.250+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88007270 con 0x7f7f8c06fd90 2023-12-16T01:26:22.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.250+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c1ffb80 con 0x7f7f8c06fd90 2023-12-16T01:26:22.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.250+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c1fbb20 con 0x7f7f8c06fd90 2023-12-16T01:26:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.255+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c0740e0 con 0x7f7f8c06fd90 2023-12-16T01:26:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.258+0000 7feea2ffd640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee8c008950 0x7fee8c00ade0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee94007fd0 tx=0x7fee8c0036f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6560b7044b9da363 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.260+0000 7ff97ec4f640 1 Processor -- start 2023-12-16T01:26:22.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.260+0000 7ff97ec4f640 1 -- start start 2023-12-16T01:26:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.261+0000 7ff97ec4f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9780c9b70 0x7ff9780ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.261+0000 7ff97ec4f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff978161ac0 con 0x7ff9780c9f50 2023-12-16T01:26:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.261+0000 7ff97ec4f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9781611d0 con 0x7ff9780c4110 2023-12-16T01:26:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.261+0000 7ff97ec4f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97806c130 con 0x7ff9780c9b70 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.261+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400e2d0 con 0x7fee8c008950 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.261+0000 7feea27fc640 1 -- 172.21.15.107:0/1222635630 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940050d0 con 0x7fee8c008950 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 -- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee8c008950 msgr2=0x7fee8c00ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee8c008950 0x7fee8c00ade0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee94007fd0 tx=0x7fee8c0036f0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 -- 172.21.15.107:0/1222635630 shutdown_connections 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 --2- 172.21.15.107:0/1222635630 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee8c008950 0x7fee8c00ade0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 -- 172.21.15.107:0/1222635630 >> 172.21.15.107:0/1222635630 conn(0x7feea406cd60 msgr2=0x7feea406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 -- 172.21.15.107:0/1222635630 shutdown_connections 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.262+0000 7feeaa056640 1 -- 172.21.15.107:0/1222635630 wait complete. 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.264+0000 7feeaa056640 1 Processor -- start 2023-12-16T01:26:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.265+0000 7feeaa056640 1 -- start start 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7ff977fff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff9780c4110 0x7ff97806ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:34958/0 (socket says 172.21.15.107:34958) 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7ff977fff640 1 -- 172.21.15.107:0/2942648803 learned_addr learned my addr 172.21.15.107:0/2942648803 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7ff97c9eb640 1 --2- 172.21.15.107:0/2942648803 >> v2:172.21.15.157:3300/0 conn(0x7ff9780c9b70 0x7ff9780ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7feeaa056640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feea40c55d0 0x7feea4163860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7feeaa056640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feea4163380 0x7feea40c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7feeaa056640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 0x7feea41ff890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7feeaa056640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea41664b0 con 0x7feea4163380 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7feeaa056640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4161450 con 0x7feea40c55d0 2023-12-16T01:26:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7feeaa056640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea40c5ef0 con 0x7feea4168e00 2023-12-16T01:26:22.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7feea3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 0x7feea41ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7feea3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 0x7feea41ff890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33532/0 (socket says 172.21.15.107:33532) 2023-12-16T01:26:22.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7feea3fff640 1 -- 172.21.15.107:0/714745981 learned_addr learned my addr 172.21.15.107:0/714745981 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7ff5b8fb0640 1 Processor -- start 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.266+0000 7ff5b8fb0640 1 -- start start 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7ff5b8fb0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 0x7ff5ac045540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7ff5b8fb0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff5ac045a80 0x7ff5ac04be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7ff5b8fb0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff5ac04c3c0 0x7ff5ac0464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7ff5b8fb0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0e4030 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7ff5b8fb0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0dd890 con 0x7ff5ac045a80 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.268+0000 7ff5b8fb0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0e34b0 con 0x7ff5ac0dd4b0 2023-12-16T01:26:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.269+0000 7feea37fe640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feea40c55d0 0x7feea4163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.272+0000 7feea3fff640 1 -- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feea40c55d0 msgr2=0x7feea4163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.272+0000 7feea3fff640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feea40c55d0 0x7feea4163860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.272+0000 7feea3fff640 1 -- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feea4163380 msgr2=0x7feea40c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.272+0000 7feea3fff640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feea4163380 0x7feea40c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.272+0000 7feea3fff640 1 -- 172.21.15.107:0/714745981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4161eb0 con 0x7feea4168e00 2023-12-16T01:26:22.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.273+0000 7ff9777fe640 1 -- 172.21.15.107:0/2942648803 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320740142 0 0) 0x7ff9781611d0 con 0x7ff9780c4110 2023-12-16T01:26:22.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.273+0000 7ff9777fe640 1 -- 172.21.15.107:0/2942648803 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff968003520 con 0x7ff9780c4110 2023-12-16T01:26:22.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.274+0000 7ff5b259c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 0x7ff5ac045540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.275+0000 7ff97c9eb640 1 -- 172.21.15.107:0/2942648803 >> v1:172.21.15.157:6789/0 conn(0x7ff9780c4110 legacy=0x7ff97806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.275+0000 7ff97c9eb640 1 -- 172.21.15.107:0/2942648803 >> v1:172.21.15.107:6789/0 conn(0x7ff9780c9f50 legacy=0x7ff978157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.275+0000 7ff97c9eb640 1 -- 172.21.15.107:0/2942648803 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9780cab60 con 0x7ff9780c9b70 2023-12-16T01:26:22.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.276+0000 7ff5b259c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 0x7ff5ac045540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33548/0 (socket says 172.21.15.107:33548) 2023-12-16T01:26:22.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.276+0000 7ff5b259c640 1 -- 172.21.15.107:0/2274390571 learned_addr learned my addr 172.21.15.107:0/2274390571 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.276+0000 7feea3fff640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 0x7feea41ff890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feea40c55a0 tx=0x7fee98003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.280+0000 7ff5b259c640 1 -- 172.21.15.107:0/2274390571 >> v2:172.21.15.157:3300/0 conn(0x7ff5ac045a80 msgr2=0x7ff5ac04be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.280+0000 7ff5b259c640 1 --2- 172.21.15.107:0/2274390571 >> v2:172.21.15.157:3300/0 conn(0x7ff5ac045a80 0x7ff5ac04be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.280+0000 7ff5b259c640 1 -- 172.21.15.107:0/2274390571 >> v2:172.21.15.107:3300/0 conn(0x7ff5ac04c3c0 msgr2=0x7ff5ac0464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.280+0000 7ff5b259c640 1 --2- 172.21.15.107:0/2274390571 >> v2:172.21.15.107:3300/0 conn(0x7ff5ac04c3c0 0x7ff5ac0464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.280+0000 7ff5b259c640 1 -- 172.21.15.107:0/2274390571 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0e3790 con 0x7ff5ac0dd4b0 2023-12-16T01:26:22.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.282+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98010990 con 0x7feea4168e00 2023-12-16T01:26:22.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.283+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98010b10 con 0x7feea4168e00 2023-12-16T01:26:22.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.283+0000 7feeaa056640 1 -- 172.21.15.107:0/714745981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea4160ed0 con 0x7feea4168e00 2023-12-16T01:26:22.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.283+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98010ec0 con 0x7feea4168e00 2023-12-16T01:26:22.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.283+0000 7feeaa056640 1 -- 172.21.15.107:0/714745981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea4165c10 con 0x7feea4168e00 2023-12-16T01:26:22.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.284+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c005250 con 0x7feea4168e00 2023-12-16T01:26:22.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.284+0000 7ff97c9eb640 1 --2- 172.21.15.107:0/2942648803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780ca470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9640097d0 tx=0x7ff96402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85798358c3589589 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.289+0000 7ff9777fe640 1 -- 172.21.15.107:0/2942648803 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964031830 con 0x7ff9780c9b70 2023-12-16T01:26:22.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.289+0000 7ff9777fe640 1 -- 172.21.15.107:0/2942648803 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964031990 con 0x7ff9780c9b70 2023-12-16T01:26:22.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.289+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7f880073d0 con 0x7f7f8c06fd90 2023-12-16T01:26:22.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.289+0000 7f7f81ffb640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f7f7006ae90 0x7f7f7006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.290+0000 7ff97ec4f640 1 -- 172.21.15.107:0/2942648803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 msgr2=0x7ff9780ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.290+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/2942648803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780ca470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9640097d0 tx=0x7ff96402b8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.290+0000 7f7f90cde640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f7f7006ae90 0x7f7f7006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.290+0000 7f7f90cde640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f7f7006ae90 0x7f7f7006d350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c036000 tx=0x7f7f7c008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.291+0000 7ff97ec4f640 1 -- 172.21.15.107:0/2942648803 shutdown_connections 2023-12-16T01:26:22.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.291+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/2942648803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780ca470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.291+0000 7ff97ec4f640 1 -- 172.21.15.107:0/2942648803 >> 172.21.15.107:0/2942648803 conn(0x7ff97808b610 msgr2=0x7ff978060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.291+0000 7ff97ec4f640 1 -- 172.21.15.107:0/2942648803 shutdown_connections 2023-12-16T01:26:22.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.291+0000 7ff5b259c640 1 --2- 172.21.15.107:0/2274390571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 0x7ff5ac045540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac008950 tx=0x7ff5a402b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a396e9fe835f940f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.291+0000 7ff97ec4f640 1 -- 172.21.15.107:0/2942648803 wait complete. 2023-12-16T01:26:22.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.293+0000 7ff97ec4f640 1 Processor -- start 2023-12-16T01:26:22.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.293+0000 7ff97ec4f640 1 -- start start 2023-12-16T01:26:22.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.294+0000 7ff97ec4f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9780c4110 0x7ff97814cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.294+0000 7ff97ec4f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.294+0000 7ff97ec4f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9780c9f50 0x7ff97814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.294+0000 7ff97ec4f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781f7190 con 0x7ff9780c9f50 2023-12-16T01:26:22.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.294+0000 7ff97ec4f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781f65f0 con 0x7ff9780c9b70 2023-12-16T01:26:22.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.294+0000 7ff97ec4f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97814cbb0 con 0x7ff9780c4110 2023-12-16T01:26:22.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.295+0000 7ff977fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.295+0000 7ff977fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47522/0 (socket says 172.21.15.107:47522) 2023-12-16T01:26:22.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.295+0000 7ff977fff640 1 -- 172.21.15.107:0/3454026893 learned_addr learned my addr 172.21.15.107:0/3454026893 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.298+0000 7ff977fff640 1 -- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9780c4110 msgr2=0x7ff97814cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.299+0000 7ff977fff640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9780c4110 0x7ff97814cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.299+0000 7ff977fff640 1 -- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9780c9f50 msgr2=0x7ff97814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.299+0000 7ff977fff640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9780c9f50 0x7ff97814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.299+0000 7ff977fff640 1 -- 172.21.15.107:0/3454026893 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009400 con 0x7ff9780c9b70 2023-12-16T01:26:22.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7f5bcd7ba640 1 Processor -- start 2023-12-16T01:26:22.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7f5bcd7ba640 1 -- start start 2023-12-16T01:26:22.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7ff977fff640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780b36b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c4d0 tx=0x7ff96c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7f5bcd7ba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5bc00dd690 0x7f5bc0007d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7f5bcd7ba640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bc004bc00 0x7f5bc0047080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7f5bcd7ba640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc00078b0 con 0x7f5bc00462d0 2023-12-16T01:26:22.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.301+0000 7f5bcd7ba640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00dda70 con 0x7f5bc00dd690 2023-12-16T01:26:22.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.302+0000 7f5bcd7ba640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc0006fc0 con 0x7f5bc004bc00 2023-12-16T01:26:22.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.304+0000 7f5bccfb9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bc004bc00 0x7f5bc0047080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.305+0000 7f5bccfb9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bc004bc00 0x7f5bc0047080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47534/0 (socket says 172.21.15.107:47534) 2023-12-16T01:26:22.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.305+0000 7f5bccfb9640 1 -- 172.21.15.107:0/2519069831 learned_addr learned my addr 172.21.15.107:0/2519069831 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.306+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c005ce0 con 0x7ff9780c9b70 2023-12-16T01:26:22.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.306+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c005e40 con 0x7ff9780c9b70 2023-12-16T01:26:22.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.306+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0072b0 con 0x7ff9780c9b70 2023-12-16T01:26:22.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.306+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97814d510 con 0x7ff9780c9b70 2023-12-16T01:26:22.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.306+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9781f6b40 con 0x7ff9780c9b70 2023-12-16T01:26:22.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.307+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff978161f30 con 0x7ff9780c9b70 2023-12-16T01:26:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.308+0000 7f5bccfb9640 1 -- 172.21.15.107:0/2519069831 >> v2:172.21.15.107:3300/0 conn(0x7f5bc00dd690 msgr2=0x7f5bc0007d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.308+0000 7f5bccfb9640 1 --2- 172.21.15.107:0/2519069831 >> v2:172.21.15.107:3300/0 conn(0x7f5bc00dd690 0x7f5bc0007d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.308+0000 7f5bccfb9640 1 -- 172.21.15.107:0/2519069831 >> v1:172.21.15.107:6789/0 conn(0x7f5bc00462d0 legacy=0x7f5bc0047bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.308+0000 7f5bccfb9640 1 -- 172.21.15.107:0/2519069831 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc004c030 con 0x7f5bc004bc00 2023-12-16T01:26:22.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.318+0000 7fe0a991d640 1 Processor -- start 2023-12-16T01:26:22.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.319+0000 7fe0a991d640 1 -- start start 2023-12-16T01:26:22.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.320+0000 7fe0a991d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe0a414f890 0x7fe0a40c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.320+0000 7fe0a991d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40c7a30 con 0x7fe0a40c52d0 2023-12-16T01:26:22.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.320+0000 7fe0a991d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40c6060 con 0x7fe0a4156320 2023-12-16T01:26:22.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.320+0000 7fe0a991d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a41557f0 con 0x7fe0a414f890 2023-12-16T01:26:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.344+0000 7fc641bd5640 1 Processor -- start 2023-12-16T01:26:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.344+0000 7fc641bd5640 1 -- start start 2023-12-16T01:26:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.345+0000 7fc641bd5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 0x7fc63c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.345+0000 7fc641bd5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc63c0ceef0 0x7fc63c0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.345+0000 7fc641bd5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c15a700 con 0x7fc63c153c70 2023-12-16T01:26:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.345+0000 7fc641bd5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0ca870 con 0x7fc63c0ceef0 2023-12-16T01:26:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.345+0000 7fc641bd5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c159af0 con 0x7fc63c153890 2023-12-16T01:26:22.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.359+0000 7f31cf3d5640 1 Processor -- start 2023-12-16T01:26:22.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.360+0000 7f31cf3d5640 1 -- start start 2023-12-16T01:26:22.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.360+0000 7f31cf3d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.360+0000 7f31cf3d5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31c8156e60 0x7f31c8071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.360+0000 7f31cf3d5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8072b60 con 0x7f31c80bff00 2023-12-16T01:26:22.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.361+0000 7f31cf3d5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80c1a90 con 0x7f31c8156e60 2023-12-16T01:26:22.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.361+0000 7f31cf3d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c1d30 con 0x7f31c81501c0 2023-12-16T01:26:22.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.540+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fee98020460 con 0x7feea4168e00 2023-12-16T01:26:22.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.540+0000 7fee8bfff640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee9006ae90 0x7fee9006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.541+0000 7feea37fe640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee9006ae90 0x7fee9006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.541+0000 7feea37fe640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee9006ae90 0x7fee9006d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0020a0 tx=0x7fee9c001810 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.543+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f88057c30 con 0x7f7f8c06fd90 2023-12-16T01:26:22.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.543+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7f88053f70 con 0x7f7f8c06fd90 2023-12-16T01:26:22.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.544+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee980597b0 con 0x7feea4168e00 2023-12-16T01:26:22.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.545+0000 7ff5b159a640 1 -- 172.21.15.107:0/2274390571 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4030870 con 0x7ff5ac0dd4b0 2023-12-16T01:26:22.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.545+0000 7ff5b159a640 1 -- 172.21.15.107:0/2274390571 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40309d0 con 0x7ff5ac0dd4b0 2023-12-16T01:26:22.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.545+0000 7ff5b159a640 1 -- 172.21.15.107:0/2274390571 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4030da0 con 0x7ff5ac0dd4b0 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/2274390571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 msgr2=0x7ff5ac045540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/2274390571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 0x7ff5ac045540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac008950 tx=0x7ff5a402b9b0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/2274390571 shutdown_connections 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/2274390571 >> v2:172.21.15.107:3300/0 conn(0x7ff5ac04c3c0 0x7ff5ac0464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/2274390571 >> v2:172.21.15.157:3300/0 conn(0x7ff5ac045a80 0x7ff5ac04be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/2274390571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac0dd4b0 0x7ff5ac045540 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/2274390571 >> 172.21.15.107:0/2274390571 conn(0x7ff5ac0505a0 msgr2=0x7ff5ac0509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/2274390571 shutdown_connections 2023-12-16T01:26:22.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.546+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/2274390571 wait complete. 2023-12-16T01:26:22.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.548+0000 7ff5b8fb0640 1 Processor -- start 2023-12-16T01:26:22.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.548+0000 7ff5b8fb0640 1 -- start start 2023-12-16T01:26:22.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.548+0000 7ff5b8fb0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5ac045a80 0x7ff5ac0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.549+0000 7ff5b8fb0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 0x7ff5ac0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.549+0000 7ff5b8fb0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5ac0dd4b0 0x7ff5ac04f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.549+0000 7ff5b8fb0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c72d0 con 0x7ff5ac045a80 2023-12-16T01:26:22.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.549+0000 7ff5b8fb0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c9780 con 0x7ff5ac0dd4b0 2023-12-16T01:26:22.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.549+0000 7ff5b8fb0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c6990 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.555+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fee980553f0 con 0x7feea4168e00 2023-12-16T01:26:22.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.557+0000 7fc63b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 0x7fc63c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.557+0000 7fc63b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 0x7fc63c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33568/0 (socket says 172.21.15.107:33568) 2023-12-16T01:26:22.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.558+0000 7fc63b7fe640 1 -- 172.21.15.107:0/3123533840 learned_addr learned my addr 172.21.15.107:0/3123533840 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.558+0000 7f31cd171640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.559+0000 7f31cd171640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33578/0 (socket says 172.21.15.107:33578) 2023-12-16T01:26:22.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.559+0000 7f31cd171640 1 -- 172.21.15.107:0/2466762389 learned_addr learned my addr 172.21.15.107:0/2466762389 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.561+0000 7fc63b7fe640 1 -- 172.21.15.107:0/3123533840 >> v2:172.21.15.107:3300/0 conn(0x7fc63c0ceef0 msgr2=0x7fc63c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.561+0000 7fc63b7fe640 1 --2- 172.21.15.107:0/3123533840 >> v2:172.21.15.107:3300/0 conn(0x7fc63c0ceef0 0x7fc63c0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.561+0000 7fc63b7fe640 1 -- 172.21.15.107:0/3123533840 >> v1:172.21.15.157:6789/0 conn(0x7fc63c153c70 legacy=0x7fc63c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.561+0000 7fc63b7fe640 1 -- 172.21.15.107:0/3123533840 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c159dd0 con 0x7fc63c153890 2023-12-16T01:26:22.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.562+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff96c007410 con 0x7ff9780c9b70 2023-12-16T01:26:22.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.562+0000 7ff5b1d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 0x7ff5ac0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.562+0000 7ff9757fa640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff95c06ae40 0x7ff95c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.563+0000 7ff97c9eb640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff95c06ae40 0x7ff95c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.563+0000 7ff97c9eb640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff95c06ae40 0x7ff95c06d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff964036000 tx=0x7ff964030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.565+0000 7f31cd171640 1 -- 172.21.15.107:0/2466762389 >> v2:172.21.15.157:3300/0 conn(0x7f31c8156e60 msgr2=0x7f31c8071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.565+0000 7f31cd171640 1 --2- 172.21.15.107:0/2466762389 >> v2:172.21.15.157:3300/0 conn(0x7f31c8156e60 0x7f31c8071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.565+0000 7f31cd171640 1 -- 172.21.15.107:0/2466762389 >> v1:172.21.15.157:6789/0 conn(0x7f31c80bff00 legacy=0x7f31c8072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:22.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.565+0000 7f31cd171640 1 -- 172.21.15.107:0/2466762389 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80c2010 con 0x7f31c81501c0 2023-12-16T01:26:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.566+0000 7ff5b1d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 0x7ff5ac0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33588/0 (socket says 172.21.15.107:33588) 2023-12-16T01:26:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.566+0000 7ff5b1d9b640 1 -- 172.21.15.107:0/1242502816 learned_addr learned my addr 172.21.15.107:0/1242502816 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.567+0000 7fc63b7fe640 1 --2- 172.21.15.107:0/3123533840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 0x7fc63c15d950 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1f8e43dceec94 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.567+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff96c058330 con 0x7ff9780c9b70 2023-12-16T01:26:22.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.572+0000 7fc63a7fc640 1 -- 172.21.15.107:0/3123533840 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c030840 con 0x7fc63c153890 2023-12-16T01:26:22.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.572+0000 7fc63a7fc640 1 -- 172.21.15.107:0/3123533840 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0309a0 con 0x7fc63c153890 2023-12-16T01:26:22.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.572+0000 7fc63a7fc640 1 -- 172.21.15.107:0/3123533840 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c030d30 con 0x7fc63c153890 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 -- 172.21.15.107:0/3123533840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 msgr2=0x7fc63c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 --2- 172.21.15.107:0/3123533840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 0x7fc63c15d950 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009870 tx=0x7fc62c02b980 comp rx=0 tx=0).stop 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 -- 172.21.15.107:0/3123533840 shutdown_connections 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 --2- 172.21.15.107:0/3123533840 >> v2:172.21.15.107:3300/0 conn(0x7fc63c0ceef0 0x7fc63c0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 --2- 172.21.15.107:0/3123533840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153890 0x7fc63c15d950 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 -- 172.21.15.107:0/3123533840 >> 172.21.15.107:0/3123533840 conn(0x7fc63c06ba00 msgr2=0x7fc63c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 -- 172.21.15.107:0/3123533840 shutdown_connections 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7fc641bd5640 1 -- 172.21.15.107:0/3123533840 wait complete. 2023-12-16T01:26:22.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.573+0000 7f31cd171640 1 --2- 172.21.15.107:0/2466762389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8159860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009870 tx=0x7f31c402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c0731dfe89bc1ce server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.575+0000 7fc641bd5640 1 Processor -- start 2023-12-16T01:26:22.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.574+0000 7ff5b259c640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5ac045a80 0x7ff5ac0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.575+0000 7fc641bd5640 1 -- start start 2023-12-16T01:26:22.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.575+0000 7fc641bd5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc63c0ceef0 0x7fc63c1e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.576+0000 7fc641bd5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 0x7fc63c1ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.576+0000 7fc641bd5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153c70 0x7fc63c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.576+0000 7fc641bd5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0b47c0 con 0x7fc63c153890 2023-12-16T01:26:22.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.576+0000 7fc641bd5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1f2ae0 con 0x7fc63c0ceef0 2023-12-16T01:26:22.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.576+0000 7fc641bd5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c15bef0 con 0x7fc63c153c70 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7ff5b1d9b640 1 -- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5ac0dd4b0 msgr2=0x7ff5ac04f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7ff5b1d9b640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5ac0dd4b0 0x7ff5ac04f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7ff5b1d9b640 1 -- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5ac045a80 msgr2=0x7ff5ac0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7ff5b1d9b640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5ac045a80 0x7ff5ac0c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7ff5b1d9b640 1 -- 172.21.15.107:0/1242502816 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40094d0 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7fe0a27fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe0a40c52d0 0x7fe0a4155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57502/0 (socket says 172.21.15.107:57502) 2023-12-16T01:26:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.578+0000 7fe0a27fc640 1 -- 172.21.15.107:0/755072081 learned_addr learned my addr 172.21.15.107:0/755072081 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:22.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.580+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff96c053f70 con 0x7ff9780c9b70 2023-12-16T01:26:22.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.582+0000 7f5bccfb9640 1 --2- 172.21.15.107:0/2519069831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc0047080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5bc802cee0 tx=0x7f5bc80a6360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f7cfa3dee34891 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.583+0000 7fe0a2ffd640 1 --2- 172.21.15.107:0/755072081 >> v2:172.21.15.157:3300/0 conn(0x7fe0a414f890 0x7fe0a40c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.585+0000 7ff5b1d9b640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 0x7ff5ac0c9c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5b406a000 tx=0x7ff5b4068030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.585+0000 7fc63affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 0x7fc63c1ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.586+0000 7fc63affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 0x7fc63c1ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41518/0 (socket says 172.21.15.107:41518) 2023-12-16T01:26:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.586+0000 7fc63affd640 1 -- 172.21.15.107:0/105395759 learned_addr learned my addr 172.21.15.107:0/105395759 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.586+0000 7fe0a1ffb640 1 -- 172.21.15.107:0/755072081 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810424844 0 0) 0x7fe0a40c7a30 con 0x7fe0a40c52d0 2023-12-16T01:26:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.586+0000 7fe0a1ffb640 1 -- 172.21.15.107:0/755072081 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c003520 con 0x7fe0a40c52d0 2023-12-16T01:26:22.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.588+0000 7f31bffff640 1 -- 172.21.15.107:0/2466762389 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4030840 con 0x7f31c81501c0 2023-12-16T01:26:22.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.589+0000 7fc63bfff640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153c70 0x7fc63c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.589+0000 7f31bffff640 1 -- 172.21.15.107:0/2466762389 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c40309a0 con 0x7f31c81501c0 2023-12-16T01:26:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.589+0000 7f31bffff640 1 -- 172.21.15.107:0/2466762389 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4030d30 con 0x7f31c81501c0 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2466762389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 msgr2=0x7f31c8159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2466762389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8159860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009870 tx=0x7f31c402b980 comp rx=0 tx=0).stop 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2466762389 shutdown_connections 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2466762389 >> v2:172.21.15.157:3300/0 conn(0x7f31c8156e60 0x7f31c8071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2466762389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8159860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2466762389 >> 172.21.15.107:0/2466762389 conn(0x7f31c806cd60 msgr2=0x7f31c806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2466762389 shutdown_connections 2023-12-16T01:26:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.590+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2466762389 wait complete. 2023-12-16T01:26:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.591+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/755072081 >> v1:172.21.15.157:6789/0 conn(0x7fe0a4156320 legacy=0x7fe0a4160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.591+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/755072081 >> v1:172.21.15.107:6789/0 conn(0x7fe0a40c52d0 legacy=0x7fe0a4155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.591+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/755072081 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40c6300 con 0x7fe0a414f890 2023-12-16T01:26:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.592+0000 7f31cf3d5640 1 Processor -- start 2023-12-16T01:26:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.592+0000 7f31cf3d5640 1 -- start start 2023-12-16T01:26:22.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.593+0000 7f31cf3d5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 0x7f31c81ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.593+0000 7f31cf3d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.593+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4093670 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.593+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac0cfaa0 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.593+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac0cfd40 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.593+0000 7f31cf3d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c8156e60 0x7f31c806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.594+0000 7f31cf3d5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81ede10 con 0x7f31c8156e60 2023-12-16T01:26:22.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.594+0000 7f31cf3d5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81574d0 con 0x7f31c80bff00 2023-12-16T01:26:22.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.594+0000 7f31cf3d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8158d50 con 0x7f31c81501c0 2023-12-16T01:26:22.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.595+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac0057b0 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.596+0000 7fe0a2ffd640 1 --2- 172.21.15.107:0/755072081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 0x7fe0a40c3fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0940097a0 tx=0x7fe09402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e431f6b987bb9ea server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.596+0000 7fc63affd640 1 -- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153c70 msgr2=0x7fc63c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.596+0000 7fc63affd640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153c70 0x7fc63c0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.596+0000 7fc63affd640 1 -- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc63c0ceef0 msgr2=0x7fc63c1e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.596+0000 7fc63affd640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc63c0ceef0 0x7fc63c1e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.596+0000 7fc63affd640 1 -- 172.21.15.107:0/105395759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0094d0 con 0x7fc63c153890 2023-12-16T01:26:22.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.600+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40937d0 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.600+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4093b80 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.602+0000 7f31cc970640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.603+0000 7f5bc6ffd640 1 -- 172.21.15.107:0/2519069831 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80ae640 con 0x7f5bc004bc00 2023-12-16T01:26:22.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.603+0000 7f5bc6ffd640 1 -- 172.21.15.107:0/2519069831 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc80ae7e0 con 0x7f5bc004bc00 2023-12-16T01:26:22.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.603+0000 7f5bc6ffd640 1 -- 172.21.15.107:0/2519069831 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80aec10 con 0x7f5bc004bc00 2023-12-16T01:26:22.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f31cd171640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 0x7f31c81ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/2519069831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 msgr2=0x7f5bc0047080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/2519069831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc0047080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5bc802cee0 tx=0x7f5bc80a6360 comp rx=0 tx=0).stop 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/2519069831 shutdown_connections 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/2519069831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc0047080 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/2519069831 >> v2:172.21.15.107:3300/0 conn(0x7f5bc00dd690 0x7f5bc0007d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/2519069831 >> 172.21.15.107:0/2519069831 conn(0x7f5bc004dd00 msgr2=0x7f5bc004e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/2519069831 shutdown_connections 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.604+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/2519069831 wait complete. 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.605+0000 7f31cd171640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 0x7f31c81ed8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47604/0 (socket says 172.21.15.107:47604) 2023-12-16T01:26:22.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.605+0000 7f31cd171640 1 -- 172.21.15.107:0/2895375257 learned_addr learned my addr 172.21.15.107:0/2895375257 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.607+0000 7f5bcd7ba640 1 Processor -- start 2023-12-16T01:26:22.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.607+0000 7f5bcd7ba640 1 -- start start 2023-12-16T01:26:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.607+0000 7fc63affd640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 0x7fc63c1ef570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc63000b3e0 tx=0x7fc63000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.608+0000 7f5bcd7ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc00462d0 0x7f5bc00df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.608+0000 7f5bcd7ba640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc00e0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.608+0000 7f5bcd7ba640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bc00dd690 0x7f5bc00472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.608+0000 7f5bcd7ba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00d48a0 con 0x7f5bc00462d0 2023-12-16T01:26:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.608+0000 7f5bcd7ba640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00d5450 con 0x7f5bc004bc00 2023-12-16T01:26:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.608+0000 7f5bcd7ba640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00d66c0 con 0x7f5bc00dd690 2023-12-16T01:26:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.612+0000 7f31cd171640 1 -- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 msgr2=0x7f31c8158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.612+0000 7f31cd171640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.612+0000 7f31cd171640 1 -- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c8156e60 msgr2=0x7f31c806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.612+0000 7f31cd171640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c8156e60 0x7f31c806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.612+0000 7f31cd171640 1 -- 172.21.15.107:0/2895375257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40094d0 con 0x7f31c80bff00 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a1ffb640 1 -- 172.21.15.107:0/755072081 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09402f810 con 0x7fe0a414f890 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a1ffb640 1 -- 172.21.15.107:0/755072081 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09402f970 con 0x7fe0a414f890 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a1ffb640 1 -- 172.21.15.107:0/755072081 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09402fd00 con 0x7fe0a414f890 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 -- 172.21.15.107:0/755072081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 msgr2=0x7fe0a40c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 --2- 172.21.15.107:0/755072081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 0x7fe0a40c3fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0940097a0 tx=0x7fe09402b9f0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 -- 172.21.15.107:0/755072081 shutdown_connections 2023-12-16T01:26:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 --2- 172.21.15.107:0/755072081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 0x7fe0a40c3fb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 -- 172.21.15.107:0/755072081 >> 172.21.15.107:0/755072081 conn(0x7fe0a406a500 msgr2=0x7fe0a406a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 -- 172.21.15.107:0/755072081 shutdown_connections 2023-12-16T01:26:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.613+0000 7fe0a991d640 1 -- 172.21.15.107:0/755072081 wait complete. 2023-12-16T01:26:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.615+0000 7fe0a991d640 1 Processor -- start 2023-12-16T01:26:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.615+0000 7fe0a991d640 1 -- start start 2023-12-16T01:26:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.616+0000 7fe0a991d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 0x7fe0a4138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.616+0000 7fe0a991d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 0x7fe0a413c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.616+0000 7fe0a991d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0a4156320 0x7fe0a413ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.616+0000 7fe0a991d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a413c0f0 con 0x7fe0a40c52d0 2023-12-16T01:26:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.616+0000 7fe0a991d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a413fda0 con 0x7fe0a414f890 2023-12-16T01:26:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.616+0000 7fe0a991d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41595a0 con 0x7fe0a4156320 2023-12-16T01:26:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.617+0000 7f31cd171640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 0x7f31c81ed8d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009870 tx=0x7f31c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.619+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630011830 con 0x7fc63c153890 2023-12-16T01:26:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.619+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6300119b0 con 0x7fc63c153890 2023-12-16T01:26:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.619+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630011d60 con 0x7fc63c153890 2023-12-16T01:26:22.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.619+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c1f2d10 con 0x7fc63c153890 2023-12-16T01:26:22.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.619+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0c41a0 con 0x7fc63c153890 2023-12-16T01:26:22.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.620+0000 7f5bc77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc00e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.620+0000 7f5bc77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc00e0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47614/0 (socket says 172.21.15.107:47614) 2023-12-16T01:26:22.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.620+0000 7f5bc77fe640 1 -- 172.21.15.107:0/4236736904 learned_addr learned my addr 172.21.15.107:0/4236736904 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.621+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c15aeb0 con 0x7fc63c153890 2023-12-16T01:26:22.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.624+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4039d60 con 0x7f31c80bff00 2023-12-16T01:26:22.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.624+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c4044070 con 0x7f31c80bff00 2023-12-16T01:26:22.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.624+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4040770 con 0x7f31c80bff00 2023-12-16T01:26:22.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.624+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8157770 con 0x7f31c80bff00 2023-12-16T01:26:22.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.625+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c8157d30 con 0x7f31c80bff00 2023-12-16T01:26:22.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.625+0000 7fe0a2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 0x7fe0a4138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.626+0000 7fe0a2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 0x7fe0a4138940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41546/0 (socket says 172.21.15.107:41546) 2023-12-16T01:26:22.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.626+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/1097036219 learned_addr learned my addr 172.21.15.107:0/1097036219 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:22.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.626+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c80c77e0 con 0x7f31c80bff00 2023-12-16T01:26:22.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.627+0000 7f5bc7fff640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc00462d0 0x7f5bc00df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.629+0000 7f5bc77fe640 1 -- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bc00dd690 msgr2=0x7f5bc00472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.629+0000 7f5bc77fe640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bc00dd690 0x7f5bc00472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.629+0000 7f5bc77fe640 1 -- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc00462d0 msgr2=0x7f5bc00df610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.629+0000 7f5bc77fe640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc00462d0 0x7f5bc00df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.629+0000 7f5bc77fe640 1 -- 172.21.15.107:0/4236736904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00dfb50 con 0x7f5bc004bc00 2023-12-16T01:26:22.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.630+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/1097036219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0a4156320 msgr2=0x7fe0a413ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.630+0000 7fe0a2ffd640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0a4156320 0x7fe0a413ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.630+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/1097036219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 msgr2=0x7fe0a413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.630+0000 7fe0a2ffd640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 0x7fe0a413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.630+0000 7fe0a2ffd640 1 -- 172.21.15.107:0/1097036219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009400 con 0x7fe0a40c52d0 2023-12-16T01:26:22.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.637+0000 7f5bc77fe640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc00e0360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b410 tx=0x7f5bb400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.716+0000 7fe0a2ffd640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 0x7fe0a4138940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe09402c000 tx=0x7fe094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.745+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc63001a400 con 0x7fc63c153890 2023-12-16T01:26:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.745+0000 7fc623fff640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc62806ae90 0x7fc62806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.745+0000 7fc63b7fe640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc62806ae90 0x7fc62806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.746+0000 7fc63b7fe640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc62806ae90 0x7fc62806d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc62c036000 tx=0x7fc62c03b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.770+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff978161f30 con 0x7ff9780c9b70 2023-12-16T01:26:22.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.827+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee7c0057d0 con 0x7feea4168e00 2023-12-16T01:26:22.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.830+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f8c15b830 con 0x7f7f8c06fd90 2023-12-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.874+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff5b4090070 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.874+0000 7ff5a2ffd640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff59406ae70 0x7ff59406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.874+0000 7ff5b259c640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff59406ae70 0x7ff59406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.875+0000 7ff5b259c640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff59406ae70 0x7ff59406d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4036000 tx=0x7ff5a403b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.882+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5b4090320 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.902+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff5b40ced10 con 0x7ff5ac04c3c0 2023-12-16T01:26:22.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.966+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f31c40408d0 con 0x7f31c80bff00 2023-12-16T01:26:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.967+0000 7f31bdffb640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f31ac06aec0 0x7f31ac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.967+0000 7f31cc970640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f31ac06aec0 0x7f31ac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.967+0000 7f31cc970640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f31ac06aec0 0x7f31ac06d380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f31c8072b30 tx=0x7f31b8008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:22.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.970+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31c407f5a0 con 0x7f31c80bff00 2023-12-16T01:26:22.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.976+0000 7fee8bfff640 1 -- 172.21.15.107:0/714745981 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee98058a10 con 0x7feea4168e00 2023-12-16T01:26:22.977 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee9006ae90 msgr2=0x7fee9006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee9006ae90 0x7fee9006d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0020a0 tx=0x7fee9c001810 comp rx=0 tx=0).stop 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 msgr2=0x7feea41ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 0x7feea41ff890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feea40c55a0 tx=0x7fee98003cd0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 shutdown_connections 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feea4168e00 0x7feea41ff890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feea4163380 0x7feea40c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee9006ae90 0x7fee9006d350 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 --2- 172.21.15.107:0/714745981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feea40c55d0 0x7feea4163860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:22.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 >> 172.21.15.107:0/714745981 conn(0x7feea406cd60 msgr2=0x7feea41f8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:22.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 shutdown_connections 2023-12-16T01:26:22.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.978+0000 7fee89ffb640 1 -- 172.21.15.107:0/714745981 wait complete. 2023-12-16T01:26:22.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.983+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f31c407b1e0 con 0x7f31c80bff00 2023-12-16T01:26:22.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.983+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4011830 con 0x7f5bc004bc00 2023-12-16T01:26:22.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.983+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb4011990 con 0x7f5bc004bc00 2023-12-16T01:26:22.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.983+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc00d57d0 con 0x7f5bc004bc00 2023-12-16T01:26:22.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.983+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc00d5d90 con 0x7f5bc004bc00 2023-12-16T01:26:22.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.984+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4011d40 con 0x7f5bc004bc00 2023-12-16T01:26:22.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:22.984+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00d6850 con 0x7f5bc004bc00 2023-12-16T01:26:22.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.2 2023-12-16T01:26:23.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.023+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc630058ff0 con 0x7fc63c153890 2023-12-16T01:26:23.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.023+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc630054c30 con 0x7fc63c153890 2023-12-16T01:26:23.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.028+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09403c040 con 0x7fe0a40c52d0 2023-12-16T01:26:23.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.028+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0940378f0 con 0x7fe0a40c52d0 2023-12-16T01:26:23.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.028+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094037ca0 con 0x7fe0a40c52d0 2023-12-16T01:26:23.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.028+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a4139200 con 0x7fe0a40c52d0 2023-12-16T01:26:23.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.028+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a413faa0 con 0x7fe0a40c52d0 2023-12-16T01:26:23.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.030+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a413c230 con 0x7fe0a40c52d0 2023-12-16T01:26:23.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.037+0000 7f7f81ffb640 1 -- 172.21.15.107:0/20462996 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f8c15b830 con 0x7f7f8c06fd90 2023-12-16T01:26:23.038 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:23.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f7f7006ae90 msgr2=0x7f7f7006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f7f7006ae90 0x7f7f7006d350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c036000 tx=0x7f7f7c008030 comp rx=0 tx=0).stop 2023-12-16T01:26:23.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 msgr2=0x7f7f8c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 0x7f7f8c06d060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800c4a0 tx=0x7f7f8800c960 comp rx=0 tx=0).stop 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 shutdown_connections 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7f8c0c9de0 0x7f7f8c0c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f7f7006ae90 0x7f7f7006d350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f8c0c9a00 0x7f7f8c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 --2- 172.21.15.107:0/20462996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f8c06fd90 0x7f7f8c06d060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.040+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 >> 172.21.15.107:0/20462996 conn(0x7f7f8c070bb0 msgr2=0x7f7f8c1504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.041+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 shutdown_connections 2023-12-16T01:26:23.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.041+0000 7f7f93743640 1 -- 172.21.15.107:0/20462996 wait complete. 2023-12-16T01:26:23.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.3 2023-12-16T01:26:23.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.190+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff5ac033e70 con 0x7ff5ac04c3c0 2023-12-16T01:26:23.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.194+0000 7ff5a2ffd640 1 -- 172.21.15.107:0/1242502816 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5b40d2330 con 0x7ff5ac04c3c0 2023-12-16T01:26:23.195 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff59406ae70 msgr2=0x7ff59406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff59406ae70 0x7ff59406d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4036000 tx=0x7ff5a403b040 comp rx=0 tx=0).stop 2023-12-16T01:26:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 msgr2=0x7ff5ac0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 0x7ff5ac0c9c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5b406a000 tx=0x7ff5b4068030 comp rx=0 tx=0).stop 2023-12-16T01:26:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 shutdown_connections 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff59406ae70 0x7ff59406d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5ac0dd4b0 0x7ff5ac04f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5ac04c3c0 0x7ff5ac0c9c10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 --2- 172.21.15.107:0/1242502816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5ac045a80 0x7ff5ac0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 >> 172.21.15.107:0/1242502816 conn(0x7ff5ac0505a0 msgr2=0x7ff5ac0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 shutdown_connections 2023-12-16T01:26:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.197+0000 7ff5b8fb0640 1 -- 172.21.15.107:0/1242502816 wait complete. 2023-12-16T01:26:23.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.7 2023-12-16T01:26:23.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.214+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc63c15aeb0 con 0x7fc63c153890 2023-12-16T01:26:23.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.244+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5bb401a400 con 0x7f5bc004bc00 2023-12-16T01:26:23.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.244+0000 7f5bc4ff9640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5bac06ae40 0x7f5bac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:23.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.244+0000 7f5bc7fff640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5bac06ae40 0x7f5bac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:23.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.245+0000 7f5bc7fff640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5bac06ae40 0x7f5bac06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00a770 tx=0x7f5bbc008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:23.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.245+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bb4059200 con 0x7f5bc004bc00 2023-12-16T01:26:23.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.256+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5bb4054e40 con 0x7f5bc004bc00 2023-12-16T01:26:23.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.261+0000 7ff9757fa640 1 -- 172.21.15.107:0/3454026893 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff978161f30 con 0x7ff9780c9b70 2023-12-16T01:26:23.262 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.263+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff95c06ae40 msgr2=0x7ff95c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.263+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff95c06ae40 0x7ff95c06d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff964036000 tx=0x7ff964030000 comp rx=0 tx=0).stop 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.263+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 msgr2=0x7ff9780b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.263+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780b36b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c4d0 tx=0x7ff96c00c990 comp rx=0 tx=0).stop 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 shutdown_connections 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9780c9f50 0x7ff97814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff95c06ae40 0x7ff95c06d300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9780c9b70 0x7ff9780b36b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 --2- 172.21.15.107:0/3454026893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9780c4110 0x7ff97814cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 >> 172.21.15.107:0/3454026893 conn(0x7ff97808b610 msgr2=0x7ff9780b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 shutdown_connections 2023-12-16T01:26:23.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.264+0000 7ff97ec4f640 1 -- 172.21.15.107:0/3454026893 wait complete. 2023-12-16T01:26:23.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.1 2023-12-16T01:26:23.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.285+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f31c8067500 con 0x7f31c80bff00 2023-12-16T01:26:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.289+0000 7f31bdffb640 1 -- 172.21.15.107:0/2895375257 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31c4046090 con 0x7f31c80bff00 2023-12-16T01:26:23.290 INFO:teuthology.orchestra.run.smithi107.stdout:60129542154 2023-12-16T01:26:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f31ac06aec0 msgr2=0x7f31ac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f31ac06aec0 0x7f31ac06d380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f31c8072b30 tx=0x7f31b8008040 comp rx=0 tx=0).stop 2023-12-16T01:26:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 msgr2=0x7f31c81ed8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 0x7f31c81ed8d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009870 tx=0x7f31c4004730 comp rx=0 tx=0).stop 2023-12-16T01:26:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 shutdown_connections 2023-12-16T01:26:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c8156e60 0x7f31c806ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31c81501c0 0x7f31c8158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f31ac06aec0 0x7f31ac06d380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 --2- 172.21.15.107:0/2895375257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31c80bff00 0x7f31c81ed8d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 >> 172.21.15.107:0/2895375257 conn(0x7f31c806cd60 msgr2=0x7f31c806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 shutdown_connections 2023-12-16T01:26:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.292+0000 7f31cf3d5640 1 -- 172.21.15.107:0/2895375257 wait complete. 2023-12-16T01:26:23.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.6 2023-12-16T01:26:23.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.309+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe09402d3a0 con 0x7fe0a40c52d0 2023-12-16T01:26:23.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.310+0000 7fe08bfff640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe09006ae40 0x7fe09006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:23.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.310+0000 7fe0a27fc640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe09006ae40 0x7fe09006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:23.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.310+0000 7fe0a27fc640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe09006ae40 0x7fe09006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4140d80 tx=0x7fe098007930 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:23.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.324+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe09407ab00 con 0x7fe0a40c52d0 2023-12-16T01:26:23.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.324+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe094076740 con 0x7fe0a40c52d0 2023-12-16T01:26:23.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.390+0000 7fc623fff640 1 -- 172.21.15.107:0/105395759 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc63c15aeb0 con 0x7fc63c153890 2023-12-16T01:26:23.391 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc62806ae90 msgr2=0x7fc62806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc62806ae90 0x7fc62806d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc62c036000 tx=0x7fc62c03b040 comp rx=0 tx=0).stop 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 msgr2=0x7fc63c1ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 0x7fc63c1ef570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc63000b3e0 tx=0x7fc63000b8a0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 shutdown_connections 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc63c153c70 0x7fc63c0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc63c153890 0x7fc63c1ef570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc62806ae90 0x7fc62806d350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 --2- 172.21.15.107:0/105395759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc63c0ceef0 0x7fc63c1e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.392+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 >> 172.21.15.107:0/105395759 conn(0x7fc63c06ba00 msgr2=0x7fc63c1495f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.393+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 shutdown_connections 2023-12-16T01:26:23.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.393+0000 7fc641bd5640 1 -- 172.21.15.107:0/105395759 wait complete. 2023-12-16T01:26:23.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.5 2023-12-16T01:26:23.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.458+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5bc00057b0 con 0x7f5bc004bc00 2023-12-16T01:26:23.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.462+0000 7f5bc4ff9640 1 -- 172.21.15.107:0/4236736904 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bb4015020 con 0x7f5bc004bc00 2023-12-16T01:26:23.463 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:23.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5bac06ae40 msgr2=0x7f5bac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5bac06ae40 0x7f5bac06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00a770 tx=0x7f5bbc008040 comp rx=0 tx=0).stop 2023-12-16T01:26:23.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 msgr2=0x7f5bc00e0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc00e0360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b410 tx=0x7f5bb400b8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 shutdown_connections 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bc00dd690 0x7f5bc00472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5bac06ae40 0x7f5bac06d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bc004bc00 0x7f5bc00e0360 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 --2- 172.21.15.107:0/4236736904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc00462d0 0x7f5bc00df610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 >> 172.21.15.107:0/4236736904 conn(0x7f5bc004dd00 msgr2=0x7f5bc004d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 shutdown_connections 2023-12-16T01:26:23.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.464+0000 7f5bcd7ba640 1 -- 172.21.15.107:0/4236736904 wait complete. 2023-12-16T01:26:23.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.4 2023-12-16T01:26:23.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.501+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0a4139720 con 0x7fe0a40c52d0 2023-12-16T01:26:23.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.505+0000 7fe08bfff640 1 -- 172.21.15.107:0/1097036219 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe094047070 con 0x7fe0a40c52d0 2023-12-16T01:26:23.506 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:23.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe09006ae40 msgr2=0x7fe09006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe09006ae40 0x7fe09006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4140d80 tx=0x7fe098007930 comp rx=0 tx=0).stop 2023-12-16T01:26:23.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 msgr2=0x7fe0a4138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 0x7fe0a4138940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe09402c000 tx=0x7fe094004730 comp rx=0 tx=0).stop 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 shutdown_connections 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0a4156320 0x7fe0a413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe09006ae40 0x7fe09006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a414f890 0x7fe0a413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 --2- 172.21.15.107:0/1097036219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a40c52d0 0x7fe0a4138940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 >> 172.21.15.107:0/1097036219 conn(0x7fe0a406a500 msgr2=0x7fe0a406f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 shutdown_connections 2023-12-16T01:26:23.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:23.507+0000 7fe0a991d640 1 -- 172.21.15.107:0/1097036219 wait complete. 2023-12-16T01:26:23.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.0 2023-12-16T01:26:23.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T01:26:24.057 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T01:26:24.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.095+0000 7f3f03d61640 1 Processor -- start 2023-12-16T01:26:24.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.096+0000 7f3f03d61640 1 -- start start 2023-12-16T01:26:24.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.096+0000 7f3f03d61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc0c9dd0 0x7f3efc0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.096+0000 7f3f03d61640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3efc15d830 0x7f3efc1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.096+0000 7f3f03d61640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc15cc90 con 0x7f3efc0ca1b0 2023-12-16T01:26:24.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.096+0000 7f3f03d61640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc1596a0 con 0x7f3efc15d830 2023-12-16T01:26:24.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.096+0000 7f3f03d61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0c7c40 con 0x7f3efc0c9dd0 2023-12-16T01:26:24.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.097+0000 7f3f022fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3efc15d830 0x7f3efc1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.097+0000 7f3f01afd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc0c9dd0 0x7f3efc0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.097+0000 7f3f022fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3efc15d830 0x7f3efc1533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47626/0 (socket says 172.21.15.107:47626) 2023-12-16T01:26:24.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.097+0000 7f3f022fe640 1 -- 172.21.15.107:0/3281246161 learned_addr learned my addr 172.21.15.107:0/3281246161 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.100+0000 7f3f01afd640 1 -- 172.21.15.107:0/3281246161 >> v2:172.21.15.157:3300/0 conn(0x7f3efc15d830 msgr2=0x7f3efc1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.100+0000 7f3f01afd640 1 --2- 172.21.15.107:0/3281246161 >> v2:172.21.15.157:3300/0 conn(0x7f3efc15d830 0x7f3efc1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.100+0000 7f3f01afd640 1 -- 172.21.15.107:0/3281246161 >> v1:172.21.15.157:6789/0 conn(0x7f3efc0ca1b0 legacy=0x7f3efc15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.100+0000 7f3f01afd640 1 -- 172.21.15.107:0/3281246161 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc1598b0 con 0x7f3efc0c9dd0 2023-12-16T01:26:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.102+0000 7f3f01afd640 1 --2- 172.21.15.107:0/3281246161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc0c9dd0 0x7f3efc0c7700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0097a0 tx=0x7f3eec02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c03270a35f8493 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.106+0000 7f3f00afb640 1 -- 172.21.15.107:0/3281246161 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec030610 con 0x7f3efc0c9dd0 2023-12-16T01:26:24.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.106+0000 7f3f00afb640 1 -- 172.21.15.107:0/3281246161 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec030770 con 0x7f3efc0c9dd0 2023-12-16T01:26:24.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.106+0000 7f3f00afb640 1 -- 172.21.15.107:0/3281246161 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec030b00 con 0x7f3efc0c9dd0 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 -- 172.21.15.107:0/3281246161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc0c9dd0 msgr2=0x7f3efc0c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 --2- 172.21.15.107:0/3281246161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc0c9dd0 0x7f3efc0c7700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0097a0 tx=0x7f3eec02b960 comp rx=0 tx=0).stop 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 -- 172.21.15.107:0/3281246161 shutdown_connections 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 --2- 172.21.15.107:0/3281246161 >> v2:172.21.15.157:3300/0 conn(0x7f3efc15d830 0x7f3efc1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 --2- 172.21.15.107:0/3281246161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc0c9dd0 0x7f3efc0c7700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 -- 172.21.15.107:0/3281246161 >> 172.21.15.107:0/3281246161 conn(0x7f3efc061100 msgr2=0x7f3efc0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 -- 172.21.15.107:0/3281246161 shutdown_connections 2023-12-16T01:26:24.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.107+0000 7f3f03d61640 1 -- 172.21.15.107:0/3281246161 wait complete. 2023-12-16T01:26:24.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.108+0000 7f3f03d61640 1 Processor -- start 2023-12-16T01:26:24.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.108+0000 7f3f03d61640 1 -- start start 2023-12-16T01:26:24.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.109+0000 7f3f03d61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3efc0c9dd0 0x7f3efc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.109+0000 7f3f03d61640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3efc0ca1b0 0x7f3efc0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.109+0000 7f3f03d61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc15d830 0x7f3efc1efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.109+0000 7f3f03d61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc158b10 con 0x7f3efc0c9dd0 2023-12-16T01:26:24.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.109+0000 7f3f03d61640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1e5160 con 0x7f3efc0ca1b0 2023-12-16T01:26:24.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.109+0000 7f3f03d61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1e5440 con 0x7f3efc15d830 2023-12-16T01:26:24.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.110+0000 7f3f012fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3efc0ca1b0 0x7f3efc0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.110+0000 7f3f022fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc15d830 0x7f3efc1efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.110+0000 7f3f01afd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3efc0c9dd0 0x7f3efc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.110+0000 7f3f01afd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3efc0c9dd0 0x7f3efc153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41548/0 (socket says 172.21.15.107:41548) 2023-12-16T01:26:24.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.110+0000 7f3f01afd640 1 -- 172.21.15.107:0/322098791 learned_addr learned my addr 172.21.15.107:0/322098791 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.113+0000 7f3f022fe640 1 -- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3efc0ca1b0 msgr2=0x7f3efc0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.113+0000 7f3f022fe640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3efc0ca1b0 0x7f3efc0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.113+0000 7f3f022fe640 1 -- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3efc0c9dd0 msgr2=0x7f3efc153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.113+0000 7f3f022fe640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3efc0c9dd0 0x7f3efc153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.113+0000 7f3f022fe640 1 -- 172.21.15.107:0/322098791 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009400 con 0x7f3efc15d830 2023-12-16T01:26:24.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.115+0000 7f3f022fe640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc15d830 0x7f3efc1efa80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400eba0 tx=0x7f3ef400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.119+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400cb20 con 0x7f3efc15d830 2023-12-16T01:26:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.119+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400f040 con 0x7f3efc15d830 2023-12-16T01:26:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.119+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400cea0 con 0x7f3efc15d830 2023-12-16T01:26:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.119+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc1e5720 con 0x7f3efc15d830 2023-12-16T01:26:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.119+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc1ef560 con 0x7f3efc15d830 2023-12-16T01:26:24.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.120+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc1ef3c0 con 0x7f3efc15d830 2023-12-16T01:26:24.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.138+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3ef4003990 con 0x7f3efc15d830 2023-12-16T01:26:24.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.138+0000 7f3ef27fc640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3ee006ae40 0x7f3ee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.139+0000 7f3f01afd640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3ee006ae40 0x7f3ee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.139+0000 7f3f01afd640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3ee006ae40 0x7f3ee006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3eec02b9a0 tx=0x7f3eec008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.140+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ef4059500 con 0x7f3efc15d830 2023-12-16T01:26:24.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.161+0000 7f2c063a9640 1 Processor -- start 2023-12-16T01:26:24.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.161+0000 7f2c063a9640 1 -- start start 2023-12-16T01:26:24.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.161+0000 7f2c063a9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2c000c5690 0x7f2c001573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.162+0000 7f2c063a9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c000c5a70 con 0x7f2c0006f090 2023-12-16T01:26:24.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.162+0000 7f2c063a9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c000c7710 con 0x7f2c000c7ba0 2023-12-16T01:26:24.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.162+0000 7f2c063a9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0015b740 con 0x7f2c000c5690 2023-12-16T01:26:24.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.162+0000 7f2bff7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2c0006f090 0x7f2c000c8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57504/0 (socket says 172.21.15.107:57504) 2023-12-16T01:26:24.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.162+0000 7f2bff7fe640 1 -- 172.21.15.107:0/3207423983 learned_addr learned my addr 172.21.15.107:0/3207423983 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:24.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.162+0000 7f2bfffff640 1 --2- 172.21.15.107:0/3207423983 >> v2:172.21.15.157:3300/0 conn(0x7f2c000c5690 0x7f2c001573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.165+0000 7f2bfeffd640 1 -- 172.21.15.107:0/3207423983 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518952703 0 0) 0x7f2c000c5a70 con 0x7f2c0006f090 2023-12-16T01:26:24.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.165+0000 7f2bfeffd640 1 -- 172.21.15.107:0/3207423983 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be8003520 con 0x7f2c0006f090 2023-12-16T01:26:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.167+0000 7f2bfffff640 1 -- 172.21.15.107:0/3207423983 >> v1:172.21.15.157:6789/0 conn(0x7f2c000c7ba0 legacy=0x7f2c000c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.167+0000 7f2bfffff640 1 -- 172.21.15.107:0/3207423983 >> v1:172.21.15.107:6789/0 conn(0x7f2c0006f090 legacy=0x7f2c000c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.167+0000 7f2bfffff640 1 -- 172.21.15.107:0/3207423983 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c000c5e10 con 0x7f2c000c5690 2023-12-16T01:26:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.173+0000 7f2bfffff640 1 --2- 172.21.15.107:0/3207423983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c5690 0x7f2c001573d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00097a0 tx=0x7f2bf002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73a350c9ffb73d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.177+0000 7f2bfeffd640 1 -- 172.21.15.107:0/3207423983 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf002f810 con 0x7f2c000c5690 2023-12-16T01:26:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.177+0000 7f2bfeffd640 1 -- 172.21.15.107:0/3207423983 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf002f970 con 0x7f2c000c5690 2023-12-16T01:26:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.177+0000 7f2bfeffd640 1 -- 172.21.15.107:0/3207423983 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf002fd00 con 0x7f2c000c5690 2023-12-16T01:26:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 -- 172.21.15.107:0/3207423983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c5690 msgr2=0x7f2c001573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 --2- 172.21.15.107:0/3207423983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c5690 0x7f2c001573d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00097a0 tx=0x7f2bf002b9f0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 -- 172.21.15.107:0/3207423983 shutdown_connections 2023-12-16T01:26:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 --2- 172.21.15.107:0/3207423983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c5690 0x7f2c001573d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 -- 172.21.15.107:0/3207423983 >> 172.21.15.107:0/3207423983 conn(0x7f2c0006fa90 msgr2=0x7f2c0006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 -- 172.21.15.107:0/3207423983 shutdown_connections 2023-12-16T01:26:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.178+0000 7f2c063a9640 1 -- 172.21.15.107:0/3207423983 wait complete. 2023-12-16T01:26:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.179+0000 7f2c063a9640 1 Processor -- start 2023-12-16T01:26:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.179+0000 7f2c063a9640 1 -- start start 2023-12-16T01:26:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c063a9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c0006f090 0x7f2c001f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c063a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 0x7f2c001ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c063a9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c7ba0 0x7f2c001e5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c063a9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c001f3110 con 0x7f2c000c5690 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c063a9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00150f80 con 0x7f2c000c7ba0 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c063a9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00150a80 con 0x7f2c0006f090 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2bff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 0x7f2c001ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.180+0000 7f2c04946640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c7ba0 0x7f2c001e5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.181+0000 7f2bff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 0x7f2c001ef5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41550/0 (socket says 172.21.15.107:41550) 2023-12-16T01:26:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.181+0000 7f2bff7fe640 1 -- 172.21.15.107:0/2246158802 learned_addr learned my addr 172.21.15.107:0/2246158802 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.184+0000 7f2bff7fe640 1 -- 172.21.15.107:0/2246158802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c0006f090 msgr2=0x7f2c001f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.184+0000 7f2bff7fe640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c0006f090 0x7f2c001f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.184+0000 7f2bff7fe640 1 -- 172.21.15.107:0/2246158802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c7ba0 msgr2=0x7f2c001e5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.184+0000 7f2bff7fe640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c7ba0 0x7f2c001e5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.184+0000 7f2bff7fe640 1 -- 172.21.15.107:0/2246158802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009400 con 0x7f2c000c5690 2023-12-16T01:26:24.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.186+0000 7f2bff7fe640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 0x7f2c001ef5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c410 tx=0x7f2bf400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.190+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4005ce0 con 0x7f2c000c5690 2023-12-16T01:26:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.190+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf4005e40 con 0x7f2c000c5690 2023-12-16T01:26:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.190+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf40072f0 con 0x7f2c000c5690 2023-12-16T01:26:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.190+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c00151220 con 0x7f2c000c5690 2023-12-16T01:26:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.190+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c001eedb0 con 0x7f2c000c5690 2023-12-16T01:26:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.191+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c000740e0 con 0x7f2c000c5690 2023-12-16T01:26:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.210+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2bf4007510 con 0x7f2c000c5690 2023-12-16T01:26:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.211+0000 7f2bfcff9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2bec06ae40 0x7f2bec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.211+0000 7f2bfffff640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2bec06ae40 0x7f2bec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.211+0000 7f2bfffff640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2bec06ae40 0x7f2bec06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0036000 tx=0x7f2bf0030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T01:26:24.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T01:26:24.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T01:26:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.315+0000 7f51d5e1c640 1 Processor -- start 2023-12-16T01:26:24.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.316+0000 7f51d5e1c640 1 -- start start 2023-12-16T01:26:24.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.316+0000 7f51d5e1c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f51d0153650 0x7f51d00c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.316+0000 7f51d5e1c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 0x7f51d00ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.316+0000 7f51d5e1c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d0159860 con 0x7f51d006f550 2023-12-16T01:26:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.316+0000 7f51d5e1c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d00c3fb0 con 0x7f51d0153650 2023-12-16T01:26:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.316+0000 7f51d5e1c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d0159670 con 0x7f51d015d750 2023-12-16T01:26:24.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.383+0000 7fe5ed7c2640 1 Processor -- start 2023-12-16T01:26:24.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.383+0000 7fe5ed7c2640 1 -- start start 2023-12-16T01:26:24.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.384+0000 7fe5ed7c2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 0x7fe5e815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.384+0000 7fe5ed7c2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5e806f590 0x7fe5e815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.384+0000 7fe5ed7c2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e815cc90 con 0x7fe5e80c9dd0 2023-12-16T01:26:24.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.384+0000 7fe5ed7c2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e81596a0 con 0x7fe5e806f590 2023-12-16T01:26:24.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.384+0000 7fe5ed7c2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e81598b0 con 0x7fe5e80ca1b0 2023-12-16T01:26:24.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.384+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3ef4055840 con 0x7f3efc15d830 2023-12-16T01:26:24.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.388+0000 7f51cffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 0x7f51d00ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.389+0000 7f51cffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 0x7f51d00ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33682/0 (socket says 172.21.15.107:33682) 2023-12-16T01:26:24.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.389+0000 7f51cffff640 1 -- 172.21.15.107:0/567349657 learned_addr learned my addr 172.21.15.107:0/567349657 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.389+0000 7fe5e67fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 0x7fe5e815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.391+0000 7f51cffff640 1 -- 172.21.15.107:0/567349657 >> v2:172.21.15.107:3300/0 conn(0x7f51d0153650 msgr2=0x7f51d00c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.391+0000 7f51cffff640 1 --2- 172.21.15.107:0/567349657 >> v2:172.21.15.107:3300/0 conn(0x7f51d0153650 0x7f51d00c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.391+0000 7f51cffff640 1 -- 172.21.15.107:0/567349657 >> v1:172.21.15.107:6789/0 conn(0x7f51d006f550 legacy=0x7f51d015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.391+0000 7f51cffff640 1 -- 172.21.15.107:0/567349657 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0159b40 con 0x7f51d015d750 2023-12-16T01:26:24.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.393+0000 7fe5e67fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 0x7fe5e815d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33684/0 (socket says 172.21.15.107:33684) 2023-12-16T01:26:24.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.393+0000 7fe5e67fc640 1 -- 172.21.15.107:0/768852577 learned_addr learned my addr 172.21.15.107:0/768852577 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.394+0000 7f51cffff640 1 --2- 172.21.15.107:0/567349657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 0x7f51d00ca060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009e50 tx=0x7f51c802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1434bc8253b59b9a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.397+0000 7fe5e67fc640 1 -- 172.21.15.107:0/768852577 >> v2:172.21.15.107:3300/0 conn(0x7fe5e806f590 msgr2=0x7fe5e815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.397+0000 7fe5e67fc640 1 --2- 172.21.15.107:0/768852577 >> v2:172.21.15.107:3300/0 conn(0x7fe5e806f590 0x7fe5e815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.397+0000 7fe5e67fc640 1 -- 172.21.15.107:0/768852577 >> v1:172.21.15.107:6789/0 conn(0x7fe5e80c9dd0 legacy=0x7fe5e80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.397+0000 7fe5e67fc640 1 -- 172.21.15.107:0/768852577 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8159b90 con 0x7fe5e80ca1b0 2023-12-16T01:26:24.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.401+0000 7f51ce7fc640 1 -- 172.21.15.107:0/567349657 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c802cb00 con 0x7f51d015d750 2023-12-16T01:26:24.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.401+0000 7f51ce7fc640 1 -- 172.21.15.107:0/567349657 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c802cc60 con 0x7f51d015d750 2023-12-16T01:26:24.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.401+0000 7f51ce7fc640 1 -- 172.21.15.107:0/567349657 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c80343f0 con 0x7f51d015d750 2023-12-16T01:26:24.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 -- 172.21.15.107:0/567349657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 msgr2=0x7f51d00ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/567349657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 0x7f51d00ca060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009e50 tx=0x7f51c802bf60 comp rx=0 tx=0).stop 2023-12-16T01:26:24.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 -- 172.21.15.107:0/567349657 shutdown_connections 2023-12-16T01:26:24.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/567349657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d015d750 0x7f51d00ca060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/567349657 >> v2:172.21.15.107:3300/0 conn(0x7f51d0153650 0x7f51d00c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 -- 172.21.15.107:0/567349657 >> 172.21.15.107:0/567349657 conn(0x7f51d0061100 msgr2=0x7f51d00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 -- 172.21.15.107:0/567349657 shutdown_connections 2023-12-16T01:26:24.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.402+0000 7f51d5e1c640 1 -- 172.21.15.107:0/567349657 wait complete. 2023-12-16T01:26:24.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.403+0000 7f51d5e1c640 1 Processor -- start 2023-12-16T01:26:24.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.403+0000 7f51d5e1c640 1 -- start start 2023-12-16T01:26:24.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7fe5e67fc640 1 --2- 172.21.15.107:0/768852577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 0x7fe5e815d120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009870 tx=0x7fe5dc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c5be76cd9fe5d4f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7f51d5e1c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51d006f550 0x7f51d0154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7f51d5e1c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d0153650 0x7f51d0148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7f51d5e1c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 0x7f51d01f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7f51d5e1c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d014d940 con 0x7f51d006f550 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7f51d5e1c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d014d410 con 0x7f51d015d750 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.404+0000 7f51d5e1c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01f3170 con 0x7f51d0153650 2023-12-16T01:26:24.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.405+0000 7f51cffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 0x7f51d01f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.405+0000 7f51cffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 0x7f51d01f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47650/0 (socket says 172.21.15.107:47650) 2023-12-16T01:26:24.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.405+0000 7f51cffff640 1 -- 172.21.15.107:0/3857421978 learned_addr learned my addr 172.21.15.107:0/3857421978 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.408+0000 7fe5e5ffb640 1 -- 172.21.15.107:0/768852577 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc030840 con 0x7fe5e80ca1b0 2023-12-16T01:26:24.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.408+0000 7fe5e5ffb640 1 -- 172.21.15.107:0/768852577 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc0309a0 con 0x7fe5e80ca1b0 2023-12-16T01:26:24.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.408+0000 7fe5e5ffb640 1 -- 172.21.15.107:0/768852577 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc030d30 con 0x7fe5e80ca1b0 2023-12-16T01:26:24.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T01:26:24.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.408+0000 7f51ceffd640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d0153650 0x7f51d0148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/768852577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 msgr2=0x7fe5e815d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/768852577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 0x7fe5e815d120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009870 tx=0x7fe5dc02b980 comp rx=0 tx=0).stop 2023-12-16T01:26:24.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/768852577 shutdown_connections 2023-12-16T01:26:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/768852577 >> v2:172.21.15.107:3300/0 conn(0x7fe5e806f590 0x7fe5e815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/768852577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e80ca1b0 0x7fe5e815d120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/768852577 >> 172.21.15.107:0/768852577 conn(0x7fe5e8061100 msgr2=0x7fe5e80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/768852577 shutdown_connections 2023-12-16T01:26:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/768852577 wait complete. 2023-12-16T01:26:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7f51cffff640 1 -- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d0153650 msgr2=0x7f51d0148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7f51cffff640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d0153650 0x7f51d0148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7f51cffff640 1 -- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51d006f550 msgr2=0x7f51d0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7f51cffff640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51d006f550 0x7f51d0154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.409+0000 7f51cffff640 1 -- 172.21.15.107:0/3857421978 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8009b30 con 0x7f51d015d750 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.410+0000 7fe5ed7c2640 1 Processor -- start 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.410+0000 7fe5ed7c2640 1 -- start start 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.411+0000 7fe5ed7c2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e806f590 0x7fe5e815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.411+0000 7fe5ed7c2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5e80c9dd0 0x7fe5e81f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.411+0000 7fe5ed7c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5e80ca1b0 0x7fe5e81f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.411+0000 7fe5ed7c2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e81eedf0 con 0x7fe5e80ca1b0 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.411+0000 7fe5ed7c2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e81f2360 con 0x7fe5e80c9dd0 2023-12-16T01:26:24.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.411+0000 7fe5ed7c2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e81ef000 con 0x7fe5e806f590 2023-12-16T01:26:24.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.412+0000 7f51cffff640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 0x7f51d01f2440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51c8036040 tx=0x7f51c8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.412+0000 7fe5e67fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5e80c9dd0 0x7fe5e81f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.412+0000 7fe5e6ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e806f590 0x7fe5e815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.413+0000 7fe5e67fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5e80c9dd0 0x7fe5e81f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47662/0 (socket says 172.21.15.107:47662) 2023-12-16T01:26:24.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.413+0000 7fe5e67fc640 1 -- 172.21.15.107:0/3979089750 learned_addr learned my addr 172.21.15.107:0/3979089750 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8040470 con 0x7f51d015d750 2023-12-16T01:26:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7fe5e6ffd640 1 -- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5e80c9dd0 msgr2=0x7fe5e81f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7fe5e6ffd640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5e80c9dd0 0x7fe5e81f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7fe5e6ffd640 1 -- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5e80ca1b0 msgr2=0x7fe5e81f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7fe5e6ffd640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5e80ca1b0 0x7fe5e81f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c80405d0 con 0x7f51d015d750 2023-12-16T01:26:24.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8040980 con 0x7f51d015d750 2023-12-16T01:26:24.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d014d660 con 0x7f51d015d750 2023-12-16T01:26:24.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d0155f90 con 0x7f51d015d750 2023-12-16T01:26:24.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.417+0000 7fe5e6ffd640 1 -- 172.21.15.107:0/3979089750 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc0094d0 con 0x7fe5e806f590 2023-12-16T01:26:24.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.418+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d0155b10 con 0x7f51d015d750 2023-12-16T01:26:24.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.420+0000 7fe5e6ffd640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e806f590 0x7fe5e815bcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c410 tx=0x7fe5e000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.421+0000 7efe28651640 1 Processor -- start 2023-12-16T01:26:24.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.421+0000 7efe28651640 1 -- start start 2023-12-16T01:26:24.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.422+0000 7efe28651640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 0x7efe20060fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.422+0000 7efe28651640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe200c56a0 0x7efe200c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.423+0000 7efe28651640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe20156330 con 0x7efe200c6410 2023-12-16T01:26:24.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.423+0000 7efe28651640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe20061610 con 0x7efe200c56a0 2023-12-16T01:26:24.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.423+0000 7efe28651640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe20156120 con 0x7efe200c52c0 2023-12-16T01:26:24.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.424+0000 7efe263ed640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 0x7efe20060fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.424+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00035f0 con 0x7fe5e806f590 2023-12-16T01:26:24.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.424+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0003770 con 0x7fe5e806f590 2023-12-16T01:26:24.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.424+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0003b60 con 0x7fe5e806f590 2023-12-16T01:26:24.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.425+0000 7efe263ed640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 0x7efe20060fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33718/0 (socket says 172.21.15.107:33718) 2023-12-16T01:26:24.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.425+0000 7efe263ed640 1 -- 172.21.15.107:0/2424230562 learned_addr learned my addr 172.21.15.107:0/2424230562 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.425+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e81ef2e0 con 0x7fe5e806f590 2023-12-16T01:26:24.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.425+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e81ef8a0 con 0x7fe5e806f590 2023-12-16T01:26:24.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.426+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e81f24f0 con 0x7fe5e806f590 2023-12-16T01:26:24.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.435+0000 7efe263ed640 1 -- 172.21.15.107:0/2424230562 >> v2:172.21.15.107:3300/0 conn(0x7efe200c56a0 msgr2=0x7efe200c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.435+0000 7efe263ed640 1 --2- 172.21.15.107:0/2424230562 >> v2:172.21.15.107:3300/0 conn(0x7efe200c56a0 0x7efe200c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.435+0000 7efe263ed640 1 -- 172.21.15.107:0/2424230562 >> v1:172.21.15.107:6789/0 conn(0x7efe200c6410 legacy=0x7efe2014fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.435+0000 7efe263ed640 1 -- 172.21.15.107:0/2424230562 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20156610 con 0x7efe200c52c0 2023-12-16T01:26:24.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.449+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe5e0003cc0 con 0x7fe5e806f590 2023-12-16T01:26:24.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.450+0000 7fe5cf7fe640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe5d406aec0 0x7fe5d406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.450+0000 7fe5e67fc640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe5d406aec0 0x7fe5d406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.450+0000 7fe5e67fc640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe5d406aec0 0x7fe5d406d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc02b9c0 tx=0x7fe5dc008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.452+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5e0057e60 con 0x7fe5e806f590 2023-12-16T01:26:24.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T01:26:24.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.498+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bf4057f60 con 0x7f2c000c5690 2023-12-16T01:26:24.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.498+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2bf40542a0 con 0x7f2c000c5690 2023-12-16T01:26:24.520 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T01:26:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.520+0000 7f1a164ad640 1 Processor -- start 2023-12-16T01:26:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.520+0000 7f1a164ad640 1 -- start start 2023-12-16T01:26:24.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.521+0000 7f1a164ad640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a100c5690 0x7f1a101573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.521+0000 7f1a164ad640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a100c5a70 con 0x7f1a1006f090 2023-12-16T01:26:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.521+0000 7f1a164ad640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a100c7710 con 0x7f1a100c7ba0 2023-12-16T01:26:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.521+0000 7f1a164ad640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1015b740 con 0x7f1a100c5690 2023-12-16T01:26:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.522+0000 7f1a0f7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1a1006f090 0x7f1a100c8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57536/0 (socket says 172.21.15.107:57536) 2023-12-16T01:26:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.522+0000 7f1a0f7fe640 1 -- 172.21.15.107:0/2770606193 learned_addr learned my addr 172.21.15.107:0/2770606193 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.525+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880623261 0 0) 0x7f1a100c5a70 con 0x7f1a1006f090 2023-12-16T01:26:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.525+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f8003520 con 0x7f1a1006f090 2023-12-16T01:26:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 931459982 0 0) 0x7f19f8003520 con 0x7f1a1006f090 2023-12-16T01:26:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 >> v2:172.21.15.157:3300/0 conn(0x7f1a100c5690 msgr2=0x7f1a101573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 --2- 172.21.15.107:0/2770606193 >> v2:172.21.15.157:3300/0 conn(0x7f1a100c5690 0x7f1a101573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 >> v1:172.21.15.157:6789/0 conn(0x7f1a100c7ba0 legacy=0x7f1a100c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100c5e10 con 0x7f1a1006f090 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7f1a04001670 con 0x7f1a1006f090 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 >> v1:172.21.15.107:6789/0 conn(0x7f1a1006f090 legacy=0x7f1a100c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19f8003970 0x7f19f8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f19f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19f80052a0 0x7f19f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1015b740 con 0x7f19f80047c0 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800c190 con 0x7f19f8003970 2023-12-16T01:26:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.532+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800c350 con 0x7f19f80052a0 2023-12-16T01:26:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.537+0000 7f1a0f7fe640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f19f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.541+0000 7f1a0f7fe640 1 -- 172.21.15.107:0/2770606193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19f80052a0 msgr2=0x7f19f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.541+0000 7f1a0f7fe640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19f80052a0 0x7f19f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.541+0000 7f1a0f7fe640 1 -- 172.21.15.107:0/2770606193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19f8003970 msgr2=0x7f19f8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.541+0000 7f1a0f7fe640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19f8003970 0x7f19f8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.541+0000 7f1a0f7fe640 1 -- 172.21.15.107:0/2770606193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100c5e10 con 0x7f19f80047c0 2023-12-16T01:26:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.542+0000 7f1a14a4a640 1 -- 172.21.15.107:0/2770606193 reap_dead start 2023-12-16T01:26:24.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.544+0000 7f1a0f7fe640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f19f8004c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c260 tx=0x7f19f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a256d6db5d24edd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.549+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0402caf0 con 0x7f19f80047c0 2023-12-16T01:26:24.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.549+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0402cc50 con 0x7f19f80047c0 2023-12-16T01:26:24.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.549+0000 7f1a0effd640 1 -- 172.21.15.107:0/2770606193 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040058d0 con 0x7f19f80047c0 2023-12-16T01:26:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 -- 172.21.15.107:0/2770606193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 msgr2=0x7f19f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f19f8004c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c260 tx=0x7f19f80057f0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 -- 172.21.15.107:0/2770606193 shutdown_connections 2023-12-16T01:26:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 --2- 172.21.15.107:0/2770606193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f19f8004c40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 -- 172.21.15.107:0/2770606193 >> 172.21.15.107:0/2770606193 conn(0x7f1a1006fa90 msgr2=0x7f1a1006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 -- 172.21.15.107:0/2770606193 shutdown_connections 2023-12-16T01:26:24.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.550+0000 7f1a164ad640 1 -- 172.21.15.107:0/2770606193 wait complete. 2023-12-16T01:26:24.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.552+0000 7f1a164ad640 1 Processor -- start 2023-12-16T01:26:24.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.552+0000 7f1a164ad640 1 -- start start 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.553+0000 7f1a164ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f1a100cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.553+0000 7f1a164ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1014d6c0 0x7f1a101f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.553+0000 7f1a164ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1006ea20 0x7f1a101476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.553+0000 7f1a164ad640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a101f6630 con 0x7f19f80047c0 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.553+0000 7f1a164ad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a101f3a90 con 0x7f1a1014d6c0 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.553+0000 7f1a164ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100b0c90 con 0x7f1a1006ea20 2023-12-16T01:26:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.554+0000 7f1a0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f1a100cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.554+0000 7f1a0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f1a100cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41604/0 (socket says 172.21.15.107:41604) 2023-12-16T01:26:24.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.554+0000 7f1a0ffff640 1 -- 172.21.15.107:0/3492041999 learned_addr learned my addr 172.21.15.107:0/3492041999 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.559+0000 7f1a0ffff640 1 -- 172.21.15.107:0/3492041999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1006ea20 msgr2=0x7f1a101476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.559+0000 7f1a0ffff640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1006ea20 0x7f1a101476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.560+0000 7f1a0ffff640 1 -- 172.21.15.107:0/3492041999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1014d6c0 msgr2=0x7f1a101f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.560+0000 7f1a0ffff640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1014d6c0 0x7f1a101f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.560+0000 7f1a0ffff640 1 -- 172.21.15.107:0/3492041999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100b0f70 con 0x7f19f80047c0 2023-12-16T01:26:24.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.563+0000 7f1a0ffff640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f1a100cb560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000b430 tx=0x7f1a0000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.569+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011830 con 0x7f19f80047c0 2023-12-16T01:26:24.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.569+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a00011990 con 0x7f19f80047c0 2023-12-16T01:26:24.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.569+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011d40 con 0x7f19f80047c0 2023-12-16T01:26:24.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.569+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a101f6250 con 0x7f19f80047c0 2023-12-16T01:26:24.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.569+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a100b1250 con 0x7f19f80047c0 2023-12-16T01:26:24.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.571+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a101f6770 con 0x7f19f80047c0 2023-12-16T01:26:24.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.590+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1a0001a400 con 0x7f19f80047c0 2023-12-16T01:26:24.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.591+0000 7f1a0cff9640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f19fc06aec0 0x7f19fc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.591+0000 7f490d65c640 1 Processor -- start 2023-12-16T01:26:24.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.591+0000 7f490d65c640 1 -- start start 2023-12-16T01:26:24.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.591+0000 7f1a0f7fe640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f19fc06aec0 0x7f19fc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.592+0000 7f1a0f7fe640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f19fc06aec0 0x7f19fc06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a04034000 tx=0x7f1a04007000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.592+0000 7f490d65c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 0x7f4908153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.592+0000 7f490d65c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f49080c4810 0x7f49080c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.592+0000 7f490d65c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490806bba0 con 0x7f4908153640 2023-12-16T01:26:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.592+0000 7f490d65c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490806be60 con 0x7f49080c4810 2023-12-16T01:26:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.592+0000 7f490d65c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490806c140 con 0x7f49080c4210 2023-12-16T01:26:24.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.598+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a0000f2e0 con 0x7f19f80047c0 2023-12-16T01:26:24.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.600+0000 7f49077fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f49080c4810 0x7f49080c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.666+0000 7fd7d4fea640 1 Processor -- start 2023-12-16T01:26:24.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.666+0000 7fd7d4fea640 1 -- start start 2023-12-16T01:26:24.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.667+0000 7fd7d4fea640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7d0153890 0x7fd7d015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.667+0000 7fd7d4fea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 0x7fd7d00c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.668+0000 7fd7d4fea640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d015a700 con 0x7fd7d00ceef0 2023-12-16T01:26:24.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.668+0000 7fd7d4fea640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00ca870 con 0x7fd7d0153890 2023-12-16T01:26:24.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.668+0000 7fd7d4fea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0159af0 con 0x7fd7d0153c70 2023-12-16T01:26:24.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.676+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3efc1ef3c0 con 0x7f3efc15d830 2023-12-16T01:26:24.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.694+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f51c8040ae0 con 0x7f51d015d750 2023-12-16T01:26:24.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.694+0000 7f51b7fff640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f51bc06ae90 0x7f51bc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.694+0000 7f51cf7fe640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f51bc06ae90 0x7f51bc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.695+0000 7f51cf7fe640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f51bc06ae90 0x7f51bc06d350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009710 tx=0x7f51c0006c90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.697+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c0006ed50 con 0x7f2c000c5690 2023-12-16T01:26:24.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.700+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51c807bee0 con 0x7f51d015d750 2023-12-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.710+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f51c8077b20 con 0x7f51d015d750 2023-12-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.711+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe5e00541a0 con 0x7fe5e806f590 2023-12-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.714+0000 7efe263ed640 1 --2- 172.21.15.107:0/2424230562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 0x7efe20060fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe20156260 tx=0x7efe1c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d7e38f0bdca890 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.725+0000 7f3ef27fc640 1 -- 172.21.15.107:0/322098791 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3efc1ef3c0 con 0x7f3efc15d830 2023-12-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3ee006ae40 msgr2=0x7f3ee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3ee006ae40 0x7f3ee006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3eec02b9a0 tx=0x7f3eec008030 comp rx=0 tx=0).stop 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc15d830 msgr2=0x7f3efc1efa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc15d830 0x7f3efc1efa80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400eba0 tx=0x7f3ef400c490 comp rx=0 tx=0).stop 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 shutdown_connections 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3efc15d830 0x7f3efc1efa80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f3ee006ae40 0x7f3ee006d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3efc0ca1b0 0x7f3efc0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 --2- 172.21.15.107:0/322098791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3efc0c9dd0 0x7f3efc153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 >> 172.21.15.107:0/322098791 conn(0x7f3efc061100 msgr2=0x7f3efc15ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 shutdown_connections 2023-12-16T01:26:24.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.728+0000 7f3f03d61640 1 -- 172.21.15.107:0/322098791 wait complete. 2023-12-16T01:26:24.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.729+0000 7f49067fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 0x7f4908153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.729+0000 7fd7cdd9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 0x7fd7d00c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.730+0000 7f49067fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 0x7f4908153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33754/0 (socket says 172.21.15.107:33754) 2023-12-16T01:26:24.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.730+0000 7f49067fc640 1 -- 172.21.15.107:0/784777167 learned_addr learned my addr 172.21.15.107:0/784777167 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.731+0000 7fd7cdd9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 0x7fd7d00c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33760/0 (socket says 172.21.15.107:33760) 2023-12-16T01:26:24.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.731+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1567564648 learned_addr learned my addr 172.21.15.107:0/1567564648 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.733+0000 7f49067fc640 1 -- 172.21.15.107:0/784777167 >> v2:172.21.15.107:3300/0 conn(0x7f49080c4810 msgr2=0x7f49080c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.733+0000 7f49067fc640 1 --2- 172.21.15.107:0/784777167 >> v2:172.21.15.107:3300/0 conn(0x7f49080c4810 0x7f49080c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.733+0000 7f49067fc640 1 -- 172.21.15.107:0/784777167 >> v1:172.21.15.107:6789/0 conn(0x7f4908153640 legacy=0x7f490815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.733+0000 7f49067fc640 1 -- 172.21.15.107:0/784777167 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490806c420 con 0x7f49080c4210 2023-12-16T01:26:24.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.735+0000 7efe253eb640 1 -- 172.21.15.107:0/2424230562 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c031640 con 0x7efe200c52c0 2023-12-16T01:26:24.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.735+0000 7efe253eb640 1 -- 172.21.15.107:0/2424230562 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0317a0 con 0x7efe200c52c0 2023-12-16T01:26:24.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.735+0000 7efe253eb640 1 -- 172.21.15.107:0/2424230562 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c031b30 con 0x7efe200c52c0 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 -- 172.21.15.107:0/2424230562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 msgr2=0x7efe20060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 --2- 172.21.15.107:0/2424230562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 0x7efe20060fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe20156260 tx=0x7efe1c02b8f0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 -- 172.21.15.107:0/2424230562 shutdown_connections 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 --2- 172.21.15.107:0/2424230562 >> v2:172.21.15.107:3300/0 conn(0x7efe200c56a0 0x7efe200c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 --2- 172.21.15.107:0/2424230562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c52c0 0x7efe20060fd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 -- 172.21.15.107:0/2424230562 >> 172.21.15.107:0/2424230562 conn(0x7efe200c7fd0 msgr2=0x7efe200c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 -- 172.21.15.107:0/2424230562 shutdown_connections 2023-12-16T01:26:24.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.736+0000 7efe28651640 1 -- 172.21.15.107:0/2424230562 wait complete. 2023-12-16T01:26:24.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.738+0000 7efe28651640 1 Processor -- start 2023-12-16T01:26:24.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.738+0000 7efe28651640 1 -- start start 2023-12-16T01:26:24.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.738+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1567564648 >> v2:172.21.15.107:3300/0 conn(0x7fd7d0153890 msgr2=0x7fd7d015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.738+0000 7fd7cdd9b640 1 --2- 172.21.15.107:0/1567564648 >> v2:172.21.15.107:3300/0 conn(0x7fd7d0153890 0x7fd7d015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.738+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1567564648 >> v1:172.21.15.107:6789/0 conn(0x7fd7d00ceef0 legacy=0x7fd7d015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:24.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.738+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1567564648 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0159dd0 con 0x7fd7d0153c70 2023-12-16T01:26:24.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7f49067fc640 1 --2- 172.21.15.107:0/784777167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 0x7f4908153a20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009850 tx=0x7f48fc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebee45372081f32 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7efe28651640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe200c52c0 0x7efe201e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7efe28651640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c56a0 0x7efe201ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7efe28651640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 0x7efe20152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7efe28651640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe201e2150 con 0x7efe200c52c0 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7efe28651640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe201dd050 con 0x7efe200c6410 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.739+0000 7efe28651640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe201dc7b0 con 0x7efe200c56a0 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.740+0000 7efe26bee640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 0x7efe20152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.740+0000 7efe26bee640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 0x7efe20152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47694/0 (socket says 172.21.15.107:47694) 2023-12-16T01:26:24.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.740+0000 7efe26bee640 1 -- 172.21.15.107:0/2953610048 learned_addr learned my addr 172.21.15.107:0/2953610048 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.742+0000 7fd7cdd9b640 1 --2- 172.21.15.107:0/1567564648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 0x7fd7d00c9fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009870 tx=0x7fd7c402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa44d1798f4b4c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.2 2023-12-16T01:26:24.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.743+0000 7f4905ffb640 1 -- 172.21.15.107:0/784777167 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc004230 con 0x7f49080c4210 2023-12-16T01:26:24.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.744+0000 7efe26bee640 1 -- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c56a0 msgr2=0x7efe201ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.744+0000 7efe26bee640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c56a0 0x7efe201ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.744+0000 7efe26bee640 1 -- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe200c52c0 msgr2=0x7efe201e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.744+0000 7efe26bee640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe200c52c0 0x7efe201e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.744+0000 7efe26bee640 1 -- 172.21.15.107:0/2953610048 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0094d0 con 0x7efe200c6410 2023-12-16T01:26:24.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.747+0000 7efe26bee640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 0x7efe20152e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe1800b9c0 tx=0x7efe1800be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.750+0000 7f4905ffb640 1 -- 172.21.15.107:0/784777167 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc004390 con 0x7f49080c4210 2023-12-16T01:26:24.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.750+0000 7f4905ffb640 1 -- 172.21.15.107:0/784777167 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc003810 con 0x7f49080c4210 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 -- 172.21.15.107:0/784777167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 msgr2=0x7f4908153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 --2- 172.21.15.107:0/784777167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 0x7f4908153a20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009850 tx=0x7f48fc02b960 comp rx=0 tx=0).stop 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 -- 172.21.15.107:0/784777167 shutdown_connections 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 --2- 172.21.15.107:0/784777167 >> v2:172.21.15.107:3300/0 conn(0x7f49080c4810 0x7f49080c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 --2- 172.21.15.107:0/784777167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49080c4210 0x7f4908153a20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 -- 172.21.15.107:0/784777167 >> 172.21.15.107:0/784777167 conn(0x7f490808b610 msgr2=0x7f4908060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 -- 172.21.15.107:0/784777167 shutdown_connections 2023-12-16T01:26:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7f490d65c640 1 -- 172.21.15.107:0/784777167 wait complete. 2023-12-16T01:26:24.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800cba0 con 0x7efe200c6410 2023-12-16T01:26:24.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800cd00 con 0x7efe200c6410 2023-12-16T01:26:24.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18014680 con 0x7efe200c6410 2023-12-16T01:26:24.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe201dca90 con 0x7efe200c6410 2023-12-16T01:26:24.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.751+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe201ecd10 con 0x7efe200c6410 2023-12-16T01:26:24.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.752+0000 7fd7cd59a640 1 -- 172.21.15.107:0/1567564648 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4030840 con 0x7fd7d0153c70 2023-12-16T01:26:24.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.752+0000 7fd7cd59a640 1 -- 172.21.15.107:0/1567564648 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40309a0 con 0x7fd7d0153c70 2023-12-16T01:26:24.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.752+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe200740e0 con 0x7efe200c6410 2023-12-16T01:26:24.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.752+0000 7fd7cd59a640 1 -- 172.21.15.107:0/1567564648 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4030d30 con 0x7fd7d0153c70 2023-12-16T01:26:24.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.753+0000 7f490d65c640 1 Processor -- start 2023-12-16T01:26:24.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.753+0000 7f490d65c640 1 -- start start 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.753+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1567564648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 msgr2=0x7fd7d00c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.753+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1567564648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 0x7fd7d00c9fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009870 tx=0x7fd7c402b980 comp rx=0 tx=0).stop 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1567564648 shutdown_connections 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1567564648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153c70 0x7fd7d00c9fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1567564648 >> v2:172.21.15.107:3300/0 conn(0x7fd7d0153890 0x7fd7d015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1567564648 >> 172.21.15.107:0/1567564648 conn(0x7fd7d006ba00 msgr2=0x7fd7d006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1567564648 shutdown_connections 2023-12-16T01:26:24.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1567564648 wait complete. 2023-12-16T01:26:24.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7f490d65c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49080c4210 0x7f49080c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7f490d65c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49080c4810 0x7f490814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7f490d65c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 0x7f49081ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7f490d65c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080c7a50 con 0x7f49080c4810 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7f490d65c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49081f23d0 con 0x7f49080c4210 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.754+0000 7f490d65c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49081f2670 con 0x7f4908153640 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.755+0000 7f49077fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 0x7f49081ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.755+0000 7f49077fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 0x7f49081ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33770/0 (socket says 172.21.15.107:33770) 2023-12-16T01:26:24.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.755+0000 7f49077fe640 1 -- 172.21.15.107:0/3459874804 learned_addr learned my addr 172.21.15.107:0/3459874804 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.756+0000 7fd7d4fea640 1 Processor -- start 2023-12-16T01:26:24.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.756+0000 7fd7d4fea640 1 -- start start 2023-12-16T01:26:24.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.757+0000 7fd7d4fea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d00ceef0 0x7fd7d0146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.757+0000 7fd7d4fea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 0x7fd7d0154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.757+0000 7fd7d4fea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7d0153c70 0x7fd7d01f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.757+0000 7fd7d4fea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b4840 con 0x7fd7d00ceef0 2023-12-16T01:26:24.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.757+0000 7fd7d4fea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b4560 con 0x7fd7d0153c70 2023-12-16T01:26:24.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.757+0000 7fd7d4fea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0154cb0 con 0x7fd7d0153890 2023-12-16T01:26:24.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.759+0000 7f49077fe640 1 -- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49080c4210 msgr2=0x7f49080c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.759+0000 7f49077fe640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49080c4210 0x7f49080c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.759+0000 7f49077fe640 1 -- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49080c4810 msgr2=0x7f490814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.759+0000 7f49077fe640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49080c4810 0x7f490814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.759+0000 7f49077fe640 1 -- 172.21.15.107:0/3459874804 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc009460 con 0x7f4908153640 2023-12-16T01:26:24.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.761+0000 7fd7cdd9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 0x7fd7d0154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.762+0000 7fd7cdd9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 0x7fd7d0154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33780/0 (socket says 172.21.15.107:33780) 2023-12-16T01:26:24.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.762+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1388923460 learned_addr learned my addr 172.21.15.107:0/1388923460 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:24.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.763+0000 7f49077fe640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 0x7f49081ef490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f490000cda0 tx=0x7f490000a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.767+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7d0153c70 msgr2=0x7fd7d01f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.767+0000 7fd7cdd9b640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7d0153c70 0x7fd7d01f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.767+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d00ceef0 msgr2=0x7fd7d0146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.767+0000 7fd7cdd9b640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d00ceef0 0x7fd7d0146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.767+0000 7fd7cdd9b640 1 -- 172.21.15.107:0/1388923460 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40094d0 con 0x7fd7d0153890 2023-12-16T01:26:24.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.772+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900003b90 con 0x7f4908153640 2023-12-16T01:26:24.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.772+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900003cf0 con 0x7f4908153640 2023-12-16T01:26:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.772+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900004240 con 0x7f4908153640 2023-12-16T01:26:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.772+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49081f2950 con 0x7f4908153640 2023-12-16T01:26:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.772+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49081f2f10 con 0x7f4908153640 2023-12-16T01:26:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.773+0000 7fd7cdd9b640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 0x7fd7d0154fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009870 tx=0x7fd7c4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.774+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49080740e0 con 0x7f4908153640 2023-12-16T01:26:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.775+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7efe1801d3b0 con 0x7efe200c6410 2023-12-16T01:26:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.775+0000 7efe16ffd640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efe0406ae40 0x7efe0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.775+0000 7efe263ed640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efe0406ae40 0x7efe0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.776+0000 7efe263ed640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efe0406ae40 0x7efe0406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efe1c036000 tx=0x7efe1c030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.793+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f49000043a0 con 0x7f4908153640 2023-12-16T01:26:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.793+0000 7f48ef7fe640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f48f406ae90 0x7f48f406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.794+0000 7f4906ffd640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f48f406ae90 0x7f48f406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.794+0000 7f4906ffd640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f48f406ae90 0x7f48f406d350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f48f8001560 tx=0x7f48f8007990 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:24.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.795+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4900012070 con 0x7f4908153640 2023-12-16T01:26:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.799+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4039d90 con 0x7fd7d0153890 2023-12-16T01:26:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.799+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40433f0 con 0x7fd7d0153890 2023-12-16T01:26:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.799+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40437a0 con 0x7fd7d0153890 2023-12-16T01:26:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.799+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d00b4cd0 con 0x7fd7d0153890 2023-12-16T01:26:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.799+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d0147be0 con 0x7fd7d0153890 2023-12-16T01:26:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.801+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d0067500 con 0x7fd7d0153890 2023-12-16T01:26:24.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.850+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1a00054c00 con 0x7f19f80047c0 2023-12-16T01:26:24.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.876+0000 7f2bfcff9640 1 -- 172.21.15.107:0/2246158802 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bf4017090 con 0x7f2c000c5690 2023-12-16T01:26:24.877 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:24.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2bec06ae40 msgr2=0x7f2bec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2bec06ae40 0x7f2bec06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0036000 tx=0x7f2bf0030000 comp rx=0 tx=0).stop 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 msgr2=0x7f2c001ef5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 0x7f2c001ef5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c410 tx=0x7f2bf400c8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 shutdown_connections 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2bec06ae40 0x7f2bec06d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c000c7ba0 0x7f2c001e5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c000c5690 0x7f2c001ef5b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 --2- 172.21.15.107:0/2246158802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c0006f090 0x7f2c001f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 >> 172.21.15.107:0/2246158802 conn(0x7f2c0006fa90 msgr2=0x7f2c0006db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 shutdown_connections 2023-12-16T01:26:24.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.878+0000 7f2c063a9640 1 -- 172.21.15.107:0/2246158802 wait complete. 2023-12-16T01:26:24.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.3 2023-12-16T01:26:24.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.899+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f51d0155b10 con 0x7f51d015d750 2023-12-16T01:26:24.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:24.933+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5e80740e0 con 0x7fe5e806f590 2023-12-16T01:26:25.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.008+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe18058f70 con 0x7efe200c6410 2023-12-16T01:26:25.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.021+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7efe18054bb0 con 0x7efe200c6410 2023-12-16T01:26:25.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.029+0000 7f51b7fff640 1 -- 172.21.15.107:0/3857421978 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51d0155b10 con 0x7f51d015d750 2023-12-16T01:26:25.030 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:25.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f51bc06ae90 msgr2=0x7f51bc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f51bc06ae90 0x7f51bc06d350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009710 tx=0x7f51c0006c90 comp rx=0 tx=0).stop 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 msgr2=0x7f51d01f2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 0x7f51d01f2440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51c8036040 tx=0x7f51c8004a40 comp rx=0 tx=0).stop 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 shutdown_connections 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f51bc06ae90 0x7f51bc06d350 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51d015d750 0x7f51d01f2440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51d0153650 0x7f51d0148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 --2- 172.21.15.107:0/3857421978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51d006f550 0x7f51d0154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 >> 172.21.15.107:0/3857421978 conn(0x7f51d0061100 msgr2=0x7f51d00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 shutdown_connections 2023-12-16T01:26:25.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.031+0000 7f51d5e1c640 1 -- 172.21.15.107:0/3857421978 wait complete. 2023-12-16T01:26:25.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.039+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4900055570 con 0x7f4908153640 2023-12-16T01:26:25.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.7 2023-12-16T01:26:25.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.062+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1a101f6770 con 0x7f19f80047c0 2023-12-16T01:26:25.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.066+0000 7f1a0cff9640 1 -- 172.21.15.107:0/3492041999 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a101f6770 con 0x7f19f80047c0 2023-12-16T01:26:25.067 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f19fc06aec0 msgr2=0x7f19fc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f19fc06aec0 0x7f19fc06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a04034000 tx=0x7f1a04007000 comp rx=0 tx=0).stop 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 msgr2=0x7f1a100cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f1a100cb560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000b430 tx=0x7f1a0000b8f0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 shutdown_connections 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1006ea20 0x7f1a101476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f19fc06aec0 0x7f19fc06d380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1014d6c0 0x7f1a101f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 --2- 172.21.15.107:0/3492041999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f80047c0 0x7f1a100cb560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.068+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 >> 172.21.15.107:0/3492041999 conn(0x7f1a1006fa90 msgr2=0x7f1a100ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.069+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 shutdown_connections 2023-12-16T01:26:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.069+0000 7f1a164ad640 1 -- 172.21.15.107:0/3492041999 wait complete. 2023-12-16T01:26:25.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.5 2023-12-16T01:26:25.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.198+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efe200c8530 con 0x7efe200c6410 2023-12-16T01:26:25.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.201+0000 7efe16ffd640 1 -- 172.21.15.107:0/2953610048 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe18019070 con 0x7efe200c6410 2023-12-16T01:26:25.202 INFO:teuthology.orchestra.run.smithi107.stdout:60129542154 2023-12-16T01:26:25.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efe0406ae40 msgr2=0x7efe0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efe0406ae40 0x7efe0406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efe1c036000 tx=0x7efe1c030000 comp rx=0 tx=0).stop 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 msgr2=0x7efe20152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 0x7efe20152e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe1800b9c0 tx=0x7efe1800be80 comp rx=0 tx=0).stop 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 shutdown_connections 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efe0406ae40 0x7efe0406d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe200c6410 0x7efe20152e90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe200c56a0 0x7efe201ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 --2- 172.21.15.107:0/2953610048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe200c52c0 0x7efe201e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 >> 172.21.15.107:0/2953610048 conn(0x7efe200c7fd0 msgr2=0x7efe200c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 shutdown_connections 2023-12-16T01:26:25.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.203+0000 7efe28651640 1 -- 172.21.15.107:0/2953610048 wait complete. 2023-12-16T01:26:25.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.6 2023-12-16T01:26:25.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.216+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f49080cac50 con 0x7f4908153640 2023-12-16T01:26:25.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.296+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd7c404c3b0 con 0x7fd7d0153890 2023-12-16T01:26:25.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.296+0000 7fd7beffd640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006aec0 0x7fd7b006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.297+0000 7fd7ce59c640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006aec0 0x7fd7b006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.297+0000 7fd7ce59c640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006aec0 0x7fd7b006d380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009710 tx=0x7fd7c0006c90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:25.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.299+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7c407b4d0 con 0x7fd7d0153890 2023-12-16T01:26:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.314+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd7c4077110 con 0x7fd7d0153890 2023-12-16T01:26:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.314+0000 7f48ef7fe640 1 -- 172.21.15.107:0/3459874804 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4900058b90 con 0x7f4908153640 2023-12-16T01:26:25.315 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.314+0000 7fe5cf7fe640 1 -- 172.21.15.107:0/3979089750 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5e0017020 con 0x7fe5e806f590 2023-12-16T01:26:25.316 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe5d406aec0 msgr2=0x7fe5d406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe5d406aec0 0x7fe5d406d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc02b9c0 tx=0x7fe5dc008030 comp rx=0 tx=0).stop 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e806f590 msgr2=0x7fe5e815bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e806f590 0x7fe5e815bcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c410 tx=0x7fe5e000c810 comp rx=0 tx=0).stop 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 shutdown_connections 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5e80ca1b0 0x7fe5e81f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe5d406aec0 0x7fe5d406d380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5e80c9dd0 0x7fe5e81f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f48f406ae90 msgr2=0x7f48f406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f48f406ae90 0x7f48f406d350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f48f8001560 tx=0x7f48f8007990 comp rx=0 tx=0).stop 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 msgr2=0x7f49081ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 0x7f49081ef490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f490000cda0 tx=0x7f490000a660 comp rx=0 tx=0).stop 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 --2- 172.21.15.107:0/3979089750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5e806f590 0x7fe5e815bcd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 >> 172.21.15.107:0/3979089750 conn(0x7fe5e8061100 msgr2=0x7fe5e815aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 shutdown_connections 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 shutdown_connections 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4908153640 0x7f49081ef490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49080c4810 0x7f490814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f48f406ae90 0x7f48f406d350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 --2- 172.21.15.107:0/3459874804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49080c4210 0x7f49080c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 >> 172.21.15.107:0/3459874804 conn(0x7f490808b610 msgr2=0x7f49080c4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 shutdown_connections 2023-12-16T01:26:25.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7f490d65c640 1 -- 172.21.15.107:0/3459874804 wait complete. 2023-12-16T01:26:25.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.317+0000 7fe5ed7c2640 1 -- 172.21.15.107:0/3979089750 wait complete. 2023-12-16T01:26:25.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.4 2023-12-16T01:26:25.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.1 2023-12-16T01:26:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.521+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7d01530b0 con 0x7fd7d0153890 2023-12-16T01:26:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.524+0000 7fd7beffd640 1 -- 172.21.15.107:0/1388923460 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7c4034090 con 0x7fd7d0153890 2023-12-16T01:26:25.525 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006aec0 msgr2=0x7fd7b006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006aec0 0x7fd7b006d380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009710 tx=0x7fd7c0006c90 comp rx=0 tx=0).stop 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 msgr2=0x7fd7d0154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 0x7fd7d0154fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009870 tx=0x7fd7c4004730 comp rx=0 tx=0).stop 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 shutdown_connections 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006aec0 0x7fd7b006d380 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7d0153c70 0x7fd7d01f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7d0153890 0x7fd7d0154fd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 --2- 172.21.15.107:0/1388923460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d00ceef0 0x7fd7d0146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 >> 172.21.15.107:0/1388923460 conn(0x7fd7d006ba00 msgr2=0x7fd7d015c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 shutdown_connections 2023-12-16T01:26:25.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.526+0000 7fd7d4fea640 1 -- 172.21.15.107:0/1388923460 wait complete. 2023-12-16T01:26:25.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.0 2023-12-16T01:26:25.538 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:25.745 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T01:26:25.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.847+0000 7fc248ce7640 1 Processor -- start 2023-12-16T01:26:25.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.847+0000 7fc248ce7640 1 -- start start 2023-12-16T01:26:25.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.848+0000 7fc248ce7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc2440c61a0 0x7fc244162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.848+0000 7fc248ce7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24415b6e0 con 0x7fc244151510 2023-12-16T01:26:25.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.848+0000 7fc248ce7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24415a880 con 0x7fc2440728b0 2023-12-16T01:26:25.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.848+0000 7fc248ce7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24406f7e0 con 0x7fc2440c61a0 2023-12-16T01:26:25.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.849+0000 7fc242d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc2440c61a0 0x7fc244162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.849+0000 7fc242d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc2440c61a0 0x7fc244162c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47704/0 (socket says 172.21.15.107:47704) 2023-12-16T01:26:25.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.849+0000 7fc242d9d640 1 -- 172.21.15.107:0/1903594641 learned_addr learned my addr 172.21.15.107:0/1903594641 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:25.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.852+0000 7fc242d9d640 1 -- 172.21.15.107:0/1903594641 >> v1:172.21.15.157:6789/0 conn(0x7fc2440728b0 legacy=0x7fc2440c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.852+0000 7fc242d9d640 1 -- 172.21.15.107:0/1903594641 >> v1:172.21.15.107:6789/0 conn(0x7fc244151510 legacy=0x7fc2440cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.852+0000 7fc242d9d640 1 -- 172.21.15.107:0/1903594641 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24415aad0 con 0x7fc2440c61a0 2023-12-16T01:26:25.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.858+0000 7fc242d9d640 1 --2- 172.21.15.107:0/1903594641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440c61a0 0x7fc244162c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc234009870 tx=0x7fc23402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=977074b2523b79fb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:25.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.862+0000 7fc24159a640 1 -- 172.21.15.107:0/1903594641 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23402f840 con 0x7fc2440c61a0 2023-12-16T01:26:25.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.862+0000 7fc24159a640 1 -- 172.21.15.107:0/1903594641 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23402f9a0 con 0x7fc2440c61a0 2023-12-16T01:26:25.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.862+0000 7fc24159a640 1 -- 172.21.15.107:0/1903594641 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23402fd30 con 0x7fc2440c61a0 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 -- 172.21.15.107:0/1903594641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440c61a0 msgr2=0x7fc244162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 --2- 172.21.15.107:0/1903594641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440c61a0 0x7fc244162c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc234009870 tx=0x7fc23402ba20 comp rx=0 tx=0).stop 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 -- 172.21.15.107:0/1903594641 shutdown_connections 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 --2- 172.21.15.107:0/1903594641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440c61a0 0x7fc244162c20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 -- 172.21.15.107:0/1903594641 >> 172.21.15.107:0/1903594641 conn(0x7fc24406cd60 msgr2=0x7fc24406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 -- 172.21.15.107:0/1903594641 shutdown_connections 2023-12-16T01:26:25.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.863+0000 7fc248ce7640 1 -- 172.21.15.107:0/1903594641 wait complete. 2023-12-16T01:26:25.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.864+0000 7fc248ce7640 1 Processor -- start 2023-12-16T01:26:25.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.864+0000 7fc248ce7640 1 -- start start 2023-12-16T01:26:25.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc248ce7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440728b0 0x7fc244159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc248ce7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2440c61a0 0x7fc244142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc248ce7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 0x7fc244144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc248ce7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c4a20 con 0x7fc244151510 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc248ce7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c3c90 con 0x7fc2440728b0 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc248ce7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc244143ea0 con 0x7fc2440c61a0 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc242d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 0x7fc244144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc24259c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440728b0 0x7fc244159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc241d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2440c61a0 0x7fc244142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc242d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 0x7fc244144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41646/0 (socket says 172.21.15.107:41646) 2023-12-16T01:26:25.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.865+0000 7fc242d9d640 1 -- 172.21.15.107:0/3190066320 learned_addr learned my addr 172.21.15.107:0/3190066320 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.869+0000 7fc242d9d640 1 -- 172.21.15.107:0/3190066320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2440c61a0 msgr2=0x7fc244142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.869+0000 7fc242d9d640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2440c61a0 0x7fc244142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.869+0000 7fc242d9d640 1 -- 172.21.15.107:0/3190066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440728b0 msgr2=0x7fc244159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.869+0000 7fc242d9d640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440728b0 0x7fc244159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.869+0000 7fc242d9d640 1 -- 172.21.15.107:0/3190066320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340094d0 con 0x7fc244151510 2023-12-16T01:26:25.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.871+0000 7fc242d9d640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 0x7fc244144330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc234009870 tx=0x7fc2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.875+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23403b040 con 0x7fc244151510 2023-12-16T01:26:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.875+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234037d50 con 0x7fc244151510 2023-12-16T01:26:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.875+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24414b880 con 0x7fc244151510 2023-12-16T01:26:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.875+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340426a0 con 0x7fc244151510 2023-12-16T01:26:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.875+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440c4c30 con 0x7fc244151510 2023-12-16T01:26:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.876+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244144030 con 0x7fc244151510 2023-12-16T01:26:25.891 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T01:26:25.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.993+0000 7fd99a044640 1 Processor -- start 2023-12-16T01:26:25.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.993+0000 7fd99a044640 1 -- start start 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.994+0000 7fd99a044640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd994153c70 0x7fd99415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.994+0000 7fd99a044640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 0x7fd9940cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.994+0000 7fd99a044640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99415a700 con 0x7fd994153890 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.994+0000 7fd99a044640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940ca870 con 0x7fd994153c70 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.994+0000 7fd99a044640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd994159af0 con 0x7fd9940ceef0 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.995+0000 7fd993fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 0x7fd9940cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.995+0000 7fd992ffd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd994153c70 0x7fd99415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:25.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.995+0000 7fd993fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 0x7fd9940cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33792/0 (socket says 172.21.15.107:33792) 2023-12-16T01:26:25.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.995+0000 7fd993fff640 1 -- 172.21.15.107:0/3135722758 learned_addr learned my addr 172.21.15.107:0/3135722758 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.997+0000 7fd993fff640 1 -- 172.21.15.107:0/3135722758 >> v2:172.21.15.157:3300/0 conn(0x7fd994153c70 msgr2=0x7fd99415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.997+0000 7fd993fff640 1 --2- 172.21.15.107:0/3135722758 >> v2:172.21.15.157:3300/0 conn(0x7fd994153c70 0x7fd99415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.997+0000 7fd993fff640 1 -- 172.21.15.107:0/3135722758 >> v1:172.21.15.157:6789/0 conn(0x7fd994153890 legacy=0x7fd9940c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.997+0000 7fd993fff640 1 -- 172.21.15.107:0/3135722758 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994159dd0 con 0x7fd9940ceef0 2023-12-16T01:26:26.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:25.999+0000 7fd993fff640 1 --2- 172.21.15.107:0/3135722758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 0x7fd9940cf320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009e50 tx=0x7fd98c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97b34f129b4db9ff server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd9927fc640 1 -- 172.21.15.107:0/3135722758 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c02cb00 con 0x7fd9940ceef0 2023-12-16T01:26:26.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd9927fc640 1 -- 172.21.15.107:0/3135722758 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c02cc60 con 0x7fd9940ceef0 2023-12-16T01:26:26.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd9927fc640 1 -- 172.21.15.107:0/3135722758 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0343f0 con 0x7fd9940ceef0 2023-12-16T01:26:26.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 -- 172.21.15.107:0/3135722758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 msgr2=0x7fd9940cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 --2- 172.21.15.107:0/3135722758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 0x7fd9940cf320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009e50 tx=0x7fd98c02bf60 comp rx=0 tx=0).stop 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 -- 172.21.15.107:0/3135722758 shutdown_connections 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 --2- 172.21.15.107:0/3135722758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9940ceef0 0x7fd9940cf320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 --2- 172.21.15.107:0/3135722758 >> v2:172.21.15.157:3300/0 conn(0x7fd994153c70 0x7fd99415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 -- 172.21.15.107:0/3135722758 >> 172.21.15.107:0/3135722758 conn(0x7fd99406ba00 msgr2=0x7fd99406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.003+0000 7fd99a044640 1 -- 172.21.15.107:0/3135722758 shutdown_connections 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.004+0000 7fd99a044640 1 -- 172.21.15.107:0/3135722758 wait complete. 2023-12-16T01:26:26.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 Processor -- start 2023-12-16T01:26:26.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 -- start start 2023-12-16T01:26:26.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9940ceef0 0x7fd9940b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd994153890 0x7fd9941440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd994153c70 0x7fd994144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940cd730 con 0x7fd9940ceef0 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c5840 con 0x7fd994153890 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.005+0000 7fd99a044640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940b5010 con 0x7fd994153c70 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.006+0000 7fd992ffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd994153890 0x7fd9941440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.006+0000 7fd993fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd994153c70 0x7fd994144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.006+0000 7fd993fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd994153c70 0x7fd994144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33796/0 (socket says 172.21.15.107:33796) 2023-12-16T01:26:26.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.006+0000 7fd993fff640 1 -- 172.21.15.107:0/3925698098 learned_addr learned my addr 172.21.15.107:0/3925698098 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.010+0000 7fd992ffd640 1 -- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd994153c70 msgr2=0x7fd994144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.010+0000 7fd992ffd640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd994153c70 0x7fd994144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.010+0000 7fd992ffd640 1 -- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9940ceef0 msgr2=0x7fd9940b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.010+0000 7fd992ffd640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9940ceef0 0x7fd9940b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.010+0000 7fd992ffd640 1 -- 172.21.15.107:0/3925698098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009b30 con 0x7fd994153890 2023-12-16T01:26:26.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.012+0000 7fd992ffd640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd994153890 0x7fd9941440c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd98800e870 tx=0x7fd98800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.016+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800ee60 con 0x7fd994153890 2023-12-16T01:26:26.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.016+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98800c940 con 0x7fd994153890 2023-12-16T01:26:26.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.016+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800ccd0 con 0x7fd994153890 2023-12-16T01:26:26.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.016+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9940c5560 con 0x7fd994153890 2023-12-16T01:26:26.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.016+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9940cd0e0 con 0x7fd994153890 2023-12-16T01:26:26.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.017+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd994067500 con 0x7fd994153890 2023-12-16T01:26:26.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.035+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd988013470 con 0x7fd994153890 2023-12-16T01:26:26.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.035+0000 7fd97bfff640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd98006ae90 0x7fd98006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.036+0000 7fd9937fe640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd98006ae90 0x7fd98006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.036+0000 7fd9937fe640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd98006ae90 0x7fd98006d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd984003cc0 tx=0x7fd9840079b0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.038+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd98800ce30 con 0x7fd994153890 2023-12-16T01:26:26.044 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T01:26:26.081 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T01:26:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.131+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc234042800 con 0x7fc244151510 2023-12-16T01:26:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.131+0000 7fc232ffd640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc22406ae40 0x7fc22406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.132+0000 7fc24259c640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc22406ae40 0x7fc22406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.132+0000 7fc24259c640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc22406ae40 0x7fc22406d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc23c001f10 tx=0x7fc23c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.145+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc23407bf70 con 0x7fc244151510 2023-12-16T01:26:26.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.146+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc2340782b0 con 0x7fc244151510 2023-12-16T01:26:26.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.147+0000 7f2b04990640 1 Processor -- start 2023-12-16T01:26:26.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.147+0000 7f2b04990640 1 -- start start 2023-12-16T01:26:26.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.148+0000 7f2b04990640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b00153c70 0x7f2b0015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.148+0000 7f2b04990640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 0x7f2b000cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.148+0000 7f2b04990640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0015a700 con 0x7f2b00153890 2023-12-16T01:26:26.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.148+0000 7f2b04990640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000ca870 con 0x7f2b00153c70 2023-12-16T01:26:26.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.148+0000 7f2b04990640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00159af0 con 0x7f2b000ceef0 2023-12-16T01:26:26.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.148+0000 7f2afed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 0x7f2b000cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.149+0000 7f2afed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 0x7f2b000cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33802/0 (socket says 172.21.15.107:33802) 2023-12-16T01:26:26.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.149+0000 7f2afed9d640 1 -- 172.21.15.107:0/2257428478 learned_addr learned my addr 172.21.15.107:0/2257428478 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.151+0000 7f2afed9d640 1 -- 172.21.15.107:0/2257428478 >> v2:172.21.15.157:3300/0 conn(0x7f2b00153c70 msgr2=0x7f2b0015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.151+0000 7f2afed9d640 1 --2- 172.21.15.107:0/2257428478 >> v2:172.21.15.157:3300/0 conn(0x7f2b00153c70 0x7f2b0015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.151+0000 7f2afed9d640 1 -- 172.21.15.107:0/2257428478 >> v1:172.21.15.107:6789/0 conn(0x7f2b00153890 legacy=0x7f2b000c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.151+0000 7f2afed9d640 1 -- 172.21.15.107:0/2257428478 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00159dd0 con 0x7f2b000ceef0 2023-12-16T01:26:26.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.153+0000 7f2afed9d640 1 --2- 172.21.15.107:0/2257428478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 0x7f2b000cf320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee5d23709049fac server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.157+0000 7f2afdd9b640 1 -- 172.21.15.107:0/2257428478 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af802cb00 con 0x7f2b000ceef0 2023-12-16T01:26:26.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.157+0000 7f2afdd9b640 1 -- 172.21.15.107:0/2257428478 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af802cc60 con 0x7f2b000ceef0 2023-12-16T01:26:26.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.157+0000 7f2afdd9b640 1 -- 172.21.15.107:0/2257428478 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80343f0 con 0x7f2b000ceef0 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 -- 172.21.15.107:0/2257428478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 msgr2=0x7f2b000cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 --2- 172.21.15.107:0/2257428478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 0x7f2b000cf320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af802bf60 comp rx=0 tx=0).stop 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 -- 172.21.15.107:0/2257428478 shutdown_connections 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 --2- 172.21.15.107:0/2257428478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b000ceef0 0x7f2b000cf320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 --2- 172.21.15.107:0/2257428478 >> v2:172.21.15.157:3300/0 conn(0x7f2b00153c70 0x7f2b0015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 -- 172.21.15.107:0/2257428478 >> 172.21.15.107:0/2257428478 conn(0x7f2b0006ba00 msgr2=0x7f2b0006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 -- 172.21.15.107:0/2257428478 shutdown_connections 2023-12-16T01:26:26.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.158+0000 7f2b04990640 1 -- 172.21.15.107:0/2257428478 wait complete. 2023-12-16T01:26:26.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.159+0000 7f2b04990640 1 Processor -- start 2023-12-16T01:26:26.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.159+0000 7f2b04990640 1 -- start start 2023-12-16T01:26:26.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2b04990640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b000ceef0 0x7f2b000ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2b04990640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 0x7f2b00154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2b04990640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b00153c70 0x7f2b00151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2b04990640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001511e0 con 0x7f2b00153c70 2023-12-16T01:26:26.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2b04990640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001554a0 con 0x7f2b000ceef0 2023-12-16T01:26:26.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2b04990640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00152fc0 con 0x7f2b00153890 2023-12-16T01:26:26.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.160+0000 7f2af7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 0x7f2b00154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.161+0000 7f2af7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 0x7f2b00154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33806/0 (socket says 172.21.15.107:33806) 2023-12-16T01:26:26.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.161+0000 7f2af7fff640 1 -- 172.21.15.107:0/2399498681 learned_addr learned my addr 172.21.15.107:0/2399498681 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.164+0000 7f2af7fff640 1 -- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b000ceef0 msgr2=0x7f2b000ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.164+0000 7f2af7fff640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b000ceef0 0x7f2b000ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.164+0000 7f2af7fff640 1 -- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b00153c70 msgr2=0x7f2b00151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.164+0000 7f2af7fff640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b00153c70 0x7f2b00151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.164+0000 7f2af7fff640 1 -- 172.21.15.107:0/2399498681 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009b30 con 0x7f2b00153890 2023-12-16T01:26:26.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.166+0000 7f2af7fff640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 0x7f2b00154900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800b410 tx=0x7f2ae800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.170+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011830 con 0x7f2b00153890 2023-12-16T01:26:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.170+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae8011990 con 0x7f2b00153890 2023-12-16T01:26:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.170+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011d40 con 0x7f2b00153890 2023-12-16T01:26:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.170+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b00156a20 con 0x7f2b00153890 2023-12-16T01:26:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.170+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b000b51b0 con 0x7f2b00153890 2023-12-16T01:26:26.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.171+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b00067500 con 0x7f2b00153890 2023-12-16T01:26:26.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.194+0000 7fee70ee0640 1 Processor -- start 2023-12-16T01:26:26.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.194+0000 7fee70ee0640 1 -- start start 2023-12-16T01:26:26.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.195+0000 7fee70ee0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fee6c0c2710 0x7fee6c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.195+0000 7fee70ee0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c06fa00 con 0x7fee6c151630 2023-12-16T01:26:26.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.195+0000 7fee70ee0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c15b9c0 con 0x7fee6c06f590 2023-12-16T01:26:26.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.195+0000 7fee70ee0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c158490 con 0x7fee6c0c2710 2023-12-16T01:26:26.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.196+0000 7fee6a59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fee6c151630 0x7fee6c0c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57580/0 (socket says 172.21.15.107:57580) 2023-12-16T01:26:26.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.196+0000 7fee6a59c640 1 -- 172.21.15.107:0/4097014069 learned_addr learned my addr 172.21.15.107:0/4097014069 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:26.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.198+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052324701 0 0) 0x7fee6c06fa00 con 0x7fee6c151630 2023-12-16T01:26:26.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.198+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee58003520 con 0x7fee6c151630 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953543507 0 0) 0x7fee58003520 con 0x7fee6c151630 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 >> v2:172.21.15.157:3300/0 conn(0x7fee6c0c2710 msgr2=0x7fee6c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 --2- 172.21.15.107:0/4097014069 >> v2:172.21.15.157:3300/0 conn(0x7fee6c0c2710 0x7fee6c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 >> v1:172.21.15.157:6789/0 conn(0x7fee6c06f590 legacy=0x7fee6c0c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c15ab60 con 0x7fee6c151630 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7fee640019f0 con 0x7fee6c151630 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 >> v1:172.21.15.107:6789/0 conn(0x7fee6c151630 legacy=0x7fee6c0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.201+0000 7fee6959a640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee580039c0 0x7fee58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.202+0000 7fee6959a640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580047c0 0x7fee58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.202+0000 7fee6959a640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee580052a0 0x7fee5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.202+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c158490 con 0x7fee580052a0 2023-12-16T01:26:26.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.202+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5800c1e0 con 0x7fee580047c0 2023-12-16T01:26:26.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.202+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5800c3a0 con 0x7fee580039c0 2023-12-16T01:26:26.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.204+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee580052a0 0x7fee5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.207+0000 7fee6ad9d640 1 -- 172.21.15.107:0/4097014069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee580039c0 msgr2=0x7fee58003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.207+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee580039c0 0x7fee58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.207+0000 7fee6ad9d640 1 -- 172.21.15.107:0/4097014069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580047c0 msgr2=0x7fee58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.207+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580047c0 0x7fee58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.207+0000 7fee6ad9d640 1 -- 172.21.15.107:0/4097014069 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58003520 con 0x7fee580052a0 2023-12-16T01:26:26.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.208+0000 7fee6ad9d640 1 -- 172.21.15.107:0/4097014069 reap_dead start 2023-12-16T01:26:26.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.209+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee580052a0 0x7fee5800b980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a522e0229602c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.213+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c004220 con 0x7fee580052a0 2023-12-16T01:26:26.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.213+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c02e050 con 0x7fee580052a0 2023-12-16T01:26:26.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.213+0000 7fee6959a640 1 -- 172.21.15.107:0/4097014069 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0035f0 con 0x7fee580052a0 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 -- 172.21.15.107:0/4097014069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee580052a0 msgr2=0x7fee5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee580052a0 0x7fee5800b980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee580057f0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 -- 172.21.15.107:0/4097014069 shutdown_connections 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 --2- 172.21.15.107:0/4097014069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee580052a0 0x7fee5800b980 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 -- 172.21.15.107:0/4097014069 >> 172.21.15.107:0/4097014069 conn(0x7fee6c061100 msgr2=0x7fee6c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 -- 172.21.15.107:0/4097014069 shutdown_connections 2023-12-16T01:26:26.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.214+0000 7fee70ee0640 1 -- 172.21.15.107:0/4097014069 wait complete. 2023-12-16T01:26:26.216 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T01:26:26.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.216+0000 7fee70ee0640 1 Processor -- start 2023-12-16T01:26:26.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.216+0000 7fee70ee0640 1 -- start start 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.217+0000 7fee70ee0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580052a0 0x7fee6c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.217+0000 7fee70ee0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee6c157f00 0x7fee6c1f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.217+0000 7fee70ee0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 0x7fee6c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.217+0000 7fee70ee0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c155820 con 0x7fee6c1eec90 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.217+0000 7fee70ee0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1ef140 con 0x7fee580052a0 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.217+0000 7fee70ee0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c155a50 con 0x7fee6c157f00 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.218+0000 7fee6ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 0x7fee6c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.219+0000 7fee6ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 0x7fee6c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41684/0 (socket says 172.21.15.107:41684) 2023-12-16T01:26:26.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.219+0000 7fee6ad9d640 1 -- 172.21.15.107:0/2861888215 learned_addr learned my addr 172.21.15.107:0/2861888215 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.222+0000 7fee6ad9d640 1 -- 172.21.15.107:0/2861888215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee6c157f00 msgr2=0x7fee6c1f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.222+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee6c157f00 0x7fee6c1f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.222+0000 7fee6ad9d640 1 -- 172.21.15.107:0/2861888215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580052a0 msgr2=0x7fee6c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.222+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580052a0 0x7fee6c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.222+0000 7fee6ad9d640 1 -- 172.21.15.107:0/2861888215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c155d10 con 0x7fee6c1eec90 2023-12-16T01:26:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.224+0000 7fee6ad9d640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 0x7fee6c0cd320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee5c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.228+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c036070 con 0x7fee6c1eec90 2023-12-16T01:26:26.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.228+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c037040 con 0x7fee6c1eec90 2023-12-16T01:26:26.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.228+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c155820 con 0x7fee6c1eec90 2023-12-16T01:26:26.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.228+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c03b600 con 0x7fee6c1eec90 2023-12-16T01:26:26.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.228+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c1562d0 con 0x7fee6c1eec90 2023-12-16T01:26:26.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.229+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c0740e0 con 0x7fee6c1eec90 2023-12-16T01:26:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.252+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fee5c03b760 con 0x7fee6c1eec90 2023-12-16T01:26:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.253+0000 7fee62ffd640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee4c06ae70 0x7fee4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.253+0000 7fee6a59c640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee4c06ae70 0x7fee4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.253+0000 7fee6a59c640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee4c06ae70 0x7fee4c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee64001e90 tx=0x7fee64001940 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.279+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd988054e90 con 0x7fd994153890 2023-12-16T01:26:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.319+0000 7f5f30283640 1 Processor -- start 2023-12-16T01:26:26.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.319+0000 7f5f30283640 1 -- start start 2023-12-16T01:26:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.320+0000 7f5f30283640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f28153c70 0x7f5f2815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.320+0000 7f5f30283640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2815a700 con 0x7f5f28153890 2023-12-16T01:26:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.320+0000 7f5f30283640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f280ca870 con 0x7f5f280ceef0 2023-12-16T01:26:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.320+0000 7f5f30283640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28159af0 con 0x7f5f28153c70 2023-12-16T01:26:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.321+0000 7f5f2e820640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5f280ceef0 0x7f5f2815aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:35016/0 (socket says 172.21.15.107:35016) 2023-12-16T01:26:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.321+0000 7f5f2e820640 1 -- 172.21.15.107:0/1882742822 learned_addr learned my addr 172.21.15.107:0/1882742822 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.324+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459441080 0 0) 0x7f5f280ca870 con 0x7f5f280ceef0 2023-12-16T01:26:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.324+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f14003520 con 0x7f5f280ceef0 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3269491106 0 0) 0x7f5f14003520 con 0x7f5f280ceef0 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f28153c70 msgr2=0x7f5f2815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f28153c70 0x7f5f2815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 >> v1:172.21.15.107:6789/0 conn(0x7f5f28153890 legacy=0x7f5f280c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28159dd0 con 0x7f5f280ceef0 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7f5f200019f0 con 0x7f5f280ceef0 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 >> v1:172.21.15.157:6789/0 conn(0x7f5f280ceef0 legacy=0x7f5f2815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f14003970 0x7f5f14003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f140047c0 0x7f5f14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f28153c70 0x7f5f1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28159af0 con 0x7f5f140047c0 2023-12-16T01:26:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f14005570 con 0x7f5f14003970 2023-12-16T01:26:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.327+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1400bec0 con 0x7f5f28153c70 2023-12-16T01:26:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.329+0000 7f5f2e01f640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f14003970 0x7f5f14003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.332 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T01:26:26.333 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T01:26:26.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.333+0000 7f5f2e01f640 1 -- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f28153c70 msgr2=0x7f5f1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.333+0000 7f5f2e01f640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f28153c70 0x7f5f1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.333+0000 7f5f2e01f640 1 -- 172.21.15.107:0/1882742822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f140047c0 msgr2=0x7f5f14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.333+0000 7f5f2e01f640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f140047c0 0x7f5f14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.333+0000 7f5f2e01f640 1 -- 172.21.15.107:0/1882742822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14003520 con 0x7f5f14003970 2023-12-16T01:26:26.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.335+0000 7f5f2e01f640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f14003970 0x7f5f14003d70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f24001680 tx=0x7f5f140057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28b7552f95969b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.339+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24005270 con 0x7f5f14003970 2023-12-16T01:26:26.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.339+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2402e070 con 0x7f5f14003970 2023-12-16T01:26:26.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.339+0000 7f5f2d01d640 1 -- 172.21.15.107:0/1882742822 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24003610 con 0x7f5f14003970 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f30283640 1 -- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f14003970 msgr2=0x7f5f14003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f30283640 1 --2- 172.21.15.107:0/1882742822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f14003970 0x7f5f14003d70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f24001680 tx=0x7f5f140057f0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f2e820640 1 -- 172.21.15.107:0/1882742822 reap_dead start 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f30283640 1 -- 172.21.15.107:0/1882742822 shutdown_connections 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f30283640 1 -- 172.21.15.107:0/1882742822 >> 172.21.15.107:0/1882742822 conn(0x7f5f2806ba00 msgr2=0x7f5f2806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f30283640 1 -- 172.21.15.107:0/1882742822 shutdown_connections 2023-12-16T01:26:26.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.340+0000 7f5f30283640 1 -- 172.21.15.107:0/1882742822 wait complete. 2023-12-16T01:26:26.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.341+0000 7f5f30283640 1 Processor -- start 2023-12-16T01:26:26.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.342+0000 7f5f30283640 1 -- start start 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.342+0000 7f5f30283640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f14003970 0x7f5f280cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.342+0000 7f5f30283640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f280b5000 0x7f5f280ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.342+0000 7f5f30283640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 0x7f5f280c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.343+0000 7f5f30283640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280c4320 con 0x7f5f14003970 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.343+0000 7f5f30283640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2814e9c0 con 0x7f5f280ceac0 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.343+0000 7f5f30283640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2814f860 con 0x7f5f280b5000 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.343+0000 7f5f2e820640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 0x7f5f280c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.343+0000 7f5f2e820640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 0x7f5f280c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47784/0 (socket says 172.21.15.107:47784) 2023-12-16T01:26:26.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.343+0000 7f5f2e820640 1 -- 172.21.15.107:0/1517968325 learned_addr learned my addr 172.21.15.107:0/1517968325 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.347+0000 7f5f2e820640 1 -- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f280b5000 msgr2=0x7f5f280ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.347+0000 7f5f2e820640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f280b5000 0x7f5f280ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.347+0000 7f5f2e820640 1 -- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f14003970 msgr2=0x7f5f280cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.347+0000 7f5f2e820640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f14003970 0x7f5f280cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.347+0000 7f5f2e820640 1 -- 172.21.15.107:0/1517968325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280c3f80 con 0x7f5f280ceac0 2023-12-16T01:26:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.349+0000 7f5f2e820640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 0x7f5f280c4740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f280c6290 tx=0x7f5f2000cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.353+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20007110 con 0x7f5f280ceac0 2023-12-16T01:26:26.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.353+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20007270 con 0x7f5f280ceac0 2023-12-16T01:26:26.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.354+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20007620 con 0x7f5f280ceac0 2023-12-16T01:26:26.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.354+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f280c5470 con 0x7f5f280ceac0 2023-12-16T01:26:26.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.354+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f280c5a30 con 0x7f5f280ceac0 2023-12-16T01:26:26.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.355+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f280c4460 con 0x7f5f280ceac0 2023-12-16T01:26:26.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.383+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee5c000e40 con 0x7fee6c1eec90 2023-12-16T01:26:26.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.409+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc244067500 con 0x7fc244151510 2023-12-16T01:26:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.433+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2ae801a400 con 0x7f2b00153890 2023-12-16T01:26:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.434+0000 7f2af6ffd640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ae006ae40 0x7f2ae006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.434+0000 7f2afe59c640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ae006ae40 0x7f2ae006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.434+0000 7f2afe59c640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ae006ae40 0x7f2ae006d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2af0001560 tx=0x7f2af0007990 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.436+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ae8058b90 con 0x7f2b00153890 2023-12-16T01:26:26.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.440+0000 7f2787a9b640 1 Processor -- start 2023-12-16T01:26:26.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.440+0000 7f2787a9b640 1 -- start start 2023-12-16T01:26:26.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.441+0000 7f2787a9b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2780153c70 0x7f278015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.441+0000 7f2787a9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 0x7f27800cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.441+0000 7f2787a9b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278015a700 con 0x7f2780153890 2023-12-16T01:26:26.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.441+0000 7f2787a9b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27800ca870 con 0x7f2780153c70 2023-12-16T01:26:26.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.441+0000 7f2787a9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2780159af0 con 0x7f27800ceef0 2023-12-16T01:26:26.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.446+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2ae8054ed0 con 0x7f2b00153890 2023-12-16T01:26:26.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.453+0000 7f2786038640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 0x7f27800cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.454+0000 7f2786038640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 0x7f27800cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33848/0 (socket says 172.21.15.107:33848) 2023-12-16T01:26:26.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.454+0000 7f2786038640 1 -- 172.21.15.107:0/3891541176 learned_addr learned my addr 172.21.15.107:0/3891541176 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.459+0000 7f2786038640 1 -- 172.21.15.107:0/3891541176 >> v2:172.21.15.107:3300/0 conn(0x7f2780153c70 msgr2=0x7f278015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.459+0000 7f2786038640 1 --2- 172.21.15.107:0/3891541176 >> v2:172.21.15.107:3300/0 conn(0x7f2780153c70 0x7f278015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.459+0000 7f2786038640 1 -- 172.21.15.107:0/3891541176 >> v1:172.21.15.107:6789/0 conn(0x7f2780153890 legacy=0x7f27800c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.459+0000 7f2786038640 1 -- 172.21.15.107:0/3891541176 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780159dd0 con 0x7f27800ceef0 2023-12-16T01:26:26.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.461+0000 7f2786038640 1 --2- 172.21.15.107:0/3891541176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 0x7f27800cf320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2778009e50 tx=0x7f277802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d14270157c9bc79 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.464+0000 7f9797f41640 1 Processor -- start 2023-12-16T01:26:26.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.464+0000 7f9797f41640 1 -- start start 2023-12-16T01:26:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.465+0000 7f9797f41640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f979006f590 0x7f9790157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.465+0000 7f9797f41640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979006fa00 con 0x7f97900c2000 2023-12-16T01:26:26.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.465+0000 7f9797f41640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979015b9c0 con 0x7f9790151630 2023-12-16T01:26:26.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.465+0000 7f9797f41640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9790158490 con 0x7f979006f590 2023-12-16T01:26:26.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.466+0000 7f2784835640 1 -- 172.21.15.107:0/3891541176 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277802cb00 con 0x7f27800ceef0 2023-12-16T01:26:26.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.466+0000 7f2784835640 1 -- 172.21.15.107:0/3891541176 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277802cc60 con 0x7f27800ceef0 2023-12-16T01:26:26.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.466+0000 7f2784835640 1 -- 172.21.15.107:0/3891541176 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780343f0 con 0x7f27800ceef0 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 -- 172.21.15.107:0/3891541176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 msgr2=0x7f27800cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 --2- 172.21.15.107:0/3891541176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 0x7f27800cf320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2778009e50 tx=0x7f277802bf60 comp rx=0 tx=0).stop 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 -- 172.21.15.107:0/3891541176 shutdown_connections 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 --2- 172.21.15.107:0/3891541176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27800ceef0 0x7f27800cf320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 --2- 172.21.15.107:0/3891541176 >> v2:172.21.15.107:3300/0 conn(0x7f2780153c70 0x7f278015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 -- 172.21.15.107:0/3891541176 >> 172.21.15.107:0/3891541176 conn(0x7f278006ba00 msgr2=0x7f278006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 -- 172.21.15.107:0/3891541176 shutdown_connections 2023-12-16T01:26:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.467+0000 7f2787a9b640 1 -- 172.21.15.107:0/3891541176 wait complete. 2023-12-16T01:26:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.468+0000 7f2787a9b640 1 Processor -- start 2023-12-16T01:26:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.468+0000 7f2787a9b640 1 -- start start 2023-12-16T01:26:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2787a9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27800ceef0 0x7f2780152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2787a9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 0x7f2780145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2787a9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2780153c70 0x7f27801efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2787a9b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27801efa00 con 0x7f27800ceef0 2023-12-16T01:26:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2787a9b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27800cd940 con 0x7f2780153c70 2023-12-16T01:26:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2787a9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27801552a0 con 0x7f2780153890 2023-12-16T01:26:26.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.469+0000 7f2785036640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 0x7f2780145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.470+0000 7f2785036640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 0x7f2780145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:33850/0 (socket says 172.21.15.107:33850) 2023-12-16T01:26:26.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.470+0000 7f2785036640 1 -- 172.21.15.107:0/2619967337 learned_addr learned my addr 172.21.15.107:0/2619967337 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.473+0000 7f2785036640 1 -- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2780153c70 msgr2=0x7f27801efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.473+0000 7f2785036640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2780153c70 0x7f27801efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.473+0000 7f2785036640 1 -- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27800ceef0 msgr2=0x7f2780152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.473+0000 7f2785036640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27800ceef0 0x7f2780152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.473+0000 7f2785036640 1 -- 172.21.15.107:0/2619967337 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778009b30 con 0x7f2780153890 2023-12-16T01:26:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.475+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5f20007780 con 0x7f5f280ceac0 2023-12-16T01:26:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.475+0000 7f5f1effd640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5f0c06ae40 0x7f5f0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.475+0000 7f5f2e01f640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5f0c06ae40 0x7f5f0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.475+0000 7f5f2e01f640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5f0c06ae40 0x7f5f0c06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f24033000 tx=0x7f5f24005000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.476+0000 7f2785036640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 0x7f2780145db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f277000b410 tx=0x7f277000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.479+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011830 con 0x7f2780153890 2023-12-16T01:26:26.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.479+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27700119b0 con 0x7f2780153890 2023-12-16T01:26:26.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.479+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27801f3080 con 0x7f2780153890 2023-12-16T01:26:26.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.479+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011d60 con 0x7f2780153890 2023-12-16T01:26:26.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.479+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27801f3640 con 0x7f2780153890 2023-12-16T01:26:26.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.480+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2780067500 con 0x7f2780153890 2023-12-16T01:26:26.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.480+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd99415aeb0 con 0x7fd994153890 2023-12-16T01:26:26.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.498+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f277001a400 con 0x7f2780153890 2023-12-16T01:26:26.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.498+0000 7f27767fc640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f276406ae40 0x7f276406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.498+0000 7f2785837640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f276406ae40 0x7f276406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.499+0000 7f2785837640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f276406ae40 0x7f276406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f277c001560 tx=0x7f277c007990 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.602+0000 7f97954dc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f979006f590 0x7f9790157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.602+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fee5c076060 con 0x7fee6c1eec90 2023-12-16T01:26:26.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.603+0000 7f97954dc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f979006f590 0x7f9790157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41710/0 (socket says 172.21.15.107:41710) 2023-12-16T01:26:26.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.603+0000 7f97954dc640 1 -- 172.21.15.107:0/2524252684 learned_addr learned my addr 172.21.15.107:0/2524252684 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.611+0000 7f97954dc640 1 -- 172.21.15.107:0/2524252684 >> v1:172.21.15.157:6789/0 conn(0x7f9790151630 legacy=0x7f97900c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.611+0000 7f97954dc640 1 -- 172.21.15.107:0/2524252684 >> v1:172.21.15.107:6789/0 conn(0x7f97900c2000 legacy=0x7f97900c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:26.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.611+0000 7f97954dc640 1 -- 172.21.15.107:0/2524252684 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979015ab60 con 0x7f979006f590 2023-12-16T01:26:26.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.615+0000 7f97954dc640 1 --2- 172.21.15.107:0/2524252684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979006f590 0x7f9790157f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9780009870 tx=0x7f978002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f636631d80748db7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.621+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f20058680 con 0x7f5f280ceac0 2023-12-16T01:26:26.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.628+0000 7fc232ffd640 1 -- 172.21.15.107:0/3190066320 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc23407b8d0 con 0x7fc244151510 2023-12-16T01:26:26.628 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:26.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9794cdb640 1 -- 172.21.15.107:0/2524252684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780030860 con 0x7f979006f590 2023-12-16T01:26:26.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9794cdb640 1 -- 172.21.15.107:0/2524252684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800309c0 con 0x7f979006f590 2023-12-16T01:26:26.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9794cdb640 1 -- 172.21.15.107:0/2524252684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780030d50 con 0x7f979006f590 2023-12-16T01:26:26.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc22406ae40 msgr2=0x7fc22406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7fc248ce7640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc22406ae40 0x7fc22406d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc23c001f10 tx=0x7fc23c009040 comp rx=0 tx=0).stop 2023-12-16T01:26:26.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 msgr2=0x7fc244144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7fc248ce7640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 0x7fc244144330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc234009870 tx=0x7fc2340046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9797f41640 1 -- 172.21.15.107:0/2524252684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979006f590 msgr2=0x7f9790157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9797f41640 1 --2- 172.21.15.107:0/2524252684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979006f590 0x7f9790157f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9780009870 tx=0x7f978002b9a0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9797f41640 1 -- 172.21.15.107:0/2524252684 shutdown_connections 2023-12-16T01:26:26.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9797f41640 1 --2- 172.21.15.107:0/2524252684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979006f590 0x7f9790157f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.630+0000 7f9797f41640 1 -- 172.21.15.107:0/2524252684 >> 172.21.15.107:0/2524252684 conn(0x7f9790061100 msgr2=0x7f97900614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 shutdown_connections 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc244151510 0x7fc244144330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2440c61a0 0x7fc244142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc22406ae40 0x7fc22406d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 --2- 172.21.15.107:0/3190066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2440728b0 0x7fc244159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 >> 172.21.15.107:0/3190066320 conn(0x7fc24406cd60 msgr2=0x7fc244070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7f9797f41640 1 -- 172.21.15.107:0/2524252684 shutdown_connections 2023-12-16T01:26:26.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7f9797f41640 1 -- 172.21.15.107:0/2524252684 wait complete. 2023-12-16T01:26:26.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 shutdown_connections 2023-12-16T01:26:26.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.631+0000 7fc248ce7640 1 -- 172.21.15.107:0/3190066320 wait complete. 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.632+0000 7f9797f41640 1 Processor -- start 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.632+0000 7f9797f41640 1 -- start start 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.633+0000 7f9797f41640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f979006f590 0x7f9790158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.633+0000 7f9797f41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 0x7f979014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.633+0000 7f9797f41640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9790151630 0x7f979014e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.633+0000 7f9797f41640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901f09e0 con 0x7f97900c2000 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.633+0000 7f9797f41640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901f0700 con 0x7f9790151630 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.633+0000 7f9797f41640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790159450 con 0x7f979006f590 2023-12-16T01:26:26.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.635+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5f200542c0 con 0x7f5f280ceac0 2023-12-16T01:26:26.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.635+0000 7fd97bfff640 1 -- 172.21.15.107:0/3925698098 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd99415aeb0 con 0x7fd994153890 2023-12-16T01:26:26.636 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:26.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.636+0000 7f97954dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 0x7f979014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.636+0000 7f97954dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 0x7f979014ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41728/0 (socket says 172.21.15.107:41728) 2023-12-16T01:26:26.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.636+0000 7f97954dc640 1 -- 172.21.15.107:0/2232189367 learned_addr learned my addr 172.21.15.107:0/2232189367 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd98006ae90 msgr2=0x7fd98006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd98006ae90 0x7fd98006d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd984003cc0 tx=0x7fd9840079b0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd994153890 msgr2=0x7fd9941440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd994153890 0x7fd9941440c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd98800e870 tx=0x7fd98800ed30 comp rx=0 tx=0).stop 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 shutdown_connections 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd994153c70 0x7fd994144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd98006ae90 0x7fd98006d350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd994153890 0x7fd9941440c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 --2- 172.21.15.107:0/3925698098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9940ceef0 0x7fd9940b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 >> 172.21.15.107:0/3925698098 conn(0x7fd99406ba00 msgr2=0x7fd9940cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 shutdown_connections 2023-12-16T01:26:26.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7fd99a044640 1 -- 172.21.15.107:0/3925698098 wait complete. 2023-12-16T01:26:26.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7f97954dc640 1 -- 172.21.15.107:0/2232189367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f979006f590 msgr2=0x7f9790158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7f97954dc640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f979006f590 0x7f9790158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.639+0000 7f97954dc640 1 -- 172.21.15.107:0/2232189367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9790151630 msgr2=0x7f979014e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.640+0000 7f97954dc640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9790151630 0x7f979014e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.640+0000 7f97954dc640 1 -- 172.21.15.107:0/2232189367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800094d0 con 0x7f97900c2000 2023-12-16T01:26:26.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.643+0000 7f97954dc640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 0x7f979014ca60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9780009870 tx=0x7f97800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.2 2023-12-16T01:26:26.645 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:26.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.647+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780039450 con 0x7f97900c2000 2023-12-16T01:26:26.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.647+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800395d0 con 0x7f97900c2000 2023-12-16T01:26:26.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.647+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780039980 con 0x7f97900c2000 2023-12-16T01:26:26.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.647+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979014cfa0 con 0x7f97900c2000 2023-12-16T01:26:26.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.648+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97901efdd0 con 0x7f97900c2000 2023-12-16T01:26:26.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.648+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97900740e0 con 0x7f97900c2000 2023-12-16T01:26:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.653+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2b0015aeb0 con 0x7f2b00153890 2023-12-16T01:26:26.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.3 2023-12-16T01:26:26.657 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:26.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.671+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f9780039ae0 con 0x7f97900c2000 2023-12-16T01:26:26.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.672+0000 7f97867fc640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f977406ae90 0x7f977406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.672+0000 7f9795cdd640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f977406ae90 0x7f977406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.672+0000 7f9795cdd640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f977406ae90 0x7f977406d350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f978c001560 tx=0x7f978c007990 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.739+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2770058ba0 con 0x7f2780153890 2023-12-16T01:26:26.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.754+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2770054ee0 con 0x7f2780153890 2023-12-16T01:26:26.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.757+0000 7f2af6ffd640 1 -- 172.21.15.107:0/2399498681 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b0015aeb0 con 0x7f2b00153890 2023-12-16T01:26:26.758 INFO:teuthology.orchestra.run.smithi107.stdout:60129542157 2023-12-16T01:26:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ae006ae40 msgr2=0x7f2ae006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ae006ae40 0x7f2ae006d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2af0001560 tx=0x7f2af0007990 comp rx=0 tx=0).stop 2023-12-16T01:26:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 msgr2=0x7f2b00154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 0x7f2b00154900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800b410 tx=0x7f2ae800b8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 shutdown_connections 2023-12-16T01:26:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b00153c70 0x7f2b00151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b00153890 0x7f2b00154900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ae006ae40 0x7f2ae006d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 --2- 172.21.15.107:0/2399498681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b000ceef0 0x7f2b000ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 >> 172.21.15.107:0/2399498681 conn(0x7f2b0006ba00 msgr2=0x7f2b0015b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 shutdown_connections 2023-12-16T01:26:26.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.760+0000 7f2b04990640 1 -- 172.21.15.107:0/2399498681 wait complete. 2023-12-16T01:26:26.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.7 2023-12-16T01:26:26.777 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:26.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.830+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fee6c061860 con 0x7fee6c1eec90 2023-12-16T01:26:26.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.858+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5f280c4460 con 0x7f5f280ceac0 2023-12-16T01:26:26.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.862+0000 7f5f1effd640 1 -- 172.21.15.107:0/1517968325 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f280c4460 con 0x7f5f280ceac0 2023-12-16T01:26:26.863 INFO:teuthology.orchestra.run.smithi107.stdout:60129542155 2023-12-16T01:26:26.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5f0c06ae40 msgr2=0x7f5f0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5f0c06ae40 0x7f5f0c06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f24033000 tx=0x7f5f24005000 comp rx=0 tx=0).stop 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 msgr2=0x7f5f280c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 0x7f5f280c4740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f280c6290 tx=0x7f5f2000cf00 comp rx=0 tx=0).stop 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 shutdown_connections 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5f0c06ae40 0x7f5f0c06d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f280ceac0 0x7f5f280c4740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f280b5000 0x7f5f280ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 --2- 172.21.15.107:0/1517968325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f14003970 0x7f5f280cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 >> 172.21.15.107:0/1517968325 conn(0x7f5f2806ba00 msgr2=0x7f5f28157610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 shutdown_connections 2023-12-16T01:26:26.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.864+0000 7f5f30283640 1 -- 172.21.15.107:0/1517968325 wait complete. 2023-12-16T01:26:26.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.6 2023-12-16T01:26:26.876 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:26.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.930+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f978007fab0 con 0x7f97900c2000 2023-12-16T01:26:26.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.930+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f978007b6f0 con 0x7f97900c2000 2023-12-16T01:26:26.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.941+0000 7fee62ffd640 1 -- 172.21.15.107:0/2861888215 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee5c077f90 con 0x7fee6c1eec90 2023-12-16T01:26:26.942 INFO:teuthology.orchestra.run.smithi107.stdout:60129542156 2023-12-16T01:26:26.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee4c06ae70 msgr2=0x7fee4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee4c06ae70 0x7fee4c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee64001e90 tx=0x7fee64001940 comp rx=0 tx=0).stop 2023-12-16T01:26:26.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 msgr2=0x7fee6c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 0x7fee6c0cd320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee5c0047d0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 shutdown_connections 2023-12-16T01:26:26.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee6c1eec90 0x7fee6c0cd320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee6c157f00 0x7fee6c1f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fee4c06ae70 0x7fee4c06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 --2- 172.21.15.107:0/2861888215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee580052a0 0x7fee6c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 >> 172.21.15.107:0/2861888215 conn(0x7fee6c061100 msgr2=0x7fee6c0c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 shutdown_connections 2023-12-16T01:26:26.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.944+0000 7fee70ee0640 1 -- 172.21.15.107:0/2861888215 wait complete. 2023-12-16T01:26:26.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.948+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f278015aeb0 con 0x7f2780153890 2023-12-16T01:26:26.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.951+0000 7f27767fc640 1 -- 172.21.15.107:0/2619967337 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f278015aeb0 con 0x7f2780153890 2023-12-16T01:26:26.952 INFO:teuthology.orchestra.run.smithi107.stdout:60129542157 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.953+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f276406ae40 msgr2=0x7f276406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.953+0000 7f2787a9b640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f276406ae40 0x7f276406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f277c001560 tx=0x7f277c007990 comp rx=0 tx=0).stop 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.953+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 msgr2=0x7f2780145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.953+0000 7f2787a9b640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 0x7f2780145db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f277000b410 tx=0x7f277000b8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 shutdown_connections 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f276406ae40 0x7f276406d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2780153c70 0x7f27801efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2780153890 0x7f2780145db0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 --2- 172.21.15.107:0/2619967337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27800ceef0 0x7f2780152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:26.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 >> 172.21.15.107:0/2619967337 conn(0x7f278006ba00 msgr2=0x7f2780157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:26.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 shutdown_connections 2023-12-16T01:26:26.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:26.954+0000 7f2787a9b640 1 -- 172.21.15.107:0/2619967337 wait complete. 2023-12-16T01:26:26.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.5 2023-12-16T01:26:26.959 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:26.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.4 2023-12-16T01:26:26.966 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:27.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.115+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97900740e0 con 0x7f97900c2000 2023-12-16T01:26:27.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.140+0000 7f97867fc640 1 -- 172.21.15.107:0/2232189367 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9780034020 con 0x7f97900c2000 2023-12-16T01:26:27.142 INFO:teuthology.orchestra.run.smithi107.stdout:60129542157 2023-12-16T01:26:27.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f977406ae90 msgr2=0x7f977406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f977406ae90 0x7f977406d350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f978c001560 tx=0x7f978c007990 comp rx=0 tx=0).stop 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 msgr2=0x7f979014ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 0x7f979014ca60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9780009870 tx=0x7f97800046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 shutdown_connections 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f977406ae90 0x7f977406d350 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9790151630 0x7f979014e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97900c2000 0x7f979014ca60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 --2- 172.21.15.107:0/2232189367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f979006f590 0x7f9790158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 >> 172.21.15.107:0/2232189367 conn(0x7f9790061100 msgr2=0x7f97900c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 shutdown_connections 2023-12-16T01:26:27.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.142+0000 7f9797f41640 1 -- 172.21.15.107:0/2232189367 wait complete. 2023-12-16T01:26:27.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542157 for osd.1 2023-12-16T01:26:27.155 DEBUG:teuthology.parallel:result is None 2023-12-16T01:26:27.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T01:26:27.155 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:26:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.254+0000 7f2f08dce640 1 Processor -- start 2023-12-16T01:26:27.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.254+0000 7f2f08dce640 1 -- start start 2023-12-16T01:26:27.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.255+0000 7f2f08dce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2f040c4de0 0x7f2f0406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.255+0000 7f2f08dce640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f0406f940 0x7f2f041514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.255+0000 7f2f08dce640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040c7dd0 con 0x7f2f040c51c0 2023-12-16T01:26:27.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.255+0000 7f2f08dce640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f04158640 con 0x7f2f0406f940 2023-12-16T01:26:27.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.255+0000 7f2f08dce640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0406ec40 con 0x7f2f040c4de0 2023-12-16T01:26:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.256+0000 7f2efbfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f0406f940 0x7f2f041514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.256+0000 7f2f0259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2f040c4de0 0x7f2f0406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.256+0000 7f2efbfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f0406f940 0x7f2f041514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41742/0 (socket says 172.21.15.107:41742) 2023-12-16T01:26:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.256+0000 7f2efbfff640 1 -- 172.21.15.107:0/2779097184 learned_addr learned my addr 172.21.15.107:0/2779097184 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.258+0000 7f2efbfff640 1 -- 172.21.15.107:0/2779097184 >> v2:172.21.15.157:3300/0 conn(0x7f2f040c4de0 msgr2=0x7f2f0406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.258+0000 7f2efbfff640 1 --2- 172.21.15.107:0/2779097184 >> v2:172.21.15.157:3300/0 conn(0x7f2f040c4de0 0x7f2f0406f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.258+0000 7f2efbfff640 1 -- 172.21.15.107:0/2779097184 >> v1:172.21.15.157:6789/0 conn(0x7f2f040c51c0 legacy=0x7f2f0415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.258+0000 7f2efbfff640 1 -- 172.21.15.107:0/2779097184 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0406a8b0 con 0x7f2f0406f940 2023-12-16T01:26:27.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.261+0000 7f2efbfff640 1 --2- 172.21.15.107:0/2779097184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041514e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f040c8e70 tx=0x7f2eec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac8562b0202af9e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:27.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.264+0000 7f2f01d9b640 1 -- 172.21.15.107:0/2779097184 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec031870 con 0x7f2f0406f940 2023-12-16T01:26:27.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.264+0000 7f2f01d9b640 1 -- 172.21.15.107:0/2779097184 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec0319d0 con 0x7f2f0406f940 2023-12-16T01:26:27.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.264+0000 7f2f01d9b640 1 -- 172.21.15.107:0/2779097184 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec031d60 con 0x7f2f0406f940 2023-12-16T01:26:27.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 -- 172.21.15.107:0/2779097184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 msgr2=0x7f2f041514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 --2- 172.21.15.107:0/2779097184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041514e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f040c8e70 tx=0x7f2eec02b910 comp rx=0 tx=0).stop 2023-12-16T01:26:27.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 -- 172.21.15.107:0/2779097184 shutdown_connections 2023-12-16T01:26:27.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 --2- 172.21.15.107:0/2779097184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041514e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 --2- 172.21.15.107:0/2779097184 >> v2:172.21.15.157:3300/0 conn(0x7f2f040c4de0 0x7f2f0406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 -- 172.21.15.107:0/2779097184 >> 172.21.15.107:0/2779097184 conn(0x7f2f040c7f60 msgr2=0x7f2f040c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 -- 172.21.15.107:0/2779097184 shutdown_connections 2023-12-16T01:26:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.265+0000 7f2f08dce640 1 -- 172.21.15.107:0/2779097184 wait complete. 2023-12-16T01:26:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.266+0000 7f2f08dce640 1 Processor -- start 2023-12-16T01:26:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.266+0000 7f2f08dce640 1 -- start start 2023-12-16T01:26:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.267+0000 7f2f08dce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.267+0000 7f2f08dce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f040c4de0 0x7f2f0414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.267+0000 7f2f08dce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f040c51c0 0x7f2f040ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.267+0000 7f2f08dce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0414e350 con 0x7f2f0406f940 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.267+0000 7f2f08dce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041f1580 con 0x7f2f040c4de0 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.267+0000 7f2f08dce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041f12a0 con 0x7f2f040c51c0 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.268+0000 7f2f0259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.268+0000 7f2efbfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f040c4de0 0x7f2f0414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.268+0000 7f2f02d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f040c51c0 0x7f2f040ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.268+0000 7f2f0259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41754/0 (socket says 172.21.15.107:41754) 2023-12-16T01:26:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.268+0000 7f2f0259c640 1 -- 172.21.15.107:0/1800433736 learned_addr learned my addr 172.21.15.107:0/1800433736 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.272+0000 7f2f0259c640 1 -- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f040c51c0 msgr2=0x7f2f040ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.272+0000 7f2f0259c640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f040c51c0 0x7f2f040ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.272+0000 7f2f0259c640 1 -- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f040c4de0 msgr2=0x7f2f0414d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.272+0000 7f2f0259c640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f040c4de0 0x7f2f0414d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.272+0000 7f2f0259c640 1 -- 172.21.15.107:0/1800433736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0094d0 con 0x7f2f0406f940 2023-12-16T01:26:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.272+0000 7f2efbfff640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f040c4de0 0x7f2f0414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:27.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.274+0000 7f2f0259c640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041f0900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400e9b0 tx=0x7f2ef400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.277+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4009670 con 0x7f2f0406f940 2023-12-16T01:26:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.277+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400c9a0 con 0x7f2f0406f940 2023-12-16T01:26:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.277+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400cd50 con 0x7f2f0406f940 2023-12-16T01:26:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.277+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f04154a20 con 0x7f2f0406f940 2023-12-16T01:26:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.277+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0414e5c0 con 0x7f2f0406f940 2023-12-16T01:26:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.278+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f04067500 con 0x7f2f0406f940 2023-12-16T01:26:27.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.520+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2ef4013470 con 0x7f2f0406f940 2023-12-16T01:26:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.520+0000 7f2efaffd640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ee406ae90 0x7f2ee406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.520+0000 7f2efbfff640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ee406ae90 0x7f2ee406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.521+0000 7f2efbfff640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ee406ae90 0x7f2ee406d350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2eec036000 tx=0x7f2eec03c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:27.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.533+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ef4058dc0 con 0x7f2f0406f940 2023-12-16T01:26:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.533+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2ef4055100 con 0x7f2f0406f940 2023-12-16T01:26:27.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.705+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f0406ae70 con 0x7f2ee406ae90 2023-12-16T01:26:27.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.713+0000 7f2efaffd640 1 -- 172.21.15.107:0/1800433736 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345323 (secure 0 0 0) 0x7f2eec03a420 con 0x7f2ee406ae90 2023-12-16T01:26:27.718 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:27.720 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.716+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ee406ae90 msgr2=0x7f2ee406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.716+0000 7f2f08dce640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ee406ae90 0x7f2ee406d350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2eec036000 tx=0x7f2eec03c040 comp rx=0 tx=0).stop 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.716+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 msgr2=0x7f2f041f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.716+0000 7f2f08dce640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041f0900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400e9b0 tx=0x7f2ef400ee70 comp rx=0 tx=0).stop 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 shutdown_connections 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f040c51c0 0x7f2f040ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f2ee406ae90 0x7f2ee406d350 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f040c4de0 0x7f2f0414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 --2- 172.21.15.107:0/1800433736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f0406f940 0x7f2f041f0900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 >> 172.21.15.107:0/1800433736 conn(0x7f2f040c7f60 msgr2=0x7f2f04071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:27.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 shutdown_connections 2023-12-16T01:26:27.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.717+0000 7f2f08dce640 1 -- 172.21.15.107:0/1800433736 wait complete. 2023-12-16T01:26:27.729 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-12-16T01:26:25.720303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235144,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739576,"statfs":{"total":773094113280,"available":772853325824,"internally_reserved":0,"allocated":2392064,"data_stored":2050444,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002982"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956050+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:25:54.956050+0000","last_peered":"2023-12-16T01:25:54.956050+0000","last_clean":"2023-12-16T01:25:54.956050+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:25:54.956050+0000","last_undegraded":"2023-12-16T01:25:54.956050+0000","last_fullsized":"2023-12-16T01:25:54.956050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976062+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:25:54.976062+0000","last_peered":"2023-12-16T01:25:54.976062+0000","last_clean":"2023-12-16T01:25:54.976062+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:25:54.976062+0000","last_undegraded":"2023-12-16T01:25:54.976062+0000","last_fullsized":"2023-12-16T01:25:54.976062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579762+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:25:57.579762+0000","last_peered":"2023-12-16T01:25:57.579762+0000","last_clean":"2023-12-16T01:25:57.579762+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:25:57.579762+0000","last_undegraded":"2023-12-16T01:25:57.579762+0000","last_fullsized":"2023-12-16T01:25:57.579762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976137+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:25:54.976137+0000","last_peered":"2023-12-16T01:25:54.976137+0000","last_clean":"2023-12-16T01:25:54.976137+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:25:54.976137+0000","last_undegraded":"2023-12-16T01:25:54.976137+0000","last_fullsized":"2023-12-16T01:25:54.976137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976018+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:25:54.976018+0000","last_peered":"2023-12-16T01:25:54.976018+0000","last_clean":"2023-12-16T01:25:54.976018+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:25:54.976018+0000","last_undegraded":"2023-12-16T01:25:54.976018+0000","last_fullsized":"2023-12-16T01:25:54.976018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.577950+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:25:57.577950+0000","last_peered":"2023-12-16T01:25:57.577950+0000","last_clean":"2023-12-16T01:25:57.577950+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:25:57.577950+0000","last_undegraded":"2023-12-16T01:25:57.577950+0000","last_fullsized":"2023-12-16T01:25:57.577950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977537+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:25:54.977537+0000","last_peered":"2023-12-16T01:25:54.977537+0000","last_clean":"2023-12-16T01:25:54.977537+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:25:54.977537+0000","last_undegraded":"2023-12-16T01:25:54.977537+0000","last_fullsized":"2023-12-16T01:25:54.977537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976272+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:25:54.976272+0000","last_peered":"2023-12-16T01:25:54.976272+0000","last_clean":"2023-12-16T01:25:54.976272+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:25:54.976272+0000","last_undegraded":"2023-12-16T01:25:54.976272+0000","last_fullsized":"2023-12-16T01:25:54.976272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578559+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:25:57.578559+0000","last_peered":"2023-12-16T01:25:57.578559+0000","last_clean":"2023-12-16T01:25:57.578559+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:25:57.578559+0000","last_undegraded":"2023-12-16T01:25:57.578559+0000","last_fullsized":"2023-12-16T01:25:57.578559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982296+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:25:54.982296+0000","last_peered":"2023-12-16T01:25:54.982296+0000","last_clean":"2023-12-16T01:25:54.982296+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:25:54.982296+0000","last_undegraded":"2023-12-16T01:25:54.982296+0000","last_fullsized":"2023-12-16T01:25:54.982296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976753+0000","last_change":"2023-12-16T01:25:49.153869+0000","last_active":"2023-12-16T01:25:54.976753+0000","last_peered":"2023-12-16T01:25:54.976753+0000","last_clean":"2023-12-16T01:25:54.976753+0000","last_became_active":"2023-12-16T01:25:49.153613+0000","last_became_peered":"2023-12-16T01:25:49.153613+0000","last_unstale":"2023-12-16T01:25:54.976753+0000","last_undegraded":"2023-12-16T01:25:54.976753+0000","last_fullsized":"2023-12-16T01:25:54.976753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:05.868096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578151+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:25:57.578151+0000","last_peered":"2023-12-16T01:25:57.578151+0000","last_clean":"2023-12-16T01:25:57.578151+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:25:57.578151+0000","last_undegraded":"2023-12-16T01:25:57.578151+0000","last_fullsized":"2023-12-16T01:25:57.578151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980257+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:25:54.980257+0000","last_peered":"2023-12-16T01:25:54.980257+0000","last_clean":"2023-12-16T01:25:54.980257+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:25:54.980257+0000","last_undegraded":"2023-12-16T01:25:54.980257+0000","last_fullsized":"2023-12-16T01:25:54.980257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977097+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:25:54.977097+0000","last_peered":"2023-12-16T01:25:54.977097+0000","last_clean":"2023-12-16T01:25:54.977097+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:25:54.977097+0000","last_undegraded":"2023-12-16T01:25:54.977097+0000","last_fullsized":"2023-12-16T01:25:54.977097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026894+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:25:56.026894+0000","last_peered":"2023-12-16T01:25:56.026894+0000","last_clean":"2023-12-16T01:25:56.026894+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:25:56.026894+0000","last_undegraded":"2023-12-16T01:25:56.026894+0000","last_fullsized":"2023-12-16T01:25:56.026894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951884+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:25:54.951884+0000","last_peered":"2023-12-16T01:25:54.951884+0000","last_clean":"2023-12-16T01:25:54.951884+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:25:54.951884+0000","last_undegraded":"2023-12-16T01:25:54.951884+0000","last_fullsized":"2023-12-16T01:25:54.951884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970306+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:25:54.970306+0000","last_peered":"2023-12-16T01:25:54.970306+0000","last_clean":"2023-12-16T01:25:54.970306+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:25:54.970306+0000","last_undegraded":"2023-12-16T01:25:54.970306+0000","last_fullsized":"2023-12-16T01:25:54.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.351491+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:25:56.351491+0000","last_peered":"2023-12-16T01:25:56.351491+0000","last_clean":"2023-12-16T01:25:56.351491+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:25:56.351491+0000","last_undegraded":"2023-12-16T01:25:56.351491+0000","last_fullsized":"2023-12-16T01:25:56.351491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955406+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:25:54.955406+0000","last_peered":"2023-12-16T01:25:54.955406+0000","last_clean":"2023-12-16T01:25:54.955406+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:25:54.955406+0000","last_undegraded":"2023-12-16T01:25:54.955406+0000","last_fullsized":"2023-12-16T01:25:54.955406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956170+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:25:54.956170+0000","last_peered":"2023-12-16T01:25:54.956170+0000","last_clean":"2023-12-16T01:25:54.956170+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:25:54.956170+0000","last_undegraded":"2023-12-16T01:25:54.956170+0000","last_fullsized":"2023-12-16T01:25:54.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578850+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:25:57.578850+0000","last_peered":"2023-12-16T01:25:57.578850+0000","last_clean":"2023-12-16T01:25:57.578850+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:25:57.578850+0000","last_undegraded":"2023-12-16T01:25:57.578850+0000","last_fullsized":"2023-12-16T01:25:57.578850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977333+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:25:54.977333+0000","last_peered":"2023-12-16T01:25:54.977333+0000","last_clean":"2023-12-16T01:25:54.977333+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:25:54.977333+0000","last_undegraded":"2023-12-16T01:25:54.977333+0000","last_fullsized":"2023-12-16T01:25:54.977333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977386+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:25:54.977386+0000","last_peered":"2023-12-16T01:25:54.977386+0000","last_clean":"2023-12-16T01:25:54.977386+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:25:54.977386+0000","last_undegraded":"2023-12-16T01:25:54.977386+0000","last_fullsized":"2023-12-16T01:25:54.977386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578376+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:25:57.578376+0000","last_peered":"2023-12-16T01:25:57.578376+0000","last_clean":"2023-12-16T01:25:57.578376+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:25:57.578376+0000","last_undegraded":"2023-12-16T01:25:57.578376+0000","last_fullsized":"2023-12-16T01:25:57.578376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955709+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:25:54.955709+0000","last_peered":"2023-12-16T01:25:54.955709+0000","last_clean":"2023-12-16T01:25:54.955709+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:25:54.955709+0000","last_undegraded":"2023-12-16T01:25:54.955709+0000","last_fullsized":"2023-12-16T01:25:54.955709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977705+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:25:54.977705+0000","last_peered":"2023-12-16T01:25:54.977705+0000","last_clean":"2023-12-16T01:25:54.977705+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:25:54.977705+0000","last_undegraded":"2023-12-16T01:25:54.977705+0000","last_fullsized":"2023-12-16T01:25:54.977705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578057+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:25:57.578057+0000","last_peered":"2023-12-16T01:25:57.578057+0000","last_clean":"2023-12-16T01:25:57.578057+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:25:57.578057+0000","last_undegraded":"2023-12-16T01:25:57.578057+0000","last_fullsized":"2023-12-16T01:25:57.578057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955950+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:25:54.955950+0000","last_peered":"2023-12-16T01:25:54.955950+0000","last_clean":"2023-12-16T01:25:54.955950+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:25:54.955950+0000","last_undegraded":"2023-12-16T01:25:54.955950+0000","last_fullsized":"2023-12-16T01:25:54.955950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955800+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:25:54.955800+0000","last_peered":"2023-12-16T01:25:54.955800+0000","last_clean":"2023-12-16T01:25:54.955800+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:25:54.955800+0000","last_undegraded":"2023-12-16T01:25:54.955800+0000","last_fullsized":"2023-12-16T01:25:54.955800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.021931+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:25:56.021931+0000","last_peered":"2023-12-16T01:25:56.021931+0000","last_clean":"2023-12-16T01:25:56.021931+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:25:56.021931+0000","last_undegraded":"2023-12-16T01:25:56.021931+0000","last_fullsized":"2023-12-16T01:25:56.021931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970664+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:25:54.970664+0000","last_peered":"2023-12-16T01:25:54.970664+0000","last_clean":"2023-12-16T01:25:54.970664+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:25:54.970664+0000","last_undegraded":"2023-12-16T01:25:54.970664+0000","last_fullsized":"2023-12-16T01:25:54.970664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976974+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:25:54.976974+0000","last_peered":"2023-12-16T01:25:54.976974+0000","last_clean":"2023-12-16T01:25:54.976974+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:25:54.976974+0000","last_undegraded":"2023-12-16T01:25:54.976974+0000","last_fullsized":"2023-12-16T01:25:54.976974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579763+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:25:57.579763+0000","last_peered":"2023-12-16T01:25:57.579763+0000","last_clean":"2023-12-16T01:25:57.579763+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:25:57.579763+0000","last_undegraded":"2023-12-16T01:25:57.579763+0000","last_fullsized":"2023-12-16T01:25:57.579763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892101+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:25:54.892101+0000","last_peered":"2023-12-16T01:25:54.892101+0000","last_clean":"2023-12-16T01:25:54.892101+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:25:54.892101+0000","last_undegraded":"2023-12-16T01:25:54.892101+0000","last_fullsized":"2023-12-16T01:25:54.892101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975270+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:25:54.975270+0000","last_peered":"2023-12-16T01:25:54.975270+0000","last_clean":"2023-12-16T01:25:54.975270+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:25:54.975270+0000","last_undegraded":"2023-12-16T01:25:54.975270+0000","last_fullsized":"2023-12-16T01:25:54.975270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578675+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:25:57.578675+0000","last_peered":"2023-12-16T01:25:57.578675+0000","last_clean":"2023-12-16T01:25:57.578675+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:25:57.578675+0000","last_undegraded":"2023-12-16T01:25:57.578675+0000","last_fullsized":"2023-12-16T01:25:57.578675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980017+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:25:54.980017+0000","last_peered":"2023-12-16T01:25:54.980017+0000","last_clean":"2023-12-16T01:25:54.980017+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:25:54.980017+0000","last_undegraded":"2023-12-16T01:25:54.980017+0000","last_fullsized":"2023-12-16T01:25:54.980017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980559+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:25:54.980559+0000","last_peered":"2023-12-16T01:25:54.980559+0000","last_clean":"2023-12-16T01:25:54.980559+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:25:54.980559+0000","last_undegraded":"2023-12-16T01:25:54.980559+0000","last_fullsized":"2023-12-16T01:25:54.980559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579261+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:25:57.579261+0000","last_peered":"2023-12-16T01:25:57.579261+0000","last_clean":"2023-12-16T01:25:57.579261+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:25:57.579261+0000","last_undegraded":"2023-12-16T01:25:57.579261+0000","last_fullsized":"2023-12-16T01:25:57.579261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970408+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:25:54.970408+0000","last_peered":"2023-12-16T01:25:54.970408+0000","last_clean":"2023-12-16T01:25:54.970408+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:25:54.970408+0000","last_undegraded":"2023-12-16T01:25:54.970408+0000","last_fullsized":"2023-12-16T01:25:54.970408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951593+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:25:54.951593+0000","last_peered":"2023-12-16T01:25:54.951593+0000","last_clean":"2023-12-16T01:25:54.951593+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:25:54.951593+0000","last_undegraded":"2023-12-16T01:25:54.951593+0000","last_fullsized":"2023-12-16T01:25:54.951593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579088+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:25:57.579088+0000","last_peered":"2023-12-16T01:25:57.579088+0000","last_clean":"2023-12-16T01:25:57.579088+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:25:57.579088+0000","last_undegraded":"2023-12-16T01:25:57.579088+0000","last_fullsized":"2023-12-16T01:25:57.579088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.969719+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:25:54.969719+0000","last_peered":"2023-12-16T01:25:54.969719+0000","last_clean":"2023-12-16T01:25:54.969719+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:25:54.969719+0000","last_undegraded":"2023-12-16T01:25:54.969719+0000","last_fullsized":"2023-12-16T01:25:54.969719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979749+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:25:54.979749+0000","last_peered":"2023-12-16T01:25:54.979749+0000","last_clean":"2023-12-16T01:25:54.979749+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:25:54.979749+0000","last_undegraded":"2023-12-16T01:25:54.979749+0000","last_fullsized":"2023-12-16T01:25:54.979749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578972+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:25:57.578972+0000","last_peered":"2023-12-16T01:25:57.578972+0000","last_clean":"2023-12-16T01:25:57.578972+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:25:57.578972+0000","last_undegraded":"2023-12-16T01:25:57.578972+0000","last_fullsized":"2023-12-16T01:25:57.578972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956071+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:25:54.956071+0000","last_peered":"2023-12-16T01:25:54.956071+0000","last_clean":"2023-12-16T01:25:54.956071+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:25:54.956071+0000","last_undegraded":"2023-12-16T01:25:54.956071+0000","last_fullsized":"2023-12-16T01:25:54.956071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977169+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:25:54.977169+0000","last_peered":"2023-12-16T01:25:54.977169+0000","last_clean":"2023-12-16T01:25:54.977169+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:25:54.977169+0000","last_undegraded":"2023-12-16T01:25:54.977169+0000","last_fullsized":"2023-12-16T01:25:54.977169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972956+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:25:54.972956+0000","last_peered":"2023-12-16T01:25:54.972956+0000","last_clean":"2023-12-16T01:25:54.972956+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:25:54.972956+0000","last_undegraded":"2023-12-16T01:25:54.972956+0000","last_fullsized":"2023-12-16T01:25:54.972956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027129+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:25:56.027129+0000","last_peered":"2023-12-16T01:25:56.027129+0000","last_clean":"2023-12-16T01:25:56.027129+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:25:56.027129+0000","last_undegraded":"2023-12-16T01:25:56.027129+0000","last_fullsized":"2023-12-16T01:25:56.027129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976823+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:25:54.976823+0000","last_peered":"2023-12-16T01:25:54.976823+0000","last_clean":"2023-12-16T01:25:54.976823+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:25:54.976823+0000","last_undegraded":"2023-12-16T01:25:54.976823+0000","last_fullsized":"2023-12-16T01:25:54.976823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970729+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:25:54.970729+0000","last_peered":"2023-12-16T01:25:54.970729+0000","last_clean":"2023-12-16T01:25:54.970729+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:25:54.970729+0000","last_undegraded":"2023-12-16T01:25:54.970729+0000","last_fullsized":"2023-12-16T01:25:54.970729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578266+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:25:57.578266+0000","last_peered":"2023-12-16T01:25:57.578266+0000","last_clean":"2023-12-16T01:25:57.578266+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:25:57.578266+0000","last_undegraded":"2023-12-16T01:25:57.578266+0000","last_fullsized":"2023-12-16T01:25:57.578266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982032+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:25:54.982032+0000","last_peered":"2023-12-16T01:25:54.982032+0000","last_clean":"2023-12-16T01:25:54.982032+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:25:54.982032+0000","last_undegraded":"2023-12-16T01:25:54.982032+0000","last_fullsized":"2023-12-16T01:25:54.982032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975450+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:25:54.975450+0000","last_peered":"2023-12-16T01:25:54.975450+0000","last_clean":"2023-12-16T01:25:54.975450+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:25:54.975450+0000","last_undegraded":"2023-12-16T01:25:54.975450+0000","last_fullsized":"2023-12-16T01:25:54.975450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579099+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:25:57.579099+0000","last_peered":"2023-12-16T01:25:57.579099+0000","last_clean":"2023-12-16T01:25:57.579099+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:25:57.579099+0000","last_undegraded":"2023-12-16T01:25:57.579099+0000","last_fullsized":"2023-12-16T01:25:57.579099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978727+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:25:54.978727+0000","last_peered":"2023-12-16T01:25:54.978727+0000","last_clean":"2023-12-16T01:25:54.978727+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:25:54.978727+0000","last_undegraded":"2023-12-16T01:25:54.978727+0000","last_fullsized":"2023-12-16T01:25:54.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955761+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:25:54.955761+0000","last_peered":"2023-12-16T01:25:54.955761+0000","last_clean":"2023-12-16T01:25:54.955761+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:25:54.955761+0000","last_undegraded":"2023-12-16T01:25:54.955761+0000","last_fullsized":"2023-12-16T01:25:54.955761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026421+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:25:56.026421+0000","last_peered":"2023-12-16T01:25:56.026421+0000","last_clean":"2023-12-16T01:25:56.026421+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:25:56.026421+0000","last_undegraded":"2023-12-16T01:25:56.026421+0000","last_fullsized":"2023-12-16T01:25:56.026421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892557+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:25:54.892557+0000","last_peered":"2023-12-16T01:25:54.892557+0000","last_clean":"2023-12-16T01:25:54.892557+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:25:54.892557+0000","last_undegraded":"2023-12-16T01:25:54.892557+0000","last_fullsized":"2023-12-16T01:25:54.892557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978933+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:25:54.978933+0000","last_peered":"2023-12-16T01:25:54.978933+0000","last_clean":"2023-12-16T01:25:54.978933+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:25:54.978933+0000","last_undegraded":"2023-12-16T01:25:54.978933+0000","last_fullsized":"2023-12-16T01:25:54.978933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578693+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:25:57.578693+0000","last_peered":"2023-12-16T01:25:57.578693+0000","last_clean":"2023-12-16T01:25:57.578693+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:25:57.578693+0000","last_undegraded":"2023-12-16T01:25:57.578693+0000","last_fullsized":"2023-12-16T01:25:57.578693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977264+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:25:54.977264+0000","last_peered":"2023-12-16T01:25:54.977264+0000","last_clean":"2023-12-16T01:25:54.977264+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:25:54.977264+0000","last_undegraded":"2023-12-16T01:25:54.977264+0000","last_fullsized":"2023-12-16T01:25:54.977264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955494+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:25:54.955494+0000","last_peered":"2023-12-16T01:25:54.955494+0000","last_clean":"2023-12-16T01:25:54.955494+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:25:54.955494+0000","last_undegraded":"2023-12-16T01:25:54.955494+0000","last_fullsized":"2023-12-16T01:25:54.955494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579484+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:25:57.579484+0000","last_peered":"2023-12-16T01:25:57.579484+0000","last_clean":"2023-12-16T01:25:57.579484+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:25:57.579484+0000","last_undegraded":"2023-12-16T01:25:57.579484+0000","last_fullsized":"2023-12-16T01:25:57.579484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972813+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:25:54.972813+0000","last_peered":"2023-12-16T01:25:54.972813+0000","last_clean":"2023-12-16T01:25:54.972813+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:25:54.972813+0000","last_undegraded":"2023-12-16T01:25:54.972813+0000","last_fullsized":"2023-12-16T01:25:54.972813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978171+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:25:54.978171+0000","last_peered":"2023-12-16T01:25:54.978171+0000","last_clean":"2023-12-16T01:25:54.978171+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:25:54.978171+0000","last_undegraded":"2023-12-16T01:25:54.978171+0000","last_fullsized":"2023-12-16T01:25:54.978171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579434+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:25:57.579434+0000","last_peered":"2023-12-16T01:25:57.579434+0000","last_clean":"2023-12-16T01:25:57.579434+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:25:57.579434+0000","last_undegraded":"2023-12-16T01:25:57.579434+0000","last_fullsized":"2023-12-16T01:25:57.579434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977003+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:25:54.977003+0000","last_peered":"2023-12-16T01:25:54.977003+0000","last_clean":"2023-12-16T01:25:54.977003+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:25:54.977003+0000","last_undegraded":"2023-12-16T01:25:54.977003+0000","last_fullsized":"2023-12-16T01:25:54.977003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980482+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:25:54.980482+0000","last_peered":"2023-12-16T01:25:54.980482+0000","last_clean":"2023-12-16T01:25:54.980482+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:25:54.980482+0000","last_undegraded":"2023-12-16T01:25:54.980482+0000","last_fullsized":"2023-12-16T01:25:54.980482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579147+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:25:57.579147+0000","last_peered":"2023-12-16T01:25:57.579147+0000","last_clean":"2023-12-16T01:25:57.579147+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:25:57.579147+0000","last_undegraded":"2023-12-16T01:25:57.579147+0000","last_fullsized":"2023-12-16T01:25:57.579147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970220+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:25:54.970220+0000","last_peered":"2023-12-16T01:25:54.970220+0000","last_clean":"2023-12-16T01:25:54.970220+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:25:54.970220+0000","last_undegraded":"2023-12-16T01:25:54.970220+0000","last_fullsized":"2023-12-16T01:25:54.970220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951806+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:25:54.951806+0000","last_peered":"2023-12-16T01:25:54.951806+0000","last_clean":"2023-12-16T01:25:54.951806+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:25:54.951806+0000","last_undegraded":"2023-12-16T01:25:54.951806+0000","last_fullsized":"2023-12-16T01:25:54.951806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026955+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:25:56.026955+0000","last_peered":"2023-12-16T01:25:56.026955+0000","last_clean":"2023-12-16T01:25:56.026955+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:25:56.026955+0000","last_undegraded":"2023-12-16T01:25:56.026955+0000","last_fullsized":"2023-12-16T01:25:56.026955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977424+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:25:54.977424+0000","last_peered":"2023-12-16T01:25:54.977424+0000","last_clean":"2023-12-16T01:25:54.977424+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:25:54.977424+0000","last_undegraded":"2023-12-16T01:25:54.977424+0000","last_fullsized":"2023-12-16T01:25:54.977424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:26:11.837618+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:26:11.837618+0000","last_peered":"2023-12-16T01:26:11.837618+0000","last_clean":"2023-12-16T01:26:11.837618+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:26:11.837618+0000","last_undegraded":"2023-12-16T01:26:11.837618+0000","last_fullsized":"2023-12-16T01:26:11.837618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022069+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:25:56.022069+0000","last_peered":"2023-12-16T01:25:56.022069+0000","last_clean":"2023-12-16T01:25:56.022069+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:25:56.022069+0000","last_undegraded":"2023-12-16T01:25:56.022069+0000","last_fullsized":"2023-12-16T01:25:56.022069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976897+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:25:54.976897+0000","last_peered":"2023-12-16T01:25:54.976897+0000","last_clean":"2023-12-16T01:25:54.976897+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:25:54.976897+0000","last_undegraded":"2023-12-16T01:25:54.976897+0000","last_fullsized":"2023-12-16T01:25:54.976897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951776+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:25:54.951776+0000","last_peered":"2023-12-16T01:25:54.951776+0000","last_clean":"2023-12-16T01:25:54.951776+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:25:54.951776+0000","last_undegraded":"2023-12-16T01:25:54.951776+0000","last_fullsized":"2023-12-16T01:25:54.951776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578353+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:25:57.578353+0000","last_peered":"2023-12-16T01:25:57.578353+0000","last_clean":"2023-12-16T01:25:57.578353+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:25:57.578353+0000","last_undegraded":"2023-12-16T01:25:57.578353+0000","last_fullsized":"2023-12-16T01:25:57.578353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976082+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:25:54.976082+0000","last_peered":"2023-12-16T01:25:54.976082+0000","last_clean":"2023-12-16T01:25:54.976082+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:25:54.976082+0000","last_undegraded":"2023-12-16T01:25:54.976082+0000","last_fullsized":"2023-12-16T01:25:54.976082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976614+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:25:54.976614+0000","last_peered":"2023-12-16T01:25:54.976614+0000","last_clean":"2023-12-16T01:25:54.976614+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:25:54.976614+0000","last_undegraded":"2023-12-16T01:25:54.976614+0000","last_fullsized":"2023-12-16T01:25:54.976614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579450+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:25:57.579450+0000","last_peered":"2023-12-16T01:25:57.579450+0000","last_clean":"2023-12-16T01:25:57.579450+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:25:57.579450+0000","last_undegraded":"2023-12-16T01:25:57.579450+0000","last_fullsized":"2023-12-16T01:25:57.579450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892462+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:25:54.892462+0000","last_peered":"2023-12-16T01:25:54.892462+0000","last_clean":"2023-12-16T01:25:54.892462+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:25:54.892462+0000","last_undegraded":"2023-12-16T01:25:54.892462+0000","last_fullsized":"2023-12-16T01:25:54.892462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975435+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:25:54.975435+0000","last_peered":"2023-12-16T01:25:54.975435+0000","last_clean":"2023-12-16T01:25:54.975435+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:25:54.975435+0000","last_undegraded":"2023-12-16T01:25:54.975435+0000","last_fullsized":"2023-12-16T01:25:54.975435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022372+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:25:56.022372+0000","last_peered":"2023-12-16T01:25:56.022372+0000","last_clean":"2023-12-16T01:25:56.022372+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:25:56.022372+0000","last_undegraded":"2023-12-16T01:25:56.022372+0000","last_fullsized":"2023-12-16T01:25:56.022372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022142+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:25:56.022142+0000","last_peered":"2023-12-16T01:25:56.022142+0000","last_clean":"2023-12-16T01:25:56.022142+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:25:56.022142+0000","last_undegraded":"2023-12-16T01:25:56.022142+0000","last_fullsized":"2023-12-16T01:25:56.022142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956110+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:25:54.956110+0000","last_peered":"2023-12-16T01:25:54.956110+0000","last_clean":"2023-12-16T01:25:54.956110+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:25:54.956110+0000","last_undegraded":"2023-12-16T01:25:54.956110+0000","last_fullsized":"2023-12-16T01:25:54.956110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979677+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:25:54.979677+0000","last_peered":"2023-12-16T01:25:54.979677+0000","last_clean":"2023-12-16T01:25:54.979677+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:25:54.979677+0000","last_undegraded":"2023-12-16T01:25:54.979677+0000","last_fullsized":"2023-12-16T01:25:54.979677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027139+0000","last_change":"2023-12-16T01:25:54.987548+0000","last_active":"2023-12-16T01:25:56.027139+0000","last_peered":"2023-12-16T01:25:56.027139+0000","last_clean":"2023-12-16T01:25:56.027139+0000","last_became_active":"2023-12-16T01:25:54.986234+0000","last_became_peered":"2023-12-16T01:25:54.986234+0000","last_unstale":"2023-12-16T01:25:56.027139+0000","last_undegraded":"2023-12-16T01:25:56.027139+0000","last_fullsized":"2023-12-16T01:25:56.027139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:33:01.262692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972408+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:25:54.972408+0000","last_peered":"2023-12-16T01:25:54.972408+0000","last_clean":"2023-12-16T01:25:54.972408+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:25:54.972408+0000","last_undegraded":"2023-12-16T01:25:54.972408+0000","last_fullsized":"2023-12-16T01:25:54.972408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970035+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:25:54.970035+0000","last_peered":"2023-12-16T01:25:54.970035+0000","last_clean":"2023-12-16T01:25:54.970035+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:25:54.970035+0000","last_undegraded":"2023-12-16T01:25:54.970035+0000","last_fullsized":"2023-12-16T01:25:54.970035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980404+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:25:54.980404+0000","last_peered":"2023-12-16T01:25:54.980404+0000","last_clean":"2023-12-16T01:25:54.980404+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:25:54.980404+0000","last_undegraded":"2023-12-16T01:25:54.980404+0000","last_fullsized":"2023-12-16T01:25:54.980404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955624+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:25:54.955624+0000","last_peered":"2023-12-16T01:25:54.955624+0000","last_clean":"2023-12-16T01:25:54.955624+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:25:54.955624+0000","last_undegraded":"2023-12-16T01:25:54.955624+0000","last_fullsized":"2023-12-16T01:25:54.955624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022214+0000","last_change":"2023-12-16T01:25:54.978408+0000","last_active":"2023-12-16T01:25:56.022214+0000","last_peered":"2023-12-16T01:25:56.022214+0000","last_clean":"2023-12-16T01:25:56.022214+0000","last_became_active":"2023-12-16T01:25:54.978056+0000","last_became_peered":"2023-12-16T01:25:54.978056+0000","last_unstale":"2023-12-16T01:25:56.022214+0000","last_undegraded":"2023-12-16T01:25:56.022214+0000","last_fullsized":"2023-12-16T01:25:56.022214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:32.801898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975724+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:25:54.975724+0000","last_peered":"2023-12-16T01:25:54.975724+0000","last_clean":"2023-12-16T01:25:54.975724+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:25:54.975724+0000","last_undegraded":"2023-12-16T01:25:54.975724+0000","last_fullsized":"2023-12-16T01:25:54.975724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972490+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:25:54.972490+0000","last_peered":"2023-12-16T01:25:54.972490+0000","last_clean":"2023-12-16T01:25:54.972490+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:25:54.972490+0000","last_undegraded":"2023-12-16T01:25:54.972490+0000","last_fullsized":"2023-12-16T01:25:54.972490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578258+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:25:57.578258+0000","last_peered":"2023-12-16T01:25:57.578258+0000","last_clean":"2023-12-16T01:25:57.578258+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:25:57.578258+0000","last_undegraded":"2023-12-16T01:25:57.578258+0000","last_fullsized":"2023-12-16T01:25:57.578258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891580+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:25:54.891580+0000","last_peered":"2023-12-16T01:25:54.891580+0000","last_clean":"2023-12-16T01:25:54.891580+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:25:54.891580+0000","last_undegraded":"2023-12-16T01:25:54.891580+0000","last_fullsized":"2023-12-16T01:25:54.891580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951407+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:25:54.951407+0000","last_peered":"2023-12-16T01:25:54.951407+0000","last_clean":"2023-12-16T01:25:54.951407+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:25:54.951407+0000","last_undegraded":"2023-12-16T01:25:54.951407+0000","last_fullsized":"2023-12-16T01:25:54.951407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980175+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:25:54.980175+0000","last_peered":"2023-12-16T01:25:54.980175+0000","last_clean":"2023-12-16T01:25:54.980175+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:25:54.980175+0000","last_undegraded":"2023-12-16T01:25:54.980175+0000","last_fullsized":"2023-12-16T01:25:54.980175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975633+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:25:54.975633+0000","last_peered":"2023-12-16T01:25:54.975633+0000","last_clean":"2023-12-16T01:25:54.975633+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:25:54.975633+0000","last_undegraded":"2023-12-16T01:25:54.975633+0000","last_fullsized":"2023-12-16T01:25:54.975633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970596+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:25:54.970596+0000","last_peered":"2023-12-16T01:25:54.970596+0000","last_clean":"2023-12-16T01:25:54.970596+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:25:54.970596+0000","last_undegraded":"2023-12-16T01:25:54.970596+0000","last_fullsized":"2023-12-16T01:25:54.970596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970559+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:25:54.970559+0000","last_peered":"2023-12-16T01:25:54.970559+0000","last_clean":"2023-12-16T01:25:54.970559+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:25:54.970559+0000","last_undegraded":"2023-12-16T01:25:54.970559+0000","last_fullsized":"2023-12-16T01:25:54.970559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892380+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:25:54.892380+0000","last_peered":"2023-12-16T01:25:54.892380+0000","last_clean":"2023-12-16T01:25:54.892380+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:25:54.892380+0000","last_undegraded":"2023-12-16T01:25:54.892380+0000","last_fullsized":"2023-12-16T01:25:54.892380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975934+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:25:54.975934+0000","last_peered":"2023-12-16T01:25:54.975934+0000","last_clean":"2023-12-16T01:25:54.975934+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:25:54.975934+0000","last_undegraded":"2023-12-16T01:25:54.975934+0000","last_fullsized":"2023-12-16T01:25:54.975934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979591+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:25:54.979591+0000","last_peered":"2023-12-16T01:25:54.979591+0000","last_clean":"2023-12-16T01:25:54.979591+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:25:54.979591+0000","last_undegraded":"2023-12-16T01:25:54.979591+0000","last_fullsized":"2023-12-16T01:25:54.979591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972206+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:25:54.972206+0000","last_peered":"2023-12-16T01:25:54.972206+0000","last_clean":"2023-12-16T01:25:54.972206+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:25:54.972206+0000","last_undegraded":"2023-12-16T01:25:54.972206+0000","last_fullsized":"2023-12-16T01:25:54.972206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972426+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:25:54.972426+0000","last_peered":"2023-12-16T01:25:54.972426+0000","last_clean":"2023-12-16T01:25:54.972426+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:25:54.972426+0000","last_undegraded":"2023-12-16T01:25:54.972426+0000","last_fullsized":"2023-12-16T01:25:54.972426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955509+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:25:54.955509+0000","last_peered":"2023-12-16T01:25:54.955509+0000","last_clean":"2023-12-16T01:25:54.955509+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:25:54.955509+0000","last_undegraded":"2023-12-16T01:25:54.955509+0000","last_fullsized":"2023-12-16T01:25:54.955509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981955+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:25:54.981955+0000","last_peered":"2023-12-16T01:25:54.981955+0000","last_clean":"2023-12-16T01:25:54.981955+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:25:54.981955+0000","last_undegraded":"2023-12-16T01:25:54.981955+0000","last_fullsized":"2023-12-16T01:25:54.981955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976900+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:25:54.976900+0000","last_peered":"2023-12-16T01:25:54.976900+0000","last_clean":"2023-12-16T01:25:54.976900+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:25:54.976900+0000","last_undegraded":"2023-12-16T01:25:54.976900+0000","last_fullsized":"2023-12-16T01:25:54.976900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.952066+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:25:54.952066+0000","last_peered":"2023-12-16T01:25:54.952066+0000","last_clean":"2023-12-16T01:25:54.952066+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:25:54.952066+0000","last_undegraded":"2023-12-16T01:25:54.952066+0000","last_fullsized":"2023-12-16T01:25:54.952066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977633+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:25:54.977633+0000","last_peered":"2023-12-16T01:25:54.977633+0000","last_clean":"2023-12-16T01:25:54.977633+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:25:54.977633+0000","last_undegraded":"2023-12-16T01:25:54.977633+0000","last_fullsized":"2023-12-16T01:25:54.977633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979510+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:25:54.979510+0000","last_peered":"2023-12-16T01:25:54.979510+0000","last_clean":"2023-12-16T01:25:54.979510+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:25:54.979510+0000","last_undegraded":"2023-12-16T01:25:54.979510+0000","last_fullsized":"2023-12-16T01:25:54.979510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972127+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:25:54.972127+0000","last_peered":"2023-12-16T01:25:54.972127+0000","last_clean":"2023-12-16T01:25:54.972127+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:25:54.972127+0000","last_undegraded":"2023-12-16T01:25:54.972127+0000","last_fullsized":"2023-12-16T01:25:54.972127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970095+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:25:54.970095+0000","last_peered":"2023-12-16T01:25:54.970095+0000","last_clean":"2023-12-16T01:25:54.970095+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:25:54.970095+0000","last_undegraded":"2023-12-16T01:25:54.970095+0000","last_fullsized":"2023-12-16T01:25:54.970095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970463+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:25:54.970463+0000","last_peered":"2023-12-16T01:25:54.970463+0000","last_clean":"2023-12-16T01:25:54.970463+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:25:54.970463+0000","last_undegraded":"2023-12-16T01:25:54.970463+0000","last_fullsized":"2023-12-16T01:25:54.970463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981872+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:25:54.981872+0000","last_peered":"2023-12-16T01:25:54.981872+0000","last_clean":"2023-12-16T01:25:54.981872+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:25:54.981872+0000","last_undegraded":"2023-12-16T01:25:54.981872+0000","last_fullsized":"2023-12-16T01:25:54.981872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977430+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:25:54.977430+0000","last_peered":"2023-12-16T01:25:54.977430+0000","last_clean":"2023-12-16T01:25:54.977430+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:25:54.977430+0000","last_undegraded":"2023-12-16T01:25:54.977430+0000","last_fullsized":"2023-12-16T01:25:54.977430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976471+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:25:54.976471+0000","last_peered":"2023-12-16T01:25:54.976471+0000","last_clean":"2023-12-16T01:25:54.976471+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:25:54.976471+0000","last_undegraded":"2023-12-16T01:25:54.976471+0000","last_fullsized":"2023-12-16T01:25:54.976471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975246+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:25:54.975246+0000","last_peered":"2023-12-16T01:25:54.975246+0000","last_clean":"2023-12-16T01:25:54.975246+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:25:54.975246+0000","last_undegraded":"2023-12-16T01:25:54.975246+0000","last_fullsized":"2023-12-16T01:25:54.975246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970321+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:25:54.970321+0000","last_peered":"2023-12-16T01:25:54.970321+0000","last_clean":"2023-12-16T01:25:54.970321+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:25:54.970321+0000","last_undegraded":"2023-12-16T01:25:54.970321+0000","last_fullsized":"2023-12-16T01:25:54.970321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978094+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:25:54.978094+0000","last_peered":"2023-12-16T01:25:54.978094+0000","last_clean":"2023-12-16T01:25:54.978094+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:25:54.978094+0000","last_undegraded":"2023-12-16T01:25:54.978094+0000","last_fullsized":"2023-12-16T01:25:54.978094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892077+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:25:54.892077+0000","last_peered":"2023-12-16T01:25:54.892077+0000","last_clean":"2023-12-16T01:25:54.892077+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:25:54.892077+0000","last_undegraded":"2023-12-16T01:25:54.892077+0000","last_fullsized":"2023-12-16T01:25:54.892077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980139+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:25:54.980139+0000","last_peered":"2023-12-16T01:25:54.980139+0000","last_clean":"2023-12-16T01:25:54.980139+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:25:54.980139+0000","last_undegraded":"2023-12-16T01:25:54.980139+0000","last_fullsized":"2023-12-16T01:25:54.980139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891999+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:25:54.891999+0000","last_peered":"2023-12-16T01:25:54.891999+0000","last_clean":"2023-12-16T01:25:54.891999+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:25:54.891999+0000","last_undegraded":"2023-12-16T01:25:54.891999+0000","last_fullsized":"2023-12-16T01:25:54.891999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975363+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:25:54.975363+0000","last_peered":"2023-12-16T01:25:54.975363+0000","last_clean":"2023-12-16T01:25:54.975363+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:25:54.975363+0000","last_undegraded":"2023-12-16T01:25:54.975363+0000","last_fullsized":"2023-12-16T01:25:54.975363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975981+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:25:54.975981+0000","last_peered":"2023-12-16T01:25:54.975981+0000","last_clean":"2023-12-16T01:25:54.975981+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:25:54.975981+0000","last_undegraded":"2023-12-16T01:25:54.975981+0000","last_fullsized":"2023-12-16T01:25:54.975981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978584+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:25:54.978584+0000","last_peered":"2023-12-16T01:25:54.978584+0000","last_clean":"2023-12-16T01:25:54.978584+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:25:54.978584+0000","last_undegraded":"2023-12-16T01:25:54.978584+0000","last_fullsized":"2023-12-16T01:25:54.978584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.718}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":698014,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":112066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":697992,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:26:27.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:26:27.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.869+0000 7f9fe6753640 1 Processor -- start 2023-12-16T01:26:27.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.869+0000 7f9fe6753640 1 -- start start 2023-12-16T01:26:27.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.870+0000 7f9fe6753640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9fe01538f0 0x7f9fe00c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.870+0000 7f9fe6753640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe01596e0 con 0x7f9fe00c7b90 2023-12-16T01:26:27.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.870+0000 7f9fe6753640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00ca630 con 0x7f9fe0159b70 2023-12-16T01:26:27.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.870+0000 7f9fe6753640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe00c2f40 con 0x7f9fe01538f0 2023-12-16T01:26:27.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.870+0000 7f9fe4cf0640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9fe0159b70 0x7f9fe0159fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:35052/0 (socket says 172.21.15.107:35052) 2023-12-16T01:26:27.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.870+0000 7f9fe4cf0640 1 -- 172.21.15.107:0/998138463 learned_addr learned my addr 172.21.15.107:0/998138463 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:27.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.871+0000 7f9fdffff640 1 --2- 172.21.15.107:0/998138463 >> v2:172.21.15.107:3300/0 conn(0x7f9fe01538f0 0x7f9fe00c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.873+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640646384 0 0) 0x7f9fe00ca630 con 0x7f9fe0159b70 2023-12-16T01:26:27.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.873+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc8003520 con 0x7f9fe0159b70 2023-12-16T01:26:27.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.874+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488279631 0 0) 0x7f9fe01596e0 con 0x7f9fe00c7b90 2023-12-16T01:26:27.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.874+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe00ca630 con 0x7f9fe00c7b90 2023-12-16T01:26:27.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870010444 0 0) 0x7f9fc8003520 con 0x7f9fe0159b70 2023-12-16T01:26:27.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 >> v2:172.21.15.107:3300/0 conn(0x7f9fe01538f0 msgr2=0x7f9fe00c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:27.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 --2- 172.21.15.107:0/998138463 >> v2:172.21.15.107:3300/0 conn(0x7f9fe01538f0 0x7f9fe00c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 >> v1:172.21.15.107:6789/0 conn(0x7f9fe00c7b90 legacy=0x7f9fe006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00c3220 con 0x7f9fe0159b70 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7f9fd80019f0 con 0x7f9fe0159b70 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 >> v1:172.21.15.157:6789/0 conn(0x7f9fe0159b70 legacy=0x7f9fe0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc8003b50 0x7f9fc8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fc80047c0 0x7f9fc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fc800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00c2f40 con 0x7f9fc80047c0 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc800c100 con 0x7f9fc8003b50 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.876+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc800c2c0 con 0x7f9fc80051d0 2023-12-16T01:26:27.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.877+0000 7f9fe4cf0640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fc800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.879+0000 7f9fdffff640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc8003b50 0x7f9fc8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.879+0000 7f9fe4cf0640 1 -- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc8003b50 msgr2=0x7f9fc8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:27.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.879+0000 7f9fe4cf0640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc8003b50 0x7f9fc8003f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.879+0000 7f9fe4cf0640 1 -- 172.21.15.107:0/998138463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fc80047c0 msgr2=0x7f9fc8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:27.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.879+0000 7f9fe4cf0640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fc80047c0 0x7f9fc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.879+0000 7f9fe4cf0640 1 -- 172.21.15.107:0/998138463 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8003520 con 0x7f9fc80051d0 2023-12-16T01:26:27.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.880+0000 7f9fe4cf0640 1 -- 172.21.15.107:0/998138463 reap_dead start 2023-12-16T01:26:27.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.881+0000 7f9fe4cf0640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fc800b980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800a710 tx=0x7f9fc80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7517fffe20f0b9c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:27.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8034630 con 0x7f9fc80051d0 2023-12-16T01:26:27.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd802f070 con 0x7f9fc80051d0 2023-12-16T01:26:27.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fdeffd640 1 -- 172.21.15.107:0/998138463 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8034a10 con 0x7f9fc80051d0 2023-12-16T01:26:27.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 -- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 msgr2=0x7f9fc800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fc800b980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800a710 tx=0x7f9fc80057f0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 -- 172.21.15.107:0/998138463 shutdown_connections 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 --2- 172.21.15.107:0/998138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fc800b980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 -- 172.21.15.107:0/998138463 >> 172.21.15.107:0/998138463 conn(0x7f9fe0060f20 msgr2=0x7f9fe0061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 -- 172.21.15.107:0/998138463 shutdown_connections 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.885+0000 7f9fe6753640 1 -- 172.21.15.107:0/998138463 wait complete. 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 Processor -- start 2023-12-16T01:26:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 -- start start 2023-12-16T01:26:27.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fe01f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 0x7f9fe014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fe014f3f0 0x7f9fe0145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:27.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0155de0 con 0x7f9fe014f3f0 2023-12-16T01:26:27.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe01543b0 con 0x7f9fe0153f30 2023-12-16T01:26:27.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.887+0000 7f9fe6753640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0156170 con 0x7f9fc80051d0 2023-12-16T01:26:27.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.888+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fe01f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.888+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 0x7f9fe014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.888+0000 7f9fe4cf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fe014f3f0 0x7f9fe0145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:27.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.888+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 0x7f9fe014d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47834/0 (socket says 172.21.15.107:47834) 2023-12-16T01:26:27.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.888+0000 7f9fdf7fe640 1 -- 172.21.15.107:0/375304841 learned_addr learned my addr 172.21.15.107:0/375304841 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.891+0000 7f9fdf7fe640 1 -- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 msgr2=0x7f9fe01f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.891+0000 7f9fdf7fe640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fe01f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.891+0000 7f9fdf7fe640 1 -- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fe014f3f0 msgr2=0x7f9fe0145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:27.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.891+0000 7f9fdf7fe640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fe014f3f0 0x7f9fe0145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:27.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.891+0000 7f9fdf7fe640 1 -- 172.21.15.107:0/375304841 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0158830 con 0x7f9fe0153f30 2023-12-16T01:26:27.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.891+0000 7f9fe4cf0640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fe014f3f0 0x7f9fe0145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:27.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.894+0000 7f9fdf7fe640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 0x7f9fe014d370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c4f0 tx=0x7f9fd400c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:27.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.896+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40052d0 con 0x7f9fe0153f30 2023-12-16T01:26:27.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.896+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe014d8b0 con 0x7f9fe0153f30 2023-12-16T01:26:27.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.896+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe01f23b0 con 0x7f9fe0153f30 2023-12-16T01:26:27.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.897+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe0151280 con 0x7f9fe0153f30 2023-12-16T01:26:27.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.897+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd4005430 con 0x7f9fe0153f30 2023-12-16T01:26:27.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:27.897+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4012830 con 0x7f9fe0153f30 2023-12-16T01:26:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.147+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f9fd4012990 con 0x7f9fe0153f30 2023-12-16T01:26:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.147+0000 7f9fdcff9640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9fcc06ae70 0x7f9fcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.147+0000 7f9fdffff640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9fcc06ae70 0x7f9fcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.148+0000 7f9fdffff640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9fcc06ae70 0x7f9fcc06d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009ac0 tx=0x7f9fd0008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:28.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.150+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fd4058950 con 0x7f9fe0153f30 2023-12-16T01:26:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.172+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f9fd4054c90 con 0x7f9fe0153f30 2023-12-16T01:26:28.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.354+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fe00c3ac0 con 0x7f9fcc06ae70 2023-12-16T01:26:28.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.362+0000 7f9fdcff9640 1 -- 172.21.15.107:0/375304841 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345321 (secure 0 0 0) 0x7f9fd0013a00 con 0x7f9fcc06ae70 2023-12-16T01:26:28.366 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:28.368 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:26:28.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9fcc06ae70 msgr2=0x7f9fcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9fcc06ae70 0x7f9fcc06d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009ac0 tx=0x7f9fd0008040 comp rx=0 tx=0).stop 2023-12-16T01:26:28.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 msgr2=0x7f9fe014d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 0x7f9fe014d370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c4f0 tx=0x7f9fd400c9b0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 shutdown_connections 2023-12-16T01:26:28.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fe014f3f0 0x7f9fe0145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9fcc06ae70 0x7f9fcc06d330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe0153f30 0x7f9fe014d370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 --2- 172.21.15.107:0/375304841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9fc80051d0 0x7f9fe01f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 >> 172.21.15.107:0/375304841 conn(0x7f9fe0060f20 msgr2=0x7f9fe006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:28.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 shutdown_connections 2023-12-16T01:26:28.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.365+0000 7f9fe6753640 1 -- 172.21.15.107:0/375304841 wait complete. 2023-12-16T01:26:28.377 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-12-16T01:26:27.720838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235144,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739576,"statfs":{"total":773094113280,"available":772853325824,"internally_reserved":0,"allocated":2392064,"data_stored":2050444,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003213"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956050+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:25:54.956050+0000","last_peered":"2023-12-16T01:25:54.956050+0000","last_clean":"2023-12-16T01:25:54.956050+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:25:54.956050+0000","last_undegraded":"2023-12-16T01:25:54.956050+0000","last_fullsized":"2023-12-16T01:25:54.956050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976062+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:25:54.976062+0000","last_peered":"2023-12-16T01:25:54.976062+0000","last_clean":"2023-12-16T01:25:54.976062+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:25:54.976062+0000","last_undegraded":"2023-12-16T01:25:54.976062+0000","last_fullsized":"2023-12-16T01:25:54.976062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579762+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:25:57.579762+0000","last_peered":"2023-12-16T01:25:57.579762+0000","last_clean":"2023-12-16T01:25:57.579762+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:25:57.579762+0000","last_undegraded":"2023-12-16T01:25:57.579762+0000","last_fullsized":"2023-12-16T01:25:57.579762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976137+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:25:54.976137+0000","last_peered":"2023-12-16T01:25:54.976137+0000","last_clean":"2023-12-16T01:25:54.976137+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:25:54.976137+0000","last_undegraded":"2023-12-16T01:25:54.976137+0000","last_fullsized":"2023-12-16T01:25:54.976137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976018+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:25:54.976018+0000","last_peered":"2023-12-16T01:25:54.976018+0000","last_clean":"2023-12-16T01:25:54.976018+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:25:54.976018+0000","last_undegraded":"2023-12-16T01:25:54.976018+0000","last_fullsized":"2023-12-16T01:25:54.976018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.577950+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:25:57.577950+0000","last_peered":"2023-12-16T01:25:57.577950+0000","last_clean":"2023-12-16T01:25:57.577950+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:25:57.577950+0000","last_undegraded":"2023-12-16T01:25:57.577950+0000","last_fullsized":"2023-12-16T01:25:57.577950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977537+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:25:54.977537+0000","last_peered":"2023-12-16T01:25:54.977537+0000","last_clean":"2023-12-16T01:25:54.977537+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:25:54.977537+0000","last_undegraded":"2023-12-16T01:25:54.977537+0000","last_fullsized":"2023-12-16T01:25:54.977537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976272+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:25:54.976272+0000","last_peered":"2023-12-16T01:25:54.976272+0000","last_clean":"2023-12-16T01:25:54.976272+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:25:54.976272+0000","last_undegraded":"2023-12-16T01:25:54.976272+0000","last_fullsized":"2023-12-16T01:25:54.976272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578559+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:25:57.578559+0000","last_peered":"2023-12-16T01:25:57.578559+0000","last_clean":"2023-12-16T01:25:57.578559+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:25:57.578559+0000","last_undegraded":"2023-12-16T01:25:57.578559+0000","last_fullsized":"2023-12-16T01:25:57.578559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982296+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:25:54.982296+0000","last_peered":"2023-12-16T01:25:54.982296+0000","last_clean":"2023-12-16T01:25:54.982296+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:25:54.982296+0000","last_undegraded":"2023-12-16T01:25:54.982296+0000","last_fullsized":"2023-12-16T01:25:54.982296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976753+0000","last_change":"2023-12-16T01:25:49.153869+0000","last_active":"2023-12-16T01:25:54.976753+0000","last_peered":"2023-12-16T01:25:54.976753+0000","last_clean":"2023-12-16T01:25:54.976753+0000","last_became_active":"2023-12-16T01:25:49.153613+0000","last_became_peered":"2023-12-16T01:25:49.153613+0000","last_unstale":"2023-12-16T01:25:54.976753+0000","last_undegraded":"2023-12-16T01:25:54.976753+0000","last_fullsized":"2023-12-16T01:25:54.976753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:05.868096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578151+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:25:57.578151+0000","last_peered":"2023-12-16T01:25:57.578151+0000","last_clean":"2023-12-16T01:25:57.578151+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:25:57.578151+0000","last_undegraded":"2023-12-16T01:25:57.578151+0000","last_fullsized":"2023-12-16T01:25:57.578151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980257+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:25:54.980257+0000","last_peered":"2023-12-16T01:25:54.980257+0000","last_clean":"2023-12-16T01:25:54.980257+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:25:54.980257+0000","last_undegraded":"2023-12-16T01:25:54.980257+0000","last_fullsized":"2023-12-16T01:25:54.980257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977097+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:25:54.977097+0000","last_peered":"2023-12-16T01:25:54.977097+0000","last_clean":"2023-12-16T01:25:54.977097+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:25:54.977097+0000","last_undegraded":"2023-12-16T01:25:54.977097+0000","last_fullsized":"2023-12-16T01:25:54.977097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026894+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:25:56.026894+0000","last_peered":"2023-12-16T01:25:56.026894+0000","last_clean":"2023-12-16T01:25:56.026894+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:25:56.026894+0000","last_undegraded":"2023-12-16T01:25:56.026894+0000","last_fullsized":"2023-12-16T01:25:56.026894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951884+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:25:54.951884+0000","last_peered":"2023-12-16T01:25:54.951884+0000","last_clean":"2023-12-16T01:25:54.951884+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:25:54.951884+0000","last_undegraded":"2023-12-16T01:25:54.951884+0000","last_fullsized":"2023-12-16T01:25:54.951884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970306+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:25:54.970306+0000","last_peered":"2023-12-16T01:25:54.970306+0000","last_clean":"2023-12-16T01:25:54.970306+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:25:54.970306+0000","last_undegraded":"2023-12-16T01:25:54.970306+0000","last_fullsized":"2023-12-16T01:25:54.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.351491+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:25:56.351491+0000","last_peered":"2023-12-16T01:25:56.351491+0000","last_clean":"2023-12-16T01:25:56.351491+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:25:56.351491+0000","last_undegraded":"2023-12-16T01:25:56.351491+0000","last_fullsized":"2023-12-16T01:25:56.351491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955406+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:25:54.955406+0000","last_peered":"2023-12-16T01:25:54.955406+0000","last_clean":"2023-12-16T01:25:54.955406+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:25:54.955406+0000","last_undegraded":"2023-12-16T01:25:54.955406+0000","last_fullsized":"2023-12-16T01:25:54.955406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956170+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:25:54.956170+0000","last_peered":"2023-12-16T01:25:54.956170+0000","last_clean":"2023-12-16T01:25:54.956170+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:25:54.956170+0000","last_undegraded":"2023-12-16T01:25:54.956170+0000","last_fullsized":"2023-12-16T01:25:54.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578850+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:25:57.578850+0000","last_peered":"2023-12-16T01:25:57.578850+0000","last_clean":"2023-12-16T01:25:57.578850+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:25:57.578850+0000","last_undegraded":"2023-12-16T01:25:57.578850+0000","last_fullsized":"2023-12-16T01:25:57.578850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977333+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:25:54.977333+0000","last_peered":"2023-12-16T01:25:54.977333+0000","last_clean":"2023-12-16T01:25:54.977333+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:25:54.977333+0000","last_undegraded":"2023-12-16T01:25:54.977333+0000","last_fullsized":"2023-12-16T01:25:54.977333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977386+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:25:54.977386+0000","last_peered":"2023-12-16T01:25:54.977386+0000","last_clean":"2023-12-16T01:25:54.977386+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:25:54.977386+0000","last_undegraded":"2023-12-16T01:25:54.977386+0000","last_fullsized":"2023-12-16T01:25:54.977386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578376+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:25:57.578376+0000","last_peered":"2023-12-16T01:25:57.578376+0000","last_clean":"2023-12-16T01:25:57.578376+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:25:57.578376+0000","last_undegraded":"2023-12-16T01:25:57.578376+0000","last_fullsized":"2023-12-16T01:25:57.578376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955709+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:25:54.955709+0000","last_peered":"2023-12-16T01:25:54.955709+0000","last_clean":"2023-12-16T01:25:54.955709+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:25:54.955709+0000","last_undegraded":"2023-12-16T01:25:54.955709+0000","last_fullsized":"2023-12-16T01:25:54.955709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977705+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:25:54.977705+0000","last_peered":"2023-12-16T01:25:54.977705+0000","last_clean":"2023-12-16T01:25:54.977705+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:25:54.977705+0000","last_undegraded":"2023-12-16T01:25:54.977705+0000","last_fullsized":"2023-12-16T01:25:54.977705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578057+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:25:57.578057+0000","last_peered":"2023-12-16T01:25:57.578057+0000","last_clean":"2023-12-16T01:25:57.578057+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:25:57.578057+0000","last_undegraded":"2023-12-16T01:25:57.578057+0000","last_fullsized":"2023-12-16T01:25:57.578057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955950+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:25:54.955950+0000","last_peered":"2023-12-16T01:25:54.955950+0000","last_clean":"2023-12-16T01:25:54.955950+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:25:54.955950+0000","last_undegraded":"2023-12-16T01:25:54.955950+0000","last_fullsized":"2023-12-16T01:25:54.955950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955800+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:25:54.955800+0000","last_peered":"2023-12-16T01:25:54.955800+0000","last_clean":"2023-12-16T01:25:54.955800+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:25:54.955800+0000","last_undegraded":"2023-12-16T01:25:54.955800+0000","last_fullsized":"2023-12-16T01:25:54.955800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.021931+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:25:56.021931+0000","last_peered":"2023-12-16T01:25:56.021931+0000","last_clean":"2023-12-16T01:25:56.021931+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:25:56.021931+0000","last_undegraded":"2023-12-16T01:25:56.021931+0000","last_fullsized":"2023-12-16T01:25:56.021931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970664+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:25:54.970664+0000","last_peered":"2023-12-16T01:25:54.970664+0000","last_clean":"2023-12-16T01:25:54.970664+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:25:54.970664+0000","last_undegraded":"2023-12-16T01:25:54.970664+0000","last_fullsized":"2023-12-16T01:25:54.970664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976974+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:25:54.976974+0000","last_peered":"2023-12-16T01:25:54.976974+0000","last_clean":"2023-12-16T01:25:54.976974+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:25:54.976974+0000","last_undegraded":"2023-12-16T01:25:54.976974+0000","last_fullsized":"2023-12-16T01:25:54.976974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579763+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:25:57.579763+0000","last_peered":"2023-12-16T01:25:57.579763+0000","last_clean":"2023-12-16T01:25:57.579763+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:25:57.579763+0000","last_undegraded":"2023-12-16T01:25:57.579763+0000","last_fullsized":"2023-12-16T01:25:57.579763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892101+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:25:54.892101+0000","last_peered":"2023-12-16T01:25:54.892101+0000","last_clean":"2023-12-16T01:25:54.892101+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:25:54.892101+0000","last_undegraded":"2023-12-16T01:25:54.892101+0000","last_fullsized":"2023-12-16T01:25:54.892101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975270+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:25:54.975270+0000","last_peered":"2023-12-16T01:25:54.975270+0000","last_clean":"2023-12-16T01:25:54.975270+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:25:54.975270+0000","last_undegraded":"2023-12-16T01:25:54.975270+0000","last_fullsized":"2023-12-16T01:25:54.975270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578675+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:25:57.578675+0000","last_peered":"2023-12-16T01:25:57.578675+0000","last_clean":"2023-12-16T01:25:57.578675+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:25:57.578675+0000","last_undegraded":"2023-12-16T01:25:57.578675+0000","last_fullsized":"2023-12-16T01:25:57.578675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980017+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:25:54.980017+0000","last_peered":"2023-12-16T01:25:54.980017+0000","last_clean":"2023-12-16T01:25:54.980017+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:25:54.980017+0000","last_undegraded":"2023-12-16T01:25:54.980017+0000","last_fullsized":"2023-12-16T01:25:54.980017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980559+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:25:54.980559+0000","last_peered":"2023-12-16T01:25:54.980559+0000","last_clean":"2023-12-16T01:25:54.980559+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:25:54.980559+0000","last_undegraded":"2023-12-16T01:25:54.980559+0000","last_fullsized":"2023-12-16T01:25:54.980559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579261+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:25:57.579261+0000","last_peered":"2023-12-16T01:25:57.579261+0000","last_clean":"2023-12-16T01:25:57.579261+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:25:57.579261+0000","last_undegraded":"2023-12-16T01:25:57.579261+0000","last_fullsized":"2023-12-16T01:25:57.579261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970408+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:25:54.970408+0000","last_peered":"2023-12-16T01:25:54.970408+0000","last_clean":"2023-12-16T01:25:54.970408+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:25:54.970408+0000","last_undegraded":"2023-12-16T01:25:54.970408+0000","last_fullsized":"2023-12-16T01:25:54.970408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951593+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:25:54.951593+0000","last_peered":"2023-12-16T01:25:54.951593+0000","last_clean":"2023-12-16T01:25:54.951593+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:25:54.951593+0000","last_undegraded":"2023-12-16T01:25:54.951593+0000","last_fullsized":"2023-12-16T01:25:54.951593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579088+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:25:57.579088+0000","last_peered":"2023-12-16T01:25:57.579088+0000","last_clean":"2023-12-16T01:25:57.579088+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:25:57.579088+0000","last_undegraded":"2023-12-16T01:25:57.579088+0000","last_fullsized":"2023-12-16T01:25:57.579088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.969719+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:25:54.969719+0000","last_peered":"2023-12-16T01:25:54.969719+0000","last_clean":"2023-12-16T01:25:54.969719+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:25:54.969719+0000","last_undegraded":"2023-12-16T01:25:54.969719+0000","last_fullsized":"2023-12-16T01:25:54.969719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979749+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:25:54.979749+0000","last_peered":"2023-12-16T01:25:54.979749+0000","last_clean":"2023-12-16T01:25:54.979749+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:25:54.979749+0000","last_undegraded":"2023-12-16T01:25:54.979749+0000","last_fullsized":"2023-12-16T01:25:54.979749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578972+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:25:57.578972+0000","last_peered":"2023-12-16T01:25:57.578972+0000","last_clean":"2023-12-16T01:25:57.578972+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:25:57.578972+0000","last_undegraded":"2023-12-16T01:25:57.578972+0000","last_fullsized":"2023-12-16T01:25:57.578972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956071+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:25:54.956071+0000","last_peered":"2023-12-16T01:25:54.956071+0000","last_clean":"2023-12-16T01:25:54.956071+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:25:54.956071+0000","last_undegraded":"2023-12-16T01:25:54.956071+0000","last_fullsized":"2023-12-16T01:25:54.956071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977169+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:25:54.977169+0000","last_peered":"2023-12-16T01:25:54.977169+0000","last_clean":"2023-12-16T01:25:54.977169+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:25:54.977169+0000","last_undegraded":"2023-12-16T01:25:54.977169+0000","last_fullsized":"2023-12-16T01:25:54.977169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972956+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:25:54.972956+0000","last_peered":"2023-12-16T01:25:54.972956+0000","last_clean":"2023-12-16T01:25:54.972956+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:25:54.972956+0000","last_undegraded":"2023-12-16T01:25:54.972956+0000","last_fullsized":"2023-12-16T01:25:54.972956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027129+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:25:56.027129+0000","last_peered":"2023-12-16T01:25:56.027129+0000","last_clean":"2023-12-16T01:25:56.027129+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:25:56.027129+0000","last_undegraded":"2023-12-16T01:25:56.027129+0000","last_fullsized":"2023-12-16T01:25:56.027129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976823+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:25:54.976823+0000","last_peered":"2023-12-16T01:25:54.976823+0000","last_clean":"2023-12-16T01:25:54.976823+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:25:54.976823+0000","last_undegraded":"2023-12-16T01:25:54.976823+0000","last_fullsized":"2023-12-16T01:25:54.976823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970729+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:25:54.970729+0000","last_peered":"2023-12-16T01:25:54.970729+0000","last_clean":"2023-12-16T01:25:54.970729+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:25:54.970729+0000","last_undegraded":"2023-12-16T01:25:54.970729+0000","last_fullsized":"2023-12-16T01:25:54.970729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578266+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:25:57.578266+0000","last_peered":"2023-12-16T01:25:57.578266+0000","last_clean":"2023-12-16T01:25:57.578266+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:25:57.578266+0000","last_undegraded":"2023-12-16T01:25:57.578266+0000","last_fullsized":"2023-12-16T01:25:57.578266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.982032+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:25:54.982032+0000","last_peered":"2023-12-16T01:25:54.982032+0000","last_clean":"2023-12-16T01:25:54.982032+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:25:54.982032+0000","last_undegraded":"2023-12-16T01:25:54.982032+0000","last_fullsized":"2023-12-16T01:25:54.982032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975450+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:25:54.975450+0000","last_peered":"2023-12-16T01:25:54.975450+0000","last_clean":"2023-12-16T01:25:54.975450+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:25:54.975450+0000","last_undegraded":"2023-12-16T01:25:54.975450+0000","last_fullsized":"2023-12-16T01:25:54.975450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579099+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:25:57.579099+0000","last_peered":"2023-12-16T01:25:57.579099+0000","last_clean":"2023-12-16T01:25:57.579099+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:25:57.579099+0000","last_undegraded":"2023-12-16T01:25:57.579099+0000","last_fullsized":"2023-12-16T01:25:57.579099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978727+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:25:54.978727+0000","last_peered":"2023-12-16T01:25:54.978727+0000","last_clean":"2023-12-16T01:25:54.978727+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:25:54.978727+0000","last_undegraded":"2023-12-16T01:25:54.978727+0000","last_fullsized":"2023-12-16T01:25:54.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955761+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:25:54.955761+0000","last_peered":"2023-12-16T01:25:54.955761+0000","last_clean":"2023-12-16T01:25:54.955761+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:25:54.955761+0000","last_undegraded":"2023-12-16T01:25:54.955761+0000","last_fullsized":"2023-12-16T01:25:54.955761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026421+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:25:56.026421+0000","last_peered":"2023-12-16T01:25:56.026421+0000","last_clean":"2023-12-16T01:25:56.026421+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:25:56.026421+0000","last_undegraded":"2023-12-16T01:25:56.026421+0000","last_fullsized":"2023-12-16T01:25:56.026421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892557+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:25:54.892557+0000","last_peered":"2023-12-16T01:25:54.892557+0000","last_clean":"2023-12-16T01:25:54.892557+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:25:54.892557+0000","last_undegraded":"2023-12-16T01:25:54.892557+0000","last_fullsized":"2023-12-16T01:25:54.892557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978933+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:25:54.978933+0000","last_peered":"2023-12-16T01:25:54.978933+0000","last_clean":"2023-12-16T01:25:54.978933+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:25:54.978933+0000","last_undegraded":"2023-12-16T01:25:54.978933+0000","last_fullsized":"2023-12-16T01:25:54.978933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578693+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:25:57.578693+0000","last_peered":"2023-12-16T01:25:57.578693+0000","last_clean":"2023-12-16T01:25:57.578693+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:25:57.578693+0000","last_undegraded":"2023-12-16T01:25:57.578693+0000","last_fullsized":"2023-12-16T01:25:57.578693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977264+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:25:54.977264+0000","last_peered":"2023-12-16T01:25:54.977264+0000","last_clean":"2023-12-16T01:25:54.977264+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:25:54.977264+0000","last_undegraded":"2023-12-16T01:25:54.977264+0000","last_fullsized":"2023-12-16T01:25:54.977264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955494+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:25:54.955494+0000","last_peered":"2023-12-16T01:25:54.955494+0000","last_clean":"2023-12-16T01:25:54.955494+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:25:54.955494+0000","last_undegraded":"2023-12-16T01:25:54.955494+0000","last_fullsized":"2023-12-16T01:25:54.955494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579484+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:25:57.579484+0000","last_peered":"2023-12-16T01:25:57.579484+0000","last_clean":"2023-12-16T01:25:57.579484+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:25:57.579484+0000","last_undegraded":"2023-12-16T01:25:57.579484+0000","last_fullsized":"2023-12-16T01:25:57.579484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972813+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:25:54.972813+0000","last_peered":"2023-12-16T01:25:54.972813+0000","last_clean":"2023-12-16T01:25:54.972813+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:25:54.972813+0000","last_undegraded":"2023-12-16T01:25:54.972813+0000","last_fullsized":"2023-12-16T01:25:54.972813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978171+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:25:54.978171+0000","last_peered":"2023-12-16T01:25:54.978171+0000","last_clean":"2023-12-16T01:25:54.978171+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:25:54.978171+0000","last_undegraded":"2023-12-16T01:25:54.978171+0000","last_fullsized":"2023-12-16T01:25:54.978171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579434+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:25:57.579434+0000","last_peered":"2023-12-16T01:25:57.579434+0000","last_clean":"2023-12-16T01:25:57.579434+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:25:57.579434+0000","last_undegraded":"2023-12-16T01:25:57.579434+0000","last_fullsized":"2023-12-16T01:25:57.579434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977003+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:25:54.977003+0000","last_peered":"2023-12-16T01:25:54.977003+0000","last_clean":"2023-12-16T01:25:54.977003+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:25:54.977003+0000","last_undegraded":"2023-12-16T01:25:54.977003+0000","last_fullsized":"2023-12-16T01:25:54.977003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980482+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:25:54.980482+0000","last_peered":"2023-12-16T01:25:54.980482+0000","last_clean":"2023-12-16T01:25:54.980482+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:25:54.980482+0000","last_undegraded":"2023-12-16T01:25:54.980482+0000","last_fullsized":"2023-12-16T01:25:54.980482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579147+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:25:57.579147+0000","last_peered":"2023-12-16T01:25:57.579147+0000","last_clean":"2023-12-16T01:25:57.579147+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:25:57.579147+0000","last_undegraded":"2023-12-16T01:25:57.579147+0000","last_fullsized":"2023-12-16T01:25:57.579147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970220+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:25:54.970220+0000","last_peered":"2023-12-16T01:25:54.970220+0000","last_clean":"2023-12-16T01:25:54.970220+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:25:54.970220+0000","last_undegraded":"2023-12-16T01:25:54.970220+0000","last_fullsized":"2023-12-16T01:25:54.970220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951806+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:25:54.951806+0000","last_peered":"2023-12-16T01:25:54.951806+0000","last_clean":"2023-12-16T01:25:54.951806+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:25:54.951806+0000","last_undegraded":"2023-12-16T01:25:54.951806+0000","last_fullsized":"2023-12-16T01:25:54.951806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.026955+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:25:56.026955+0000","last_peered":"2023-12-16T01:25:56.026955+0000","last_clean":"2023-12-16T01:25:56.026955+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:25:56.026955+0000","last_undegraded":"2023-12-16T01:25:56.026955+0000","last_fullsized":"2023-12-16T01:25:56.026955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977424+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:25:54.977424+0000","last_peered":"2023-12-16T01:25:54.977424+0000","last_clean":"2023-12-16T01:25:54.977424+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:25:54.977424+0000","last_undegraded":"2023-12-16T01:25:54.977424+0000","last_fullsized":"2023-12-16T01:25:54.977424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:26:11.837618+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:26:11.837618+0000","last_peered":"2023-12-16T01:26:11.837618+0000","last_clean":"2023-12-16T01:26:11.837618+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:26:11.837618+0000","last_undegraded":"2023-12-16T01:26:11.837618+0000","last_fullsized":"2023-12-16T01:26:11.837618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022069+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:25:56.022069+0000","last_peered":"2023-12-16T01:25:56.022069+0000","last_clean":"2023-12-16T01:25:56.022069+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:25:56.022069+0000","last_undegraded":"2023-12-16T01:25:56.022069+0000","last_fullsized":"2023-12-16T01:25:56.022069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976897+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:25:54.976897+0000","last_peered":"2023-12-16T01:25:54.976897+0000","last_clean":"2023-12-16T01:25:54.976897+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:25:54.976897+0000","last_undegraded":"2023-12-16T01:25:54.976897+0000","last_fullsized":"2023-12-16T01:25:54.976897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951776+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:25:54.951776+0000","last_peered":"2023-12-16T01:25:54.951776+0000","last_clean":"2023-12-16T01:25:54.951776+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:25:54.951776+0000","last_undegraded":"2023-12-16T01:25:54.951776+0000","last_fullsized":"2023-12-16T01:25:54.951776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578353+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:25:57.578353+0000","last_peered":"2023-12-16T01:25:57.578353+0000","last_clean":"2023-12-16T01:25:57.578353+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:25:57.578353+0000","last_undegraded":"2023-12-16T01:25:57.578353+0000","last_fullsized":"2023-12-16T01:25:57.578353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976082+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:25:54.976082+0000","last_peered":"2023-12-16T01:25:54.976082+0000","last_clean":"2023-12-16T01:25:54.976082+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:25:54.976082+0000","last_undegraded":"2023-12-16T01:25:54.976082+0000","last_fullsized":"2023-12-16T01:25:54.976082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976614+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:25:54.976614+0000","last_peered":"2023-12-16T01:25:54.976614+0000","last_clean":"2023-12-16T01:25:54.976614+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:25:54.976614+0000","last_undegraded":"2023-12-16T01:25:54.976614+0000","last_fullsized":"2023-12-16T01:25:54.976614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.579450+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:25:57.579450+0000","last_peered":"2023-12-16T01:25:57.579450+0000","last_clean":"2023-12-16T01:25:57.579450+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:25:57.579450+0000","last_undegraded":"2023-12-16T01:25:57.579450+0000","last_fullsized":"2023-12-16T01:25:57.579450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892462+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:25:54.892462+0000","last_peered":"2023-12-16T01:25:54.892462+0000","last_clean":"2023-12-16T01:25:54.892462+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:25:54.892462+0000","last_undegraded":"2023-12-16T01:25:54.892462+0000","last_fullsized":"2023-12-16T01:25:54.892462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975435+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:25:54.975435+0000","last_peered":"2023-12-16T01:25:54.975435+0000","last_clean":"2023-12-16T01:25:54.975435+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:25:54.975435+0000","last_undegraded":"2023-12-16T01:25:54.975435+0000","last_fullsized":"2023-12-16T01:25:54.975435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022372+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:25:56.022372+0000","last_peered":"2023-12-16T01:25:56.022372+0000","last_clean":"2023-12-16T01:25:56.022372+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:25:56.022372+0000","last_undegraded":"2023-12-16T01:25:56.022372+0000","last_fullsized":"2023-12-16T01:25:56.022372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022142+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:25:56.022142+0000","last_peered":"2023-12-16T01:25:56.022142+0000","last_clean":"2023-12-16T01:25:56.022142+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:25:56.022142+0000","last_undegraded":"2023-12-16T01:25:56.022142+0000","last_fullsized":"2023-12-16T01:25:56.022142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.956110+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:25:54.956110+0000","last_peered":"2023-12-16T01:25:54.956110+0000","last_clean":"2023-12-16T01:25:54.956110+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:25:54.956110+0000","last_undegraded":"2023-12-16T01:25:54.956110+0000","last_fullsized":"2023-12-16T01:25:54.956110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979677+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:25:54.979677+0000","last_peered":"2023-12-16T01:25:54.979677+0000","last_clean":"2023-12-16T01:25:54.979677+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:25:54.979677+0000","last_undegraded":"2023-12-16T01:25:54.979677+0000","last_fullsized":"2023-12-16T01:25:54.979677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.027139+0000","last_change":"2023-12-16T01:25:54.987548+0000","last_active":"2023-12-16T01:25:56.027139+0000","last_peered":"2023-12-16T01:25:56.027139+0000","last_clean":"2023-12-16T01:25:56.027139+0000","last_became_active":"2023-12-16T01:25:54.986234+0000","last_became_peered":"2023-12-16T01:25:54.986234+0000","last_unstale":"2023-12-16T01:25:56.027139+0000","last_undegraded":"2023-12-16T01:25:56.027139+0000","last_fullsized":"2023-12-16T01:25:56.027139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:33:01.262692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972408+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:25:54.972408+0000","last_peered":"2023-12-16T01:25:54.972408+0000","last_clean":"2023-12-16T01:25:54.972408+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:25:54.972408+0000","last_undegraded":"2023-12-16T01:25:54.972408+0000","last_fullsized":"2023-12-16T01:25:54.972408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970035+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:25:54.970035+0000","last_peered":"2023-12-16T01:25:54.970035+0000","last_clean":"2023-12-16T01:25:54.970035+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:25:54.970035+0000","last_undegraded":"2023-12-16T01:25:54.970035+0000","last_fullsized":"2023-12-16T01:25:54.970035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980404+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:25:54.980404+0000","last_peered":"2023-12-16T01:25:54.980404+0000","last_clean":"2023-12-16T01:25:54.980404+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:25:54.980404+0000","last_undegraded":"2023-12-16T01:25:54.980404+0000","last_fullsized":"2023-12-16T01:25:54.980404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955624+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:25:54.955624+0000","last_peered":"2023-12-16T01:25:54.955624+0000","last_clean":"2023-12-16T01:25:54.955624+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:25:54.955624+0000","last_undegraded":"2023-12-16T01:25:54.955624+0000","last_fullsized":"2023-12-16T01:25:54.955624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:56.022214+0000","last_change":"2023-12-16T01:25:54.978408+0000","last_active":"2023-12-16T01:25:56.022214+0000","last_peered":"2023-12-16T01:25:56.022214+0000","last_clean":"2023-12-16T01:25:56.022214+0000","last_became_active":"2023-12-16T01:25:54.978056+0000","last_became_peered":"2023-12-16T01:25:54.978056+0000","last_unstale":"2023-12-16T01:25:56.022214+0000","last_undegraded":"2023-12-16T01:25:56.022214+0000","last_fullsized":"2023-12-16T01:25:56.022214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:32.801898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975724+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:25:54.975724+0000","last_peered":"2023-12-16T01:25:54.975724+0000","last_clean":"2023-12-16T01:25:54.975724+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:25:54.975724+0000","last_undegraded":"2023-12-16T01:25:54.975724+0000","last_fullsized":"2023-12-16T01:25:54.975724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972490+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:25:54.972490+0000","last_peered":"2023-12-16T01:25:54.972490+0000","last_clean":"2023-12-16T01:25:54.972490+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:25:54.972490+0000","last_undegraded":"2023-12-16T01:25:54.972490+0000","last_fullsized":"2023-12-16T01:25:54.972490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-16T01:25:57.578258+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:25:57.578258+0000","last_peered":"2023-12-16T01:25:57.578258+0000","last_clean":"2023-12-16T01:25:57.578258+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:25:57.578258+0000","last_undegraded":"2023-12-16T01:25:57.578258+0000","last_fullsized":"2023-12-16T01:25:57.578258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891580+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:25:54.891580+0000","last_peered":"2023-12-16T01:25:54.891580+0000","last_clean":"2023-12-16T01:25:54.891580+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:25:54.891580+0000","last_undegraded":"2023-12-16T01:25:54.891580+0000","last_fullsized":"2023-12-16T01:25:54.891580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.951407+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:25:54.951407+0000","last_peered":"2023-12-16T01:25:54.951407+0000","last_clean":"2023-12-16T01:25:54.951407+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:25:54.951407+0000","last_undegraded":"2023-12-16T01:25:54.951407+0000","last_fullsized":"2023-12-16T01:25:54.951407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980175+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:25:54.980175+0000","last_peered":"2023-12-16T01:25:54.980175+0000","last_clean":"2023-12-16T01:25:54.980175+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:25:54.980175+0000","last_undegraded":"2023-12-16T01:25:54.980175+0000","last_fullsized":"2023-12-16T01:25:54.980175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975633+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:25:54.975633+0000","last_peered":"2023-12-16T01:25:54.975633+0000","last_clean":"2023-12-16T01:25:54.975633+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:25:54.975633+0000","last_undegraded":"2023-12-16T01:25:54.975633+0000","last_fullsized":"2023-12-16T01:25:54.975633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970596+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:25:54.970596+0000","last_peered":"2023-12-16T01:25:54.970596+0000","last_clean":"2023-12-16T01:25:54.970596+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:25:54.970596+0000","last_undegraded":"2023-12-16T01:25:54.970596+0000","last_fullsized":"2023-12-16T01:25:54.970596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970559+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:25:54.970559+0000","last_peered":"2023-12-16T01:25:54.970559+0000","last_clean":"2023-12-16T01:25:54.970559+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:25:54.970559+0000","last_undegraded":"2023-12-16T01:25:54.970559+0000","last_fullsized":"2023-12-16T01:25:54.970559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892380+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:25:54.892380+0000","last_peered":"2023-12-16T01:25:54.892380+0000","last_clean":"2023-12-16T01:25:54.892380+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:25:54.892380+0000","last_undegraded":"2023-12-16T01:25:54.892380+0000","last_fullsized":"2023-12-16T01:25:54.892380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975934+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:25:54.975934+0000","last_peered":"2023-12-16T01:25:54.975934+0000","last_clean":"2023-12-16T01:25:54.975934+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:25:54.975934+0000","last_undegraded":"2023-12-16T01:25:54.975934+0000","last_fullsized":"2023-12-16T01:25:54.975934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979591+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:25:54.979591+0000","last_peered":"2023-12-16T01:25:54.979591+0000","last_clean":"2023-12-16T01:25:54.979591+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:25:54.979591+0000","last_undegraded":"2023-12-16T01:25:54.979591+0000","last_fullsized":"2023-12-16T01:25:54.979591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972206+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:25:54.972206+0000","last_peered":"2023-12-16T01:25:54.972206+0000","last_clean":"2023-12-16T01:25:54.972206+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:25:54.972206+0000","last_undegraded":"2023-12-16T01:25:54.972206+0000","last_fullsized":"2023-12-16T01:25:54.972206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972426+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:25:54.972426+0000","last_peered":"2023-12-16T01:25:54.972426+0000","last_clean":"2023-12-16T01:25:54.972426+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:25:54.972426+0000","last_undegraded":"2023-12-16T01:25:54.972426+0000","last_fullsized":"2023-12-16T01:25:54.972426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.955509+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:25:54.955509+0000","last_peered":"2023-12-16T01:25:54.955509+0000","last_clean":"2023-12-16T01:25:54.955509+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:25:54.955509+0000","last_undegraded":"2023-12-16T01:25:54.955509+0000","last_fullsized":"2023-12-16T01:25:54.955509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981955+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:25:54.981955+0000","last_peered":"2023-12-16T01:25:54.981955+0000","last_clean":"2023-12-16T01:25:54.981955+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:25:54.981955+0000","last_undegraded":"2023-12-16T01:25:54.981955+0000","last_fullsized":"2023-12-16T01:25:54.981955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976900+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:25:54.976900+0000","last_peered":"2023-12-16T01:25:54.976900+0000","last_clean":"2023-12-16T01:25:54.976900+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:25:54.976900+0000","last_undegraded":"2023-12-16T01:25:54.976900+0000","last_fullsized":"2023-12-16T01:25:54.976900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.952066+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:25:54.952066+0000","last_peered":"2023-12-16T01:25:54.952066+0000","last_clean":"2023-12-16T01:25:54.952066+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:25:54.952066+0000","last_undegraded":"2023-12-16T01:25:54.952066+0000","last_fullsized":"2023-12-16T01:25:54.952066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977633+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:25:54.977633+0000","last_peered":"2023-12-16T01:25:54.977633+0000","last_clean":"2023-12-16T01:25:54.977633+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:25:54.977633+0000","last_undegraded":"2023-12-16T01:25:54.977633+0000","last_fullsized":"2023-12-16T01:25:54.977633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.979510+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:25:54.979510+0000","last_peered":"2023-12-16T01:25:54.979510+0000","last_clean":"2023-12-16T01:25:54.979510+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:25:54.979510+0000","last_undegraded":"2023-12-16T01:25:54.979510+0000","last_fullsized":"2023-12-16T01:25:54.979510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.972127+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:25:54.972127+0000","last_peered":"2023-12-16T01:25:54.972127+0000","last_clean":"2023-12-16T01:25:54.972127+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:25:54.972127+0000","last_undegraded":"2023-12-16T01:25:54.972127+0000","last_fullsized":"2023-12-16T01:25:54.972127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970095+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:25:54.970095+0000","last_peered":"2023-12-16T01:25:54.970095+0000","last_clean":"2023-12-16T01:25:54.970095+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:25:54.970095+0000","last_undegraded":"2023-12-16T01:25:54.970095+0000","last_fullsized":"2023-12-16T01:25:54.970095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970463+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:25:54.970463+0000","last_peered":"2023-12-16T01:25:54.970463+0000","last_clean":"2023-12-16T01:25:54.970463+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:25:54.970463+0000","last_undegraded":"2023-12-16T01:25:54.970463+0000","last_fullsized":"2023-12-16T01:25:54.970463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.981872+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:25:54.981872+0000","last_peered":"2023-12-16T01:25:54.981872+0000","last_clean":"2023-12-16T01:25:54.981872+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:25:54.981872+0000","last_undegraded":"2023-12-16T01:25:54.981872+0000","last_fullsized":"2023-12-16T01:25:54.981872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.977430+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:25:54.977430+0000","last_peered":"2023-12-16T01:25:54.977430+0000","last_clean":"2023-12-16T01:25:54.977430+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:25:54.977430+0000","last_undegraded":"2023-12-16T01:25:54.977430+0000","last_fullsized":"2023-12-16T01:25:54.977430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.976471+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:25:54.976471+0000","last_peered":"2023-12-16T01:25:54.976471+0000","last_clean":"2023-12-16T01:25:54.976471+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:25:54.976471+0000","last_undegraded":"2023-12-16T01:25:54.976471+0000","last_fullsized":"2023-12-16T01:25:54.976471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975246+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:25:54.975246+0000","last_peered":"2023-12-16T01:25:54.975246+0000","last_clean":"2023-12-16T01:25:54.975246+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:25:54.975246+0000","last_undegraded":"2023-12-16T01:25:54.975246+0000","last_fullsized":"2023-12-16T01:25:54.975246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.970321+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:25:54.970321+0000","last_peered":"2023-12-16T01:25:54.970321+0000","last_clean":"2023-12-16T01:25:54.970321+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:25:54.970321+0000","last_undegraded":"2023-12-16T01:25:54.970321+0000","last_fullsized":"2023-12-16T01:25:54.970321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978094+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:25:54.978094+0000","last_peered":"2023-12-16T01:25:54.978094+0000","last_clean":"2023-12-16T01:25:54.978094+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:25:54.978094+0000","last_undegraded":"2023-12-16T01:25:54.978094+0000","last_fullsized":"2023-12-16T01:25:54.978094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.892077+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:25:54.892077+0000","last_peered":"2023-12-16T01:25:54.892077+0000","last_clean":"2023-12-16T01:25:54.892077+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:25:54.892077+0000","last_undegraded":"2023-12-16T01:25:54.892077+0000","last_fullsized":"2023-12-16T01:25:54.892077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.980139+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:25:54.980139+0000","last_peered":"2023-12-16T01:25:54.980139+0000","last_clean":"2023-12-16T01:25:54.980139+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:25:54.980139+0000","last_undegraded":"2023-12-16T01:25:54.980139+0000","last_fullsized":"2023-12-16T01:25:54.980139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.891999+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:25:54.891999+0000","last_peered":"2023-12-16T01:25:54.891999+0000","last_clean":"2023-12-16T01:25:54.891999+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:25:54.891999+0000","last_undegraded":"2023-12-16T01:25:54.891999+0000","last_fullsized":"2023-12-16T01:25:54.891999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975363+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:25:54.975363+0000","last_peered":"2023-12-16T01:25:54.975363+0000","last_clean":"2023-12-16T01:25:54.975363+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:25:54.975363+0000","last_undegraded":"2023-12-16T01:25:54.975363+0000","last_fullsized":"2023-12-16T01:25:54.975363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.975981+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:25:54.975981+0000","last_peered":"2023-12-16T01:25:54.975981+0000","last_clean":"2023-12-16T01:25:54.975981+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:25:54.975981+0000","last_undegraded":"2023-12-16T01:25:54.975981+0000","last_fullsized":"2023-12-16T01:25:54.975981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T01:25:54.978584+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:25:54.978584+0000","last_peered":"2023-12-16T01:25:54.978584+0000","last_clean":"2023-12-16T01:25:54.978584+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:25:54.978584+0000","last_undegraded":"2023-12-16T01:25:54.978584+0000","last_fullsized":"2023-12-16T01:25:54.978584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.718}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":698014,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":112066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":697992,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:26:28.382 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T01:26:28.382 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T01:26:28.382 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-16T01:26:28.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-16T01:26:28.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.515+0000 7fe23d39e640 1 Processor -- start 2023-12-16T01:26:28.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.515+0000 7fe23d39e640 1 -- start start 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.515+0000 7fe23d39e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe2381566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.515+0000 7fe23d39e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe238159500 con 0x7fe2380c4c10 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.515+0000 7fe23d39e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380720a0 con 0x7fe2380c59e0 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.515+0000 7fe23d39e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c5e90 con 0x7fe2380c5600 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.516+0000 7fe23cb9d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe2380c4c10 0x7fe238160890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57620/0 (socket says 172.21.15.107:57620) 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.516+0000 7fe23cb9d640 1 -- 172.21.15.107:0/273820074 learned_addr learned my addr 172.21.15.107:0/273820074 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:28.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.516+0000 7fe237fff640 1 --2- 172.21.15.107:0/273820074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe2381566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:28.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.518+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141699524 0 0) 0x7fe238159500 con 0x7fe2380c4c10 2023-12-16T01:26:28.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.518+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe220003520 con 0x7fe2380c4c10 2023-12-16T01:26:28.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.519+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117382542 0 0) 0x7fe2380720a0 con 0x7fe2380c59e0 2023-12-16T01:26:28.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.519+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe238159500 con 0x7fe2380c59e0 2023-12-16T01:26:28.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.519+0000 7fe237fff640 1 -- 172.21.15.107:0/273820074 >> v1:172.21.15.157:6789/0 conn(0x7fe2380c59e0 legacy=0x7fe23814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.519+0000 7fe237fff640 1 -- 172.21.15.107:0/273820074 >> v1:172.21.15.107:6789/0 conn(0x7fe2380c4c10 legacy=0x7fe238160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.519+0000 7fe237fff640 1 -- 172.21.15.107:0/273820074 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238155f10 con 0x7fe2380c5600 2023-12-16T01:26:28.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.520+0000 7fe237fff640 1 --2- 172.21.15.107:0/273820074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe2381566f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097d0 tx=0x7fe22802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27593f0d8b10ce10 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:28.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.524+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228030880 con 0x7fe2380c5600 2023-12-16T01:26:28.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.524+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2280309e0 con 0x7fe2380c5600 2023-12-16T01:26:28.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.524+0000 7fe236ffd640 1 -- 172.21.15.107:0/273820074 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228030d70 con 0x7fe2380c5600 2023-12-16T01:26:28.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 -- 172.21.15.107:0/273820074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 msgr2=0x7fe2381566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 --2- 172.21.15.107:0/273820074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe2381566f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097d0 tx=0x7fe22802b9c0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 -- 172.21.15.107:0/273820074 shutdown_connections 2023-12-16T01:26:28.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 --2- 172.21.15.107:0/273820074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe2381566f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 -- 172.21.15.107:0/273820074 >> 172.21.15.107:0/273820074 conn(0x7fe23806a500 msgr2=0x7fe23806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:28.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 -- 172.21.15.107:0/273820074 shutdown_connections 2023-12-16T01:26:28.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.525+0000 7fe23d39e640 1 -- 172.21.15.107:0/273820074 wait complete. 2023-12-16T01:26:28.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.526+0000 7fe23d39e640 1 Processor -- start 2023-12-16T01:26:28.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 -- start start 2023-12-16T01:26:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 0x7fe238151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe23814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2380c59e0 0x7fe23814bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c7120 con 0x7fe2380c4c10 2023-12-16T01:26:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380ca6c0 con 0x7fe2380c59e0 2023-12-16T01:26:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.527+0000 7fe23d39e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23814c630 con 0x7fe2380c5600 2023-12-16T01:26:28.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.528+0000 7fe237fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 0x7fe238151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:28.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.528+0000 7fe23cb9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2380c59e0 0x7fe23814bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:28.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.528+0000 7fe2377fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe23814b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:28.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.528+0000 7fe237fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 0x7fe238151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41788/0 (socket says 172.21.15.107:41788) 2023-12-16T01:26:28.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.528+0000 7fe237fff640 1 -- 172.21.15.107:0/2086112596 learned_addr learned my addr 172.21.15.107:0/2086112596 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:28.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.531+0000 7fe237fff640 1 -- 172.21.15.107:0/2086112596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 msgr2=0x7fe23814b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.531+0000 7fe237fff640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe23814b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.531+0000 7fe237fff640 1 -- 172.21.15.107:0/2086112596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2380c59e0 msgr2=0x7fe23814bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:28.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.531+0000 7fe237fff640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2380c59e0 0x7fe23814bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:28.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.531+0000 7fe237fff640 1 -- 172.21.15.107:0/2086112596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe228009400 con 0x7fe2380c4c10 2023-12-16T01:26:28.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.534+0000 7fe237fff640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 0x7fe238151a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe22802bfd0 tx=0x7fe228004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:28.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.537+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22803e040 con 0x7fe2380c4c10 2023-12-16T01:26:28.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.537+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe228039cf0 con 0x7fe2380c4c10 2023-12-16T01:26:28.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.537+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228044630 con 0x7fe2380c4c10 2023-12-16T01:26:28.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.537+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2381525d0 con 0x7fe2380c4c10 2023-12-16T01:26:28.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.537+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe238150e50 con 0x7fe2380c4c10 2023-12-16T01:26:28.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.538+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe238152410 con 0x7fe2380c4c10 2023-12-16T01:26:28.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.557+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe22802f3d0 con 0x7fe2380c4c10 2023-12-16T01:26:28.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.557+0000 7fe234ff9640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe22406aec0 0x7fe22406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:28.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.557+0000 7fe2377fe640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe22406aec0 0x7fe22406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:28.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.557+0000 7fe2377fe640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe22406aec0 0x7fe22406d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe22c007fd0 tx=0x7fe22c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:28.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.796+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe22807af30 con 0x7fe2380c4c10 2023-12-16T01:26:28.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:28.796+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe228077270 con 0x7fe2380c4c10 2023-12-16T01:26:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.004+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe238159ab0 con 0x7fe2380c4c10 2023-12-16T01:26:29.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.009+0000 7fe234ff9640 1 -- 172.21.15.107:0/2086112596 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe228039e60 con 0x7fe2380c4c10 2023-12-16T01:26:29.010 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:29.010 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T01:26:29.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe22406aec0 msgr2=0x7fe22406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe22406aec0 0x7fe22406d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe22c007fd0 tx=0x7fe22c009040 comp rx=0 tx=0).stop 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 msgr2=0x7fe238151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 0x7fe238151a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe22802bfd0 tx=0x7fe228004730 comp rx=0 tx=0).stop 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 shutdown_connections 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe22406aec0 0x7fe22406d380 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2380c59e0 0x7fe23814bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2380c5600 0x7fe23814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 --2- 172.21.15.107:0/2086112596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2380c4c10 0x7fe238151a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.011+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 >> 172.21.15.107:0/2086112596 conn(0x7fe23806a500 msgr2=0x7fe238153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.012+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 shutdown_connections 2023-12-16T01:26:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.012+0000 7fe23d39e640 1 -- 172.21.15.107:0/2086112596 wait complete. 2023-12-16T01:26:29.023 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-16T01:26:29.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:29.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.123+0000 7fc283a6e640 1 Processor -- start 2023-12-16T01:26:29.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.123+0000 7fc283a6e640 1 -- start start 2023-12-16T01:26:29.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.124+0000 7fc283a6e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc27c151130 0x7fc27c157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.124+0000 7fc283a6e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc27c0ccc50 0x7fc27c161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.124+0000 7fc283a6e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0cd1b0 con 0x7fc27c0b1ff0 2023-12-16T01:26:29.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.124+0000 7fc283a6e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0cd490 con 0x7fc27c0ccc50 2023-12-16T01:26:29.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.124+0000 7fc283a6e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0cd770 con 0x7fc27c151130 2023-12-16T01:26:29.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.124+0000 7fc28200b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc27c0ccc50 0x7fc27c161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.125+0000 7fc28180a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc27c151130 0x7fc27c157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.125+0000 7fc28200b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc27c0ccc50 0x7fc27c161ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41792/0 (socket says 172.21.15.107:41792) 2023-12-16T01:26:29.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.125+0000 7fc28200b640 1 -- 172.21.15.107:0/742620516 learned_addr learned my addr 172.21.15.107:0/742620516 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:29.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.127+0000 7fc28200b640 1 -- 172.21.15.107:0/742620516 >> v2:172.21.15.157:3300/0 conn(0x7fc27c151130 msgr2=0x7fc27c157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:29.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.127+0000 7fc28200b640 1 --2- 172.21.15.107:0/742620516 >> v2:172.21.15.157:3300/0 conn(0x7fc27c151130 0x7fc27c157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.127+0000 7fc28200b640 1 -- 172.21.15.107:0/742620516 >> v1:172.21.15.157:6789/0 conn(0x7fc27c0b1ff0 legacy=0x7fc27c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:29.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.127+0000 7fc28200b640 1 -- 172.21.15.107:0/742620516 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c157430 con 0x7fc27c0ccc50 2023-12-16T01:26:29.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.128+0000 7fc28200b640 1 --2- 172.21.15.107:0/742620516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c161ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0cdd10 tx=0x7fc27402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcf7ae395de4b37 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:29.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.132+0000 7fc280808640 1 -- 172.21.15.107:0/742620516 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27402cb20 con 0x7fc27c0ccc50 2023-12-16T01:26:29.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.132+0000 7fc280808640 1 -- 172.21.15.107:0/742620516 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27402cc80 con 0x7fc27c0ccc50 2023-12-16T01:26:29.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.132+0000 7fc280808640 1 -- 172.21.15.107:0/742620516 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740343f0 con 0x7fc27c0ccc50 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 -- 172.21.15.107:0/742620516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 msgr2=0x7fc27c161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 --2- 172.21.15.107:0/742620516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c161ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0cdd10 tx=0x7fc27402bf80 comp rx=0 tx=0).stop 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 -- 172.21.15.107:0/742620516 shutdown_connections 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 --2- 172.21.15.107:0/742620516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c161ca0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 --2- 172.21.15.107:0/742620516 >> v2:172.21.15.157:3300/0 conn(0x7fc27c151130 0x7fc27c157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 -- 172.21.15.107:0/742620516 >> 172.21.15.107:0/742620516 conn(0x7fc27c06ab30 msgr2=0x7fc27c06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:29.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 -- 172.21.15.107:0/742620516 shutdown_connections 2023-12-16T01:26:29.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.133+0000 7fc283a6e640 1 -- 172.21.15.107:0/742620516 wait complete. 2023-12-16T01:26:29.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.134+0000 7fc283a6e640 1 Processor -- start 2023-12-16T01:26:29.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.134+0000 7fc283a6e640 1 -- start start 2023-12-16T01:26:29.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc283a6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc27c0b1ff0 0x7fc27c158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc283a6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc283a6e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc27c151130 0x7fc27c14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc283a6e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c159fc0 con 0x7fc27c0ccc50 2023-12-16T01:26:29.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc283a6e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c154f40 con 0x7fc27c151130 2023-12-16T01:26:29.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc283a6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c1ec9a0 con 0x7fc27c0b1ff0 2023-12-16T01:26:29.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.135+0000 7fc281009640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.136+0000 7fc28200b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc27c151130 0x7fc27c14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.136+0000 7fc281009640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41796/0 (socket says 172.21.15.107:41796) 2023-12-16T01:26:29.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.136+0000 7fc281009640 1 -- 172.21.15.107:0/3612813360 learned_addr learned my addr 172.21.15.107:0/3612813360 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:29.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.136+0000 7fc28180a640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc27c0b1ff0 0x7fc27c158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:26:29.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:26:29.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.139+0000 7fc281009640 1 -- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc27c0b1ff0 msgr2=0x7fc27c158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.139+0000 7fc281009640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc27c0b1ff0 0x7fc27c158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.139+0000 7fc281009640 1 -- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc27c151130 msgr2=0x7fc27c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.139+0000 7fc281009640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc27c151130 0x7fc27c14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.139+0000 7fc281009640 1 -- 172.21.15.107:0/3612813360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009b30 con 0x7fc27c0ccc50 2023-12-16T01:26:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.141+0000 7fc281009640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c0c5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c400 tx=0x7fc26c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:29.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.145+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c011790 con 0x7fc27c0ccc50 2023-12-16T01:26:29.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.145+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c011930 con 0x7fc27c0ccc50 2023-12-16T01:26:29.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.145+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c011ce0 con 0x7fc27c0ccc50 2023-12-16T01:26:29.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.145+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c1ecc60 con 0x7fc27c0ccc50 2023-12-16T01:26:29.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.145+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c1ed220 con 0x7fc27c0ccc50 2023-12-16T01:26:29.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.146+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c067500 con 0x7fc27c0ccc50 2023-12-16T01:26:29.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.166+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc26c01c460 con 0x7fc27c0ccc50 2023-12-16T01:26:29.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.166+0000 7fc2727fc640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc26006aec0 0x7fc26006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.167+0000 7fc28180a640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc26006aec0 0x7fc26006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.167+0000 7fc28180a640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc26006aec0 0x7fc26006d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc278009aa0 tx=0x7fc278009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:29.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.169+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc26c011e40 con 0x7fc27c0ccc50 2023-12-16T01:26:29.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.401+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc26c054fe0 con 0x7fc27c0ccc50 2023-12-16T01:26:29.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.568+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc27c150bd0 con 0x7fc27c0ccc50 2023-12-16T01:26:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.605+0000 7fc2727fc640 1 -- 172.21.15.107:0/3612813360 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18410 (secure 0 0 0) 0x7fc26c058600 con 0x7fc27c0ccc50 2023-12-16T01:26:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:29.606 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:25:55.553722+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc26006aec0 msgr2=0x7fc26006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc26006aec0 0x7fc26006d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc278009aa0 tx=0x7fc278009190 comp rx=0 tx=0).stop 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 msgr2=0x7fc27c0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c0c5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c400 tx=0x7fc26c00c8c0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 shutdown_connections 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fc26006aec0 0x7fc26006d380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc27c151130 0x7fc27c14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0ccc50 0x7fc27c0c5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 --2- 172.21.15.107:0/3612813360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc27c0b1ff0 0x7fc27c158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 >> 172.21.15.107:0/3612813360 conn(0x7fc27c06ab30 msgr2=0x7fc27c070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 shutdown_connections 2023-12-16T01:26:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.607+0000 7fc283a6e640 1 -- 172.21.15.107:0/3612813360 wait complete. 2023-12-16T01:26:29.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T01:25:45.757668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T01:25:47.362497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T01:25:52.786986+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T01:26:29.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:26:29.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.719+0000 7f60d8590640 1 Processor -- start 2023-12-16T01:26:29.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.720+0000 7f60d8590640 1 -- start start 2023-12-16T01:26:29.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.720+0000 7f60d8590640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60d0153890 0x7f60d015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.721+0000 7f60d8590640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d00ceef0 0x7f60d00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.721+0000 7f60d8590640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d015a700 con 0x7f60d0153c70 2023-12-16T01:26:29.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.721+0000 7f60d8590640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d00ca870 con 0x7f60d0153890 2023-12-16T01:26:29.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.721+0000 7f60d8590640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d0159af0 con 0x7f60d00ceef0 2023-12-16T01:26:29.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.722+0000 7f60d6b2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d00ceef0 0x7f60d00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.722+0000 7f60d5b2b640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f60d0153c70 0x7f60d00c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60296/0 (socket says 172.21.15.107:60296) 2023-12-16T01:26:29.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.722+0000 7f60d5b2b640 1 -- 172.21.15.107:0/708600051 learned_addr learned my addr 172.21.15.107:0/708600051 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:29.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.725+0000 7f60d532a640 1 -- 172.21.15.107:0/708600051 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367226177 0 0) 0x7f60d015a700 con 0x7f60d0153c70 2023-12-16T01:26:29.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.725+0000 7f60d532a640 1 -- 172.21.15.107:0/708600051 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60bc003520 con 0x7f60d0153c70 2023-12-16T01:26:29.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.725+0000 7f60d6b2d640 1 -- 172.21.15.107:0/708600051 >> v2:172.21.15.107:3300/0 conn(0x7f60d0153890 msgr2=0x7f60d015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:29.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.725+0000 7f60d6b2d640 1 --2- 172.21.15.107:0/708600051 >> v2:172.21.15.107:3300/0 conn(0x7f60d0153890 0x7f60d015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.725+0000 7f60d6b2d640 1 -- 172.21.15.107:0/708600051 >> v1:172.21.15.157:6789/0 conn(0x7f60d0153c70 legacy=0x7f60d00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.725+0000 7f60d6b2d640 1 -- 172.21.15.107:0/708600051 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0159dd0 con 0x7f60d00ceef0 2023-12-16T01:26:29.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.727+0000 7f60d6b2d640 1 --2- 172.21.15.107:0/708600051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d00ceef0 0x7f60d00cf320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009d90 tx=0x7f60c802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4406bec49d92fead server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:29.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.731+0000 7f60d532a640 1 -- 172.21.15.107:0/708600051 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c802cce0 con 0x7f60d00ceef0 2023-12-16T01:26:29.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.731+0000 7f60d532a640 1 -- 172.21.15.107:0/708600051 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c802ce40 con 0x7f60d00ceef0 2023-12-16T01:26:29.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.731+0000 7f60d532a640 1 -- 172.21.15.107:0/708600051 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8034660 con 0x7f60d00ceef0 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 -- 172.21.15.107:0/708600051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d00ceef0 msgr2=0x7f60d00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 --2- 172.21.15.107:0/708600051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d00ceef0 0x7f60d00cf320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009d90 tx=0x7f60c802bf30 comp rx=0 tx=0).stop 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 -- 172.21.15.107:0/708600051 shutdown_connections 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 --2- 172.21.15.107:0/708600051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d00ceef0 0x7f60d00cf320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 --2- 172.21.15.107:0/708600051 >> v2:172.21.15.107:3300/0 conn(0x7f60d0153890 0x7f60d015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 -- 172.21.15.107:0/708600051 >> 172.21.15.107:0/708600051 conn(0x7f60d006ba00 msgr2=0x7f60d006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 -- 172.21.15.107:0/708600051 shutdown_connections 2023-12-16T01:26:29.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.732+0000 7f60d8590640 1 -- 172.21.15.107:0/708600051 wait complete. 2023-12-16T01:26:29.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.733+0000 7f60d8590640 1 Processor -- start 2023-12-16T01:26:29.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.733+0000 7f60d8590640 1 -- start start 2023-12-16T01:26:29.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d8590640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60d00ceef0 0x7f60d0155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d8590640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d0153890 0x7f60d0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d8590640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 0x7f60d01f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d8590640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d01f07e0 con 0x7f60d00ceef0 2023-12-16T01:26:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d8590640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d01efef0 con 0x7f60d0153890 2023-12-16T01:26:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d8590640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d01f0a80 con 0x7f60d0153c70 2023-12-16T01:26:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d6b2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 0x7f60d01f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.734+0000 7f60d5b2b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d0153890 0x7f60d0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.735+0000 7f60d6b2d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 0x7f60d01f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54336/0 (socket says 172.21.15.107:54336) 2023-12-16T01:26:29.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.735+0000 7f60d6b2d640 1 -- 172.21.15.107:0/616797593 learned_addr learned my addr 172.21.15.107:0/616797593 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:29.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.738+0000 7f60d6b2d640 1 -- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d0153890 msgr2=0x7f60d0155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.738+0000 7f60d6b2d640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d0153890 0x7f60d0155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.738+0000 7f60d6b2d640 1 -- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60d00ceef0 msgr2=0x7f60d0155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:29.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.738+0000 7f60d6b2d640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60d00ceef0 0x7f60d0155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:29.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.738+0000 7f60d6b2d640 1 -- 172.21.15.107:0/616797593 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8009a70 con 0x7f60d0153c70 2023-12-16T01:26:29.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.742+0000 7f60d6b2d640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 0x7f60d01f1560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009d90 tx=0x7f60c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:29.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.747+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c803e610 con 0x7f60d0153c70 2023-12-16T01:26:29.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.747+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c803e770 con 0x7f60d0153c70 2023-12-16T01:26:29.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.747+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c803eb20 con 0x7f60d0153c70 2023-12-16T01:26:29.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.747+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d01f0d60 con 0x7f60d0153c70 2023-12-16T01:26:29.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.748+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d01f01d0 con 0x7f60d0153c70 2023-12-16T01:26:29.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.749+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d00b2a20 con 0x7f60d0153c70 2023-12-16T01:26:29.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.996+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f60c803b050 con 0x7f60d0153c70 2023-12-16T01:26:29.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.996+0000 7f60c6ffd640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f60b406ae90 0x7f60b406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:29.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.997+0000 7f60d632c640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f60b406ae90 0x7f60b406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:29.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:29.997+0000 7f60d632c640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f60b406ae90 0x7f60b406d350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009710 tx=0x7f60c0006c90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:30.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.002+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60c807a980 con 0x7f60d0153c70 2023-12-16T01:26:30.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.015+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f60c8076cc0 con 0x7f60d0153c70 2023-12-16T01:26:30.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.201+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60d01f1280 con 0x7f60d0153c70 2023-12-16T01:26:30.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.231+0000 7f60c6ffd640 1 -- 172.21.15.107:0/616797593 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60d01f1280 con 0x7f60d0153c70 2023-12-16T01:26:30.232 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f60b406ae90 msgr2=0x7f60b406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f60b406ae90 0x7f60b406d350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009710 tx=0x7f60c0006c90 comp rx=0 tx=0).stop 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 msgr2=0x7f60d01f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 0x7f60d01f1560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009d90 tx=0x7f60c8004a40 comp rx=0 tx=0).stop 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 shutdown_connections 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60d0153c70 0x7f60d01f1560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f60b406ae90 0x7f60b406d350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d0153890 0x7f60d0155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 --2- 172.21.15.107:0/616797593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60d00ceef0 0x7f60d0155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.233+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 >> 172.21.15.107:0/616797593 conn(0x7f60d006ba00 msgr2=0x7f60d0073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.234+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 shutdown_connections 2023-12-16T01:26:30.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.234+0000 7f60d8590640 1 -- 172.21.15.107:0/616797593 wait complete. 2023-12-16T01:26:30.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T01:26:30.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.360+0000 7fbd5b00e640 1 Processor -- start 2023-12-16T01:26:30.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.360+0000 7fbd5b00e640 1 -- start start 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd5b00e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd541501c0 0x7fbd54159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd5b00e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd54156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd5b00e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540c1a90 con 0x7fbd54072450 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd5b00e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540c1d30 con 0x7fbd541501c0 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd5b00e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540c2010 con 0x7fbd540bff00 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd58daa640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd541501c0 0x7fbd54159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd54156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd595ab640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbd54072450 0x7fbd54071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60304/0 (socket says 172.21.15.107:60304) 2023-12-16T01:26:30.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.361+0000 7fbd595ab640 1 -- 172.21.15.107:0/419756434 learned_addr learned my addr 172.21.15.107:0/419756434 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:30.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.363+0000 7fbd537fe640 1 -- 172.21.15.107:0/419756434 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477577216 0 0) 0x7fbd540c1a90 con 0x7fbd54072450 2023-12-16T01:26:30.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.363+0000 7fbd537fe640 1 -- 172.21.15.107:0/419756434 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd44003520 con 0x7fbd54072450 2023-12-16T01:26:30.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.363+0000 7fbd58daa640 1 -- 172.21.15.107:0/419756434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 msgr2=0x7fbd54156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:30.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.364+0000 7fbd58daa640 1 --2- 172.21.15.107:0/419756434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd54156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.364+0000 7fbd58daa640 1 -- 172.21.15.107:0/419756434 >> v1:172.21.15.157:6789/0 conn(0x7fbd54072450 legacy=0x7fbd54071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.364+0000 7fbd58daa640 1 -- 172.21.15.107:0/419756434 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54156380 con 0x7fbd541501c0 2023-12-16T01:26:30.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.365+0000 7fbd58daa640 1 --2- 172.21.15.107:0/419756434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd541501c0 0x7fbd54159860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097a0 tx=0x7fbd4802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9bd851d0c19c5f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:30.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.369+0000 7fbd537fe640 1 -- 172.21.15.107:0/419756434 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48030610 con 0x7fbd541501c0 2023-12-16T01:26:30.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.369+0000 7fbd537fe640 1 -- 172.21.15.107:0/419756434 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48030770 con 0x7fbd541501c0 2023-12-16T01:26:30.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.369+0000 7fbd537fe640 1 -- 172.21.15.107:0/419756434 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48030b00 con 0x7fbd541501c0 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 -- 172.21.15.107:0/419756434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd541501c0 msgr2=0x7fbd54159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/419756434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd541501c0 0x7fbd54159860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097a0 tx=0x7fbd4802b960 comp rx=0 tx=0).stop 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 -- 172.21.15.107:0/419756434 shutdown_connections 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/419756434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd54156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/419756434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd541501c0 0x7fbd54159860 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 -- 172.21.15.107:0/419756434 >> 172.21.15.107:0/419756434 conn(0x7fbd5406cd60 msgr2=0x7fbd5406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 -- 172.21.15.107:0/419756434 shutdown_connections 2023-12-16T01:26:30.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.370+0000 7fbd5b00e640 1 -- 172.21.15.107:0/419756434 wait complete. 2023-12-16T01:26:30.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.371+0000 7fbd5b00e640 1 Processor -- start 2023-12-16T01:26:30.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.371+0000 7fbd5b00e640 1 -- start start 2023-12-16T01:26:30.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd5b00e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 0x7fbd54151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd5b00e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd540c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd5b00e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd541501c0 0x7fbd541484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd5b00e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541561b0 con 0x7fbd54072450 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd5b00e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541f0ae0 con 0x7fbd541501c0 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd5b00e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541f1010 con 0x7fbd540bff00 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.372+0000 7fbd58daa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 0x7fbd54151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.373+0000 7fbd595ab640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd541501c0 0x7fbd541484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.373+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd540c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.373+0000 7fbd58daa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 0x7fbd54151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59866/0 (socket says 172.21.15.107:59866) 2023-12-16T01:26:30.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.373+0000 7fbd58daa640 1 -- 172.21.15.107:0/1718852097 learned_addr learned my addr 172.21.15.107:0/1718852097 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:30.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.376+0000 7fbd58daa640 1 -- 172.21.15.107:0/1718852097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 msgr2=0x7fbd540c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.376+0000 7fbd58daa640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd540c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.376+0000 7fbd58daa640 1 -- 172.21.15.107:0/1718852097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd541501c0 msgr2=0x7fbd541484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.376+0000 7fbd58daa640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd541501c0 0x7fbd541484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.376+0000 7fbd58daa640 1 -- 172.21.15.107:0/1718852097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48009400 con 0x7fbd54072450 2023-12-16T01:26:30.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.378+0000 7fbd58daa640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 0x7fbd54151dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd4802bf70 tx=0x7fbd480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:30.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.381+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4803e070 con 0x7fbd54072450 2023-12-16T01:26:30.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.381+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48039720 con 0x7fbd54072450 2023-12-16T01:26:30.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.381+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540c2d30 con 0x7fbd54072450 2023-12-16T01:26:30.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.381+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48039ab0 con 0x7fbd54072450 2023-12-16T01:26:30.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.381+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd540c2770 con 0x7fbd54072450 2023-12-16T01:26:30.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.382+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd540c77e0 con 0x7fbd54072450 2023-12-16T01:26:30.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.400+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fbd48039c10 con 0x7fbd54072450 2023-12-16T01:26:30.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.401+0000 7fbd517fa640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd3806aec0 0x7fbd3806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.401+0000 7fbd53fff640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd3806aec0 0x7fbd3806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.401+0000 7fbd53fff640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd3806aec0 0x7fbd3806d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd54074640 tx=0x7fbd40009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:30.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.403+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbd4807a2e0 con 0x7fbd54072450 2023-12-16T01:26:30.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.635+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fbd48076620 con 0x7fbd54072450 2023-12-16T01:26:30.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.801+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd54072230 con 0x7fbd54072450 2023-12-16T01:26:30.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.808+0000 7fbd517fa640 1 -- 172.21.15.107:0/1718852097 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd480480a0 con 0x7fbd54072450 2023-12-16T01:26:30.809 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:30.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd3806aec0 msgr2=0x7fbd3806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd3806aec0 0x7fbd3806d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd54074640 tx=0x7fbd40009190 comp rx=0 tx=0).stop 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 msgr2=0x7fbd54151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 0x7fbd54151dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd4802bf70 tx=0x7fbd480046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 shutdown_connections 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbd3806aec0 0x7fbd3806d380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd541501c0 0x7fbd541484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd540bff00 0x7fbd540c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 --2- 172.21.15.107:0/1718852097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd54072450 0x7fbd54151dc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 >> 172.21.15.107:0/1718852097 conn(0x7fbd5406cd60 msgr2=0x7fbd5406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.810+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 shutdown_connections 2023-12-16T01:26:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.811+0000 7fbd5b00e640 1 -- 172.21.15.107:0/1718852097 wait complete. 2023-12-16T01:26:30.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T01:26:30.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.923+0000 7f1ca4c87640 1 Processor -- start 2023-12-16T01:26:30.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.923+0000 7f1ca4c87640 1 -- start start 2023-12-16T01:26:30.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1ca4c87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca00cb0a0 0x7f1ca006f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1ca4c87640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1ca015d880 0x7f1ca0153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1ca4c87640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca0071170 con 0x7f1ca00cb480 2023-12-16T01:26:30.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1ca4c87640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca0071450 con 0x7f1ca015d880 2023-12-16T01:26:30.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1ca4c87640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0071730 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1c9ed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1ca015d880 0x7f1ca0153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.924+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca00cb0a0 0x7f1ca006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.925+0000 7f1c97fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1ca00cb480 0x7f1ca015d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46358/0 (socket says 172.21.15.107:46358) 2023-12-16T01:26:30.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.925+0000 7f1c97fff640 1 -- 172.21.15.107:0/2417152463 learned_addr learned my addr 172.21.15.107:0/2417152463 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:30.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.927+0000 7f1c9e59c640 1 -- 172.21.15.107:0/2417152463 >> v2:172.21.15.107:3300/0 conn(0x7f1ca015d880 msgr2=0x7f1ca0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:30.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.927+0000 7f1c9e59c640 1 --2- 172.21.15.107:0/2417152463 >> v2:172.21.15.107:3300/0 conn(0x7f1ca015d880 0x7f1ca0153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.927+0000 7f1c9e59c640 1 -- 172.21.15.107:0/2417152463 >> v1:172.21.15.107:6789/0 conn(0x7f1ca00cb480 legacy=0x7f1ca015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.927+0000 7f1c9e59c640 1 -- 172.21.15.107:0/2417152463 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0071a10 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.929+0000 7f1c9e59c640 1 --2- 172.21.15.107:0/2417152463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca00cb0a0 0x7f1ca006f190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c900097a0 tx=0x7f1c9002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb518c6d8095a66 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:30.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.932+0000 7f1c9dd9b640 1 -- 172.21.15.107:0/2417152463 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90030800 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.932+0000 7f1c9dd9b640 1 -- 172.21.15.107:0/2417152463 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90030960 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.932+0000 7f1c9dd9b640 1 -- 172.21.15.107:0/2417152463 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90030cf0 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 -- 172.21.15.107:0/2417152463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca00cb0a0 msgr2=0x7f1ca006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/2417152463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca00cb0a0 0x7f1ca006f190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c900097a0 tx=0x7f1c9002b940 comp rx=0 tx=0).stop 2023-12-16T01:26:30.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 -- 172.21.15.107:0/2417152463 shutdown_connections 2023-12-16T01:26:30.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/2417152463 >> v2:172.21.15.107:3300/0 conn(0x7f1ca015d880 0x7f1ca0153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/2417152463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca00cb0a0 0x7f1ca006f190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 -- 172.21.15.107:0/2417152463 >> 172.21.15.107:0/2417152463 conn(0x7f1ca006cd60 msgr2=0x7f1ca006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:30.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 -- 172.21.15.107:0/2417152463 shutdown_connections 2023-12-16T01:26:30.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.933+0000 7f1ca4c87640 1 -- 172.21.15.107:0/2417152463 wait complete. 2023-12-16T01:26:30.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.934+0000 7f1ca4c87640 1 Processor -- start 2023-12-16T01:26:30.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.934+0000 7f1ca4c87640 1 -- start start 2023-12-16T01:26:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.935+0000 7f1ca4c87640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 0x7f1ca01ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.935+0000 7f1ca4c87640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ca00cb480 0x7f1ca014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.935+0000 7f1ca4c87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca015d880 0x7f1ca00c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.935+0000 7f1ca4c87640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01596e0 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.935+0000 7f1ca4c87640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca014ec00 con 0x7f1ca00cb480 2023-12-16T01:26:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.935+0000 7f1ca4c87640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0158e80 con 0x7f1ca015d880 2023-12-16T01:26:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.936+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 0x7f1ca01ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.936+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ca00cb480 0x7f1ca014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.936+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 0x7f1ca01ef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59878/0 (socket says 172.21.15.107:59878) 2023-12-16T01:26:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.936+0000 7f1c9e59c640 1 -- 172.21.15.107:0/666570078 learned_addr learned my addr 172.21.15.107:0/666570078 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.936+0000 7f1c9ed9d640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca015d880 0x7f1ca00c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:30.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.939+0000 7f1c9e59c640 1 -- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca015d880 msgr2=0x7f1ca00c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.939+0000 7f1c9e59c640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca015d880 0x7f1ca00c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.939+0000 7f1c9e59c640 1 -- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ca00cb480 msgr2=0x7f1ca014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:30.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.939+0000 7f1c9e59c640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ca00cb480 0x7f1ca014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:30.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.939+0000 7f1c9e59c640 1 -- 172.21.15.107:0/666570078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009400 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.941+0000 7f1c9e59c640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 0x7f1ca01ef420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c9002bf50 tx=0x7f1c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:30.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.945+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9003e070 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.945+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90039a10 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.945+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca0159140 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.945+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90039da0 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.945+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca01f20a0 con 0x7f1ca00cb0a0 2023-12-16T01:26:30.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:30.946+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca0070e10 con 0x7f1ca00cb0a0 2023-12-16T01:26:31.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.193+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1c900423f0 con 0x7f1ca00cb0a0 2023-12-16T01:26:31.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.193+0000 7f1c96ffd640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1c8006ae90 0x7f1c8006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.193+0000 7f1c97fff640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1c8006ae90 0x7f1c8006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.194+0000 7f1c97fff640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1c8006ae90 0x7f1c8006d350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00c5040 tx=0x7f1c88009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.208+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c9007a5d0 con 0x7f1ca00cb0a0 2023-12-16T01:26:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.208+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1c90076910 con 0x7f1ca00cb0a0 2023-12-16T01:26:31.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.386+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ca0070e10 con 0x7f1ca00cb0a0 2023-12-16T01:26:31.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.391+0000 7f1c96ffd640 1 -- 172.21.15.107:0/666570078 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ca0070e10 con 0x7f1ca00cb0a0 2023-12-16T01:26:31.392 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-12-16T01:26:31.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1c8006ae90 msgr2=0x7f1c8006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1c8006ae90 0x7f1c8006d350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00c5040 tx=0x7f1c88009040 comp rx=0 tx=0).stop 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 msgr2=0x7f1ca01ef420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 0x7f1ca01ef420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c9002bf50 tx=0x7f1c900046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 shutdown_connections 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ca015d880 0x7f1ca00c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1c8006ae90 0x7f1c8006d350 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ca00cb480 0x7f1ca014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 --2- 172.21.15.107:0/666570078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ca00cb0a0 0x7f1ca01ef420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 >> 172.21.15.107:0/666570078 conn(0x7f1ca006cd60 msgr2=0x7f1ca00c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 shutdown_connections 2023-12-16T01:26:31.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.393+0000 7f1ca4c87640 1 -- 172.21.15.107:0/666570078 wait complete. 2023-12-16T01:26:31.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T01:26:31.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.508+0000 7faa4c6c2640 1 Processor -- start 2023-12-16T01:26:31.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.508+0000 7faa4c6c2640 1 -- start start 2023-12-16T01:26:31.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.509+0000 7faa4c6c2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44151630 0x7faa4406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.509+0000 7faa4c6c2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faa440c2000 0x7faa440c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.509+0000 7faa4c6c2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440c29b0 con 0x7faa44157f50 2023-12-16T01:26:31.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.509+0000 7faa4c6c2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4415b9c0 con 0x7faa440c2000 2023-12-16T01:26:31.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.509+0000 7faa4c6c2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4415ab60 con 0x7faa44151630 2023-12-16T01:26:31.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.510+0000 7faa49c5d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7faa44157f50 0x7faa440c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46362/0 (socket says 172.21.15.107:46362) 2023-12-16T01:26:31.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.510+0000 7faa49c5d640 1 -- 172.21.15.107:0/1012023783 learned_addr learned my addr 172.21.15.107:0/1012023783 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:31.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.510+0000 7faa4a45e640 1 --2- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44151630 0x7faa4406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.510+0000 7faa4ac5f640 1 --2- 172.21.15.107:0/1012023783 >> v2:172.21.15.157:3300/0 conn(0x7faa440c2000 0x7faa440c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.513+0000 7faa4945c640 1 -- 172.21.15.107:0/1012023783 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797567447 0 0) 0x7faa440c29b0 con 0x7faa44157f50 2023-12-16T01:26:31.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.513+0000 7faa4945c640 1 -- 172.21.15.107:0/1012023783 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa30003520 con 0x7faa44157f50 2023-12-16T01:26:31.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.513+0000 7faa4ac5f640 1 -- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44151630 msgr2=0x7faa4406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:31.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.513+0000 7faa4ac5f640 1 --2- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44151630 0x7faa4406f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.513+0000 7faa4ac5f640 1 -- 172.21.15.107:0/1012023783 >> v1:172.21.15.107:6789/0 conn(0x7faa44157f50 legacy=0x7faa440c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.513+0000 7faa4ac5f640 1 -- 172.21.15.107:0/1012023783 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4415ae40 con 0x7faa440c2000 2023-12-16T01:26:31.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.515+0000 7faa4ac5f640 1 --2- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa440c2000 0x7faa440c2470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0097a0 tx=0x7faa3c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11de91280e9dc18b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.518+0000 7faa4945c640 1 -- 172.21.15.107:0/1012023783 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c030610 con 0x7faa440c2000 2023-12-16T01:26:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.518+0000 7faa4945c640 1 -- 172.21.15.107:0/1012023783 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c030770 con 0x7faa440c2000 2023-12-16T01:26:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.518+0000 7faa4945c640 1 -- 172.21.15.107:0/1012023783 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c030b00 con 0x7faa440c2000 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 -- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa440c2000 msgr2=0x7faa440c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa440c2000 0x7faa440c2470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0097a0 tx=0x7faa3c02b960 comp rx=0 tx=0).stop 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 -- 172.21.15.107:0/1012023783 shutdown_connections 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa440c2000 0x7faa440c2470 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/1012023783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44151630 0x7faa4406f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 -- 172.21.15.107:0/1012023783 >> 172.21.15.107:0/1012023783 conn(0x7faa44061100 msgr2=0x7faa440614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:31.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 -- 172.21.15.107:0/1012023783 shutdown_connections 2023-12-16T01:26:31.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.519+0000 7faa4c6c2640 1 -- 172.21.15.107:0/1012023783 wait complete. 2023-12-16T01:26:31.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.520+0000 7faa4c6c2640 1 Processor -- start 2023-12-16T01:26:31.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.520+0000 7faa4c6c2640 1 -- start start 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4c6c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 0x7faa4414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4c6c2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa44151630 0x7faa441eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4c6c2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44157f50 0x7faa44148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4c6c2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4406cce0 con 0x7faa440c2000 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4c6c2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4406c720 con 0x7faa44151630 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4c6c2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4406ca00 con 0x7faa44157f50 2023-12-16T01:26:31.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.521+0000 7faa4a45e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 0x7faa4414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.522+0000 7faa4a45e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 0x7faa4414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59886/0 (socket says 172.21.15.107:59886) 2023-12-16T01:26:31.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.522+0000 7faa4a45e640 1 -- 172.21.15.107:0/143233239 learned_addr learned my addr 172.21.15.107:0/143233239 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:31.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.522+0000 7faa4ac5f640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44157f50 0x7faa44148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.522+0000 7faa49c5d640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa44151630 0x7faa441eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.525+0000 7faa4a45e640 1 -- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44157f50 msgr2=0x7faa44148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.525+0000 7faa4a45e640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44157f50 0x7faa44148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.525+0000 7faa4a45e640 1 -- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa44151630 msgr2=0x7faa441eea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.525+0000 7faa4a45e640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa44151630 0x7faa441eea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.525+0000 7faa4a45e640 1 -- 172.21.15.107:0/143233239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009400 con 0x7faa440c2000 2023-12-16T01:26:31.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.527+0000 7faa4a45e640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 0x7faa4414fad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa4000efc0 tx=0x7faa4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:31.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.531+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40014480 con 0x7faa440c2000 2023-12-16T01:26:31.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.531+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4000f040 con 0x7faa440c2000 2023-12-16T01:26:31.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.531+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa44156340 con 0x7faa440c2000 2023-12-16T01:26:31.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.531+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40014800 con 0x7faa440c2000 2023-12-16T01:26:31.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.531+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa44156900 con 0x7faa440c2000 2023-12-16T01:26:31.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.532+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa440740e0 con 0x7faa440c2000 2023-12-16T01:26:31.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.551+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7faa40014960 con 0x7faa440c2000 2023-12-16T01:26:31.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.551+0000 7faa3affd640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa2806ae90 0x7faa2806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:31.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.551+0000 7faa49c5d640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa2806ae90 0x7faa2806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:31.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.552+0000 7faa49c5d640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa2806ae90 0x7faa2806d350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa4414ccb0 tx=0x7faa34009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:31.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.554+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa40059720 con 0x7faa440c2000 2023-12-16T01:26:31.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.789+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7faa40055a60 con 0x7faa440c2000 2023-12-16T01:26:31.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.955+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa4414cce0 con 0x7faa440c2000 2023-12-16T01:26:31.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.961+0000 7faa3affd640 1 -- 172.21.15.107:0/143233239 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa40059080 con 0x7faa440c2000 2023-12-16T01:26:31.962 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:31.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa2806ae90 msgr2=0x7faa2806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa2806ae90 0x7faa2806d350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa4414ccb0 tx=0x7faa34009040 comp rx=0 tx=0).stop 2023-12-16T01:26:31.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 msgr2=0x7faa4414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:31.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 0x7faa4414fad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa4000efc0 tx=0x7faa4000c490 comp rx=0 tx=0).stop 2023-12-16T01:26:31.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 shutdown_connections 2023-12-16T01:26:31.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa44157f50 0x7faa44148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa2806ae90 0x7faa2806d350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa44151630 0x7faa441eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 --2- 172.21.15.107:0/143233239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa440c2000 0x7faa4414fad0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:31.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 >> 172.21.15.107:0/143233239 conn(0x7faa44061100 msgr2=0x7faa440c9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:31.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 shutdown_connections 2023-12-16T01:26:31.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:31.963+0000 7faa4c6c2640 1 -- 172.21.15.107:0/143233239 wait complete. 2023-12-16T01:26:31.975 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:26:32.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.074+0000 7ffa11c6e640 1 Processor -- start 2023-12-16T01:26:32.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.074+0000 7ffa11c6e640 1 -- start start 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.075+0000 7ffa11c6e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa0c151630 0x7ffa0c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.075+0000 7ffa11c6e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa0c157f50 0x7ffa0c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.075+0000 7ffa11c6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c0c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.075+0000 7ffa11c6e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c15b9c0 con 0x7ffa0c157f50 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.075+0000 7ffa11c6e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c1583c0 con 0x7ffa0c151630 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.075+0000 7ffa11c6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c15ab60 con 0x7ffa0c0ca130 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.076+0000 7ffa0affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa0c157f50 0x7ffa0c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.076+0000 7ffa0b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa0c151630 0x7ffa0c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.076+0000 7ffa0affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa0c157f50 0x7ffa0c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59892/0 (socket says 172.21.15.107:59892) 2023-12-16T01:26:32.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.076+0000 7ffa0affd640 1 -- 172.21.15.107:0/2712797204 learned_addr learned my addr 172.21.15.107:0/2712797204 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:32.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.076+0000 7ffa0bfff640 1 --2- 172.21.15.107:0/2712797204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c0c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.078+0000 7ffa0affd640 1 -- 172.21.15.107:0/2712797204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 msgr2=0x7ffa0c0c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:32.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.078+0000 7ffa0affd640 1 --2- 172.21.15.107:0/2712797204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c0c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.078+0000 7ffa0affd640 1 -- 172.21.15.107:0/2712797204 >> v2:172.21.15.157:3300/0 conn(0x7ffa0c151630 msgr2=0x7ffa0c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:32.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.078+0000 7ffa0affd640 1 --2- 172.21.15.107:0/2712797204 >> v2:172.21.15.157:3300/0 conn(0x7ffa0c151630 0x7ffa0c06f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.078+0000 7ffa0affd640 1 -- 172.21.15.107:0/2712797204 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c15ae40 con 0x7ffa0c157f50 2023-12-16T01:26:32.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.080+0000 7ffa0affd640 1 --2- 172.21.15.107:0/2712797204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c157f50 0x7ffa0c0c9bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c061ea0 tx=0x7ffa0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97257945dde646d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:32.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa0a7fc640 1 -- 172.21.15.107:0/2712797204 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00030860 con 0x7ffa0c157f50 2023-12-16T01:26:32.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa0a7fc640 1 -- 172.21.15.107:0/2712797204 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa000309c0 con 0x7ffa0c157f50 2023-12-16T01:26:32.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa0a7fc640 1 -- 172.21.15.107:0/2712797204 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00030d50 con 0x7ffa0c157f50 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2712797204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c157f50 msgr2=0x7ffa0c0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2712797204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c157f50 0x7ffa0c0c9bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c061ea0 tx=0x7ffa0002b9a0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2712797204 shutdown_connections 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2712797204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c157f50 0x7ffa0c0c9bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2712797204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c0c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2712797204 >> v2:172.21.15.157:3300/0 conn(0x7ffa0c151630 0x7ffa0c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2712797204 >> 172.21.15.107:0/2712797204 conn(0x7ffa0c061100 msgr2=0x7ffa0c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2712797204 shutdown_connections 2023-12-16T01:26:32.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.084+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2712797204 wait complete. 2023-12-16T01:26:32.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.086+0000 7ffa11c6e640 1 Processor -- start 2023-12-16T01:26:32.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.086+0000 7ffa11c6e640 1 -- start start 2023-12-16T01:26:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa11c6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c06cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa11c6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 0x7ffa0c06c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa11c6e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa0c157f50 0x7ffa0c1f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa11c6e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cab00 con 0x7ffa0c151630 2023-12-16T01:26:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa11c6e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1f2070 con 0x7ffa0c157f50 2023-12-16T01:26:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa11c6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c150fd0 con 0x7ffa0c0ca130 2023-12-16T01:26:32.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa0affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 0x7ffa0c06c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa0affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 0x7ffa0c06c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59898/0 (socket says 172.21.15.107:59898) 2023-12-16T01:26:32.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa0affd640 1 -- 172.21.15.107:0/2338541034 learned_addr learned my addr 172.21.15.107:0/2338541034 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:32.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa0bfff640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa0c157f50 0x7ffa0c1f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.087+0000 7ffa0b7fe640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c06cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.090+0000 7ffa0affd640 1 -- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 msgr2=0x7ffa0c06cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.090+0000 7ffa0affd640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c06cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.090+0000 7ffa0affd640 1 -- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa0c157f50 msgr2=0x7ffa0c1f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.090+0000 7ffa0affd640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa0c157f50 0x7ffa0c1f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.090+0000 7ffa0affd640 1 -- 172.21.15.107:0/2338541034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa000094d0 con 0x7ffa0c151630 2023-12-16T01:26:32.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.093+0000 7ffa0affd640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 0x7ffa0c06c040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa00000c00 tx=0x7ffa000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:32.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.096+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0003e070 con 0x7ffa0c151630 2023-12-16T01:26:32.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.096+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00039a10 con 0x7ffa0c151630 2023-12-16T01:26:32.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.096+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00039da0 con 0x7ffa0c151630 2023-12-16T01:26:32.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.096+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0cace0 con 0x7ffa0c151630 2023-12-16T01:26:32.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.096+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0c9e70 con 0x7ffa0c151630 2023-12-16T01:26:32.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.097+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0c4bf0 con 0x7ffa0c151630 2023-12-16T01:26:32.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.115+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ffa00055430 con 0x7ffa0c151630 2023-12-16T01:26:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.116+0000 7ff9f3fff640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f806ae90 0x7ff9f806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.116+0000 7ffa0b7fe640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f806ae90 0x7ff9f806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.116+0000 7ffa0b7fe640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f806ae90 0x7ff9f806d350 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009b40 tx=0x7ff9fc009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:32.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.119+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa0007b2d0 con 0x7ffa0c151630 2023-12-16T01:26:32.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.354+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ffa00077610 con 0x7ffa0c151630 2023-12-16T01:26:32.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.558+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa0c0740e0 con 0x7ffa0c151630 2023-12-16T01:26:32.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.570+0000 7ff9f3fff640 1 -- 172.21.15.107:0/2338541034 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6532 (secure 0 0 0) 0x7ffa00034030 con 0x7ffa0c151630 2023-12-16T01:26:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:32.572 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:26:16.623444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T01:26:32.572 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2023-12-16T01:26:32.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f806ae90 msgr2=0x7ff9f806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f806ae90 0x7ff9f806d350 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009b40 tx=0x7ff9fc009190 comp rx=0 tx=0).stop 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 msgr2=0x7ffa0c06c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 0x7ffa0c06c040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa00000c00 tx=0x7ffa000046c0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 shutdown_connections 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff9f806ae90 0x7ff9f806d350 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa0c157f50 0x7ffa0c1f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa0c151630 0x7ffa0c06c040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 --2- 172.21.15.107:0/2338541034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa0c0ca130 0x7ffa0c06cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.572+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 >> 172.21.15.107:0/2338541034 conn(0x7ffa0c061100 msgr2=0x7ffa0c0c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.573+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 shutdown_connections 2023-12-16T01:26:32.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.573+0000 7ffa11c6e640 1 -- 172.21.15.107:0/2338541034 wait complete. 2023-12-16T01:26:32.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:32.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.687+0000 7f0ee709b640 1 Processor -- start 2023-12-16T01:26:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.688+0000 7f0ee709b640 1 -- start start 2023-12-16T01:26:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.688+0000 7f0ee709b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ee00cced0 0x7f0ee0070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.688+0000 7f0ee709b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0070540 con 0x7f0ee00cc650 2023-12-16T01:26:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.688+0000 7f0ee709b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0158400 con 0x7f0ee00cd2b0 2023-12-16T01:26:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.688+0000 7f0ee709b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee015ad60 con 0x7f0ee00cced0 2023-12-16T01:26:32.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.689+0000 7f0ee4e37640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ee00cced0 0x7f0ee0070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.689+0000 7f0edffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0ee00cd2b0 0x7f0ee00cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60314/0 (socket says 172.21.15.107:60314) 2023-12-16T01:26:32.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.689+0000 7f0edffff640 1 -- 172.21.15.107:0/3344887635 learned_addr learned my addr 172.21.15.107:0/3344887635 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:32.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.691+0000 7f0edf7fe640 1 -- 172.21.15.107:0/3344887635 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191655595 0 0) 0x7f0ee0158400 con 0x7f0ee00cd2b0 2023-12-16T01:26:32.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.691+0000 7f0edf7fe640 1 -- 172.21.15.107:0/3344887635 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec8003520 con 0x7f0ee00cd2b0 2023-12-16T01:26:32.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.692+0000 7f0ee4e37640 1 -- 172.21.15.107:0/3344887635 >> v1:172.21.15.157:6789/0 conn(0x7f0ee00cd2b0 legacy=0x7f0ee00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.692+0000 7f0ee4e37640 1 -- 172.21.15.107:0/3344887635 >> v1:172.21.15.107:6789/0 conn(0x7f0ee00cc650 legacy=0x7f0ee01510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.692+0000 7f0ee4e37640 1 -- 172.21.15.107:0/3344887635 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee015b040 con 0x7f0ee00cced0 2023-12-16T01:26:32.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.695+0000 7f0ee4e37640 1 --2- 172.21.15.107:0/3344887635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee0070000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00097a0 tx=0x7f0ed002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170e206064a716b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0edf7fe640 1 -- 172.21.15.107:0/3344887635 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed002f810 con 0x7f0ee00cced0 2023-12-16T01:26:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0edf7fe640 1 -- 172.21.15.107:0/3344887635 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed002f970 con 0x7f0ee00cced0 2023-12-16T01:26:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0edf7fe640 1 -- 172.21.15.107:0/3344887635 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed002fd00 con 0x7f0ee00cced0 2023-12-16T01:26:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 -- 172.21.15.107:0/3344887635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 msgr2=0x7f0ee0070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 --2- 172.21.15.107:0/3344887635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee0070000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00097a0 tx=0x7f0ed002b9f0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 -- 172.21.15.107:0/3344887635 shutdown_connections 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 --2- 172.21.15.107:0/3344887635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee0070000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 -- 172.21.15.107:0/3344887635 >> 172.21.15.107:0/3344887635 conn(0x7f0ee0061660 msgr2=0x7f0ee0070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 -- 172.21.15.107:0/3344887635 shutdown_connections 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.700+0000 7f0ee709b640 1 -- 172.21.15.107:0/3344887635 wait complete. 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.701+0000 7f0ee709b640 1 Processor -- start 2023-12-16T01:26:32.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.701+0000 7f0ee709b640 1 -- start start 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.702+0000 7f0ee709b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ee00cc650 0x7f0ee006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.702+0000 7f0ee709b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee01432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.702+0000 7f0ee709b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ee00cd2b0 0x7f0ee01f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.702+0000 7f0ee709b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00acb80 con 0x7f0ee00cced0 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.702+0000 7f0ee709b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00ace60 con 0x7f0ee00cc650 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.702+0000 7f0ee709b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00ad140 con 0x7f0ee00cd2b0 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.703+0000 7f0edffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee01432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.703+0000 7f0ee4e37640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ee00cc650 0x7f0ee006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.703+0000 7f0ee5638640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ee00cd2b0 0x7f0ee01f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.703+0000 7f0edffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee01432a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59916/0 (socket says 172.21.15.107:59916) 2023-12-16T01:26:32.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.703+0000 7f0edffff640 1 -- 172.21.15.107:0/2374075661 learned_addr learned my addr 172.21.15.107:0/2374075661 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.706+0000 7f0edffff640 1 -- 172.21.15.107:0/2374075661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ee00cd2b0 msgr2=0x7f0ee01f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.706+0000 7f0edffff640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ee00cd2b0 0x7f0ee01f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.706+0000 7f0edffff640 1 -- 172.21.15.107:0/2374075661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ee00cc650 msgr2=0x7f0ee006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.706+0000 7f0edffff640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ee00cc650 0x7f0ee006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.706+0000 7f0edffff640 1 -- 172.21.15.107:0/2374075661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009400 con 0x7f0ee00cced0 2023-12-16T01:26:32.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.708+0000 7f0edffff640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee01432a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001eb0 tx=0x7f0ed400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.712+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4005ce0 con 0x7f0ee00cced0 2023-12-16T01:26:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.712+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4005e60 con 0x7f0ee00cced0 2023-12-16T01:26:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.712+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee00ad420 con 0x7f0ee00cced0 2023-12-16T01:26:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.712+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40072f0 con 0x7f0ee00cced0 2023-12-16T01:26:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.712+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee01f2930 con 0x7f0ee00cced0 2023-12-16T01:26:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.713+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee00ad660 con 0x7f0ee00cced0 2023-12-16T01:26:32.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.952+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0ed4007450 con 0x7f0ee00cced0 2023-12-16T01:26:32.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.952+0000 7f0edd7fa640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ecc06ae90 0x7f0ecc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:32.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.953+0000 7f0ee4e37640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ecc06ae90 0x7f0ecc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:32.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.953+0000 7f0ee4e37640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ecc06ae90 0x7f0ecc06d350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0036000 tx=0x7f0ed0008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:32.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.965+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ed4057d60 con 0x7f0ee00cced0 2023-12-16T01:26:32.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:32.965+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0ed40540a0 con 0x7f0ee00cced0 2023-12-16T01:26:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.132+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ee00ad660 con 0x7f0ee00cced0 2023-12-16T01:26:33.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.173+0000 7f0edd7fa640 1 -- 172.21.15.107:0/2374075661 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18553 (secure 0 0 0) 0x7f0ee00ad660 con 0x7f0ee00cced0 2023-12-16T01:26:33.175 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:33.175 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:26:31.279218+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ecc06ae90 msgr2=0x7f0ecc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ecc06ae90 0x7f0ecc06d350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0036000 tx=0x7f0ed0008030 comp rx=0 tx=0).stop 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 msgr2=0x7f0ee01432a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee01432a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001eb0 tx=0x7f0ed400c890 comp rx=0 tx=0).stop 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 shutdown_connections 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ee00cd2b0 0x7f0ee01f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ee00cced0 0x7f0ee01432a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f0ecc06ae90 0x7f0ecc06d350 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 --2- 172.21.15.107:0/2374075661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ee00cc650 0x7f0ee006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.175+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 >> 172.21.15.107:0/2374075661 conn(0x7f0ee0061660 msgr2=0x7f0ee0155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.176+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 shutdown_connections 2023-12-16T01:26:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.176+0000 7f0ee709b640 1 -- 172.21.15.107:0/2374075661 wait complete. 2023-12-16T01:26:33.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T01:25:45.757668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T01:25:47.362497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T01:25:52.786986+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T01:26:33.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:26:33.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.294+0000 7f74a4990640 1 Processor -- start 2023-12-16T01:26:33.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.294+0000 7f74a4990640 1 -- start start 2023-12-16T01:26:33.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f74a4990640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153890 0x7f74a015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f74a4990640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74a00ceef0 0x7f74a00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f74a4990640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a015a700 con 0x7f74a0153c70 2023-12-16T01:26:33.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f74a4990640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a00ca870 con 0x7f74a00ceef0 2023-12-16T01:26:33.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f74a4990640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0159af0 con 0x7f74a0153890 2023-12-16T01:26:33.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f749e59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153890 0x7f74a015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f7497fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f74a0153c70 0x7f74a00c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46386/0 (socket says 172.21.15.107:46386) 2023-12-16T01:26:33.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.295+0000 7f7497fff640 1 -- 172.21.15.107:0/3164591829 learned_addr learned my addr 172.21.15.107:0/3164591829 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:33.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.296+0000 7f749ed9d640 1 --2- 172.21.15.107:0/3164591829 >> v2:172.21.15.107:3300/0 conn(0x7f74a00ceef0 0x7f74a00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.298+0000 7f749e59c640 1 -- 172.21.15.107:0/3164591829 >> v2:172.21.15.107:3300/0 conn(0x7f74a00ceef0 msgr2=0x7f74a00cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:33.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.298+0000 7f749e59c640 1 --2- 172.21.15.107:0/3164591829 >> v2:172.21.15.107:3300/0 conn(0x7f74a00ceef0 0x7f74a00cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.298+0000 7f749e59c640 1 -- 172.21.15.107:0/3164591829 >> v1:172.21.15.107:6789/0 conn(0x7f74a0153c70 legacy=0x7f74a00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.298+0000 7f749e59c640 1 -- 172.21.15.107:0/3164591829 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0159dd0 con 0x7f74a0153890 2023-12-16T01:26:33.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.300+0000 7f749e59c640 1 --2- 172.21.15.107:0/3164591829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153890 0x7f74a015d950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74900097a0 tx=0x7f749002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf8b602450b67c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:33.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.304+0000 7f749dd9b640 1 -- 172.21.15.107:0/3164591829 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490030610 con 0x7f74a0153890 2023-12-16T01:26:33.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.304+0000 7f749dd9b640 1 -- 172.21.15.107:0/3164591829 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490030770 con 0x7f74a0153890 2023-12-16T01:26:33.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.304+0000 7f749dd9b640 1 -- 172.21.15.107:0/3164591829 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490030b00 con 0x7f74a0153890 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 -- 172.21.15.107:0/3164591829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153890 msgr2=0x7f74a015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 --2- 172.21.15.107:0/3164591829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153890 0x7f74a015d950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74900097a0 tx=0x7f749002b960 comp rx=0 tx=0).stop 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 -- 172.21.15.107:0/3164591829 shutdown_connections 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 --2- 172.21.15.107:0/3164591829 >> v2:172.21.15.107:3300/0 conn(0x7f74a00ceef0 0x7f74a00cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 --2- 172.21.15.107:0/3164591829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153890 0x7f74a015d950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 -- 172.21.15.107:0/3164591829 >> 172.21.15.107:0/3164591829 conn(0x7f74a006ba00 msgr2=0x7f74a006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 -- 172.21.15.107:0/3164591829 shutdown_connections 2023-12-16T01:26:33.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.305+0000 7f74a4990640 1 -- 172.21.15.107:0/3164591829 wait complete. 2023-12-16T01:26:33.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.306+0000 7f74a4990640 1 Processor -- start 2023-12-16T01:26:33.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.306+0000 7f74a4990640 1 -- start start 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f74a4990640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 0x7f74a01557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f74a4990640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a0153890 0x7f74a0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f74a4990640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153c70 0x7f74a01565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f74a4990640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a015ca30 con 0x7f74a00ceef0 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f74a4990640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0152fb0 con 0x7f74a0153890 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f74a4990640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01529f0 con 0x7f74a0153c70 2023-12-16T01:26:33.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f749e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 0x7f74a01557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f749e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 0x7f74a01557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59924/0 (socket says 172.21.15.107:59924) 2023-12-16T01:26:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.307+0000 7f749e59c640 1 -- 172.21.15.107:0/2792799333 learned_addr learned my addr 172.21.15.107:0/2792799333 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.308+0000 7f749ed9d640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153c70 0x7f74a01565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.308+0000 7f7497fff640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a0153890 0x7f74a0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.311+0000 7f749e59c640 1 -- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153c70 msgr2=0x7f74a01565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.311+0000 7f749e59c640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153c70 0x7f74a01565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.311+0000 7f749e59c640 1 -- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a0153890 msgr2=0x7f74a0154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.311+0000 7f749e59c640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a0153890 0x7f74a0154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.311+0000 7f749e59c640 1 -- 172.21.15.107:0/2792799333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490009400 con 0x7f74a00ceef0 2023-12-16T01:26:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.313+0000 7f749e59c640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 0x7f74a01557d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f749002bf70 tx=0x7f7490004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.317+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749003e040 con 0x7f74a00ceef0 2023-12-16T01:26:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.317+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490039a40 con 0x7f74a00ceef0 2023-12-16T01:26:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.317+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490039df0 con 0x7f74a00ceef0 2023-12-16T01:26:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.317+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a0152cd0 con 0x7f74a00ceef0 2023-12-16T01:26:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.317+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a01560a0 con 0x7f74a00ceef0 2023-12-16T01:26:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.318+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a0067500 con 0x7f74a00ceef0 2023-12-16T01:26:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.561+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7490043390 con 0x7f74a00ceef0 2023-12-16T01:26:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.561+0000 7f7496ffd640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f748006ae40 0x7f748006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.561+0000 7f7497fff640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f748006ae40 0x7f748006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.562+0000 7f7497fff640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f748006ae40 0x7f748006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74a0073a70 tx=0x7f7488007e80 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:33.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.576+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f749007a910 con 0x7f74a00ceef0 2023-12-16T01:26:33.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.576+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7490076c50 con 0x7f74a00ceef0 2023-12-16T01:26:33.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.748+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74a00c6070 con 0x7f74a00ceef0 2023-12-16T01:26:33.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.753+0000 7f7496ffd640 1 -- 172.21.15.107:0/2792799333 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74900490a0 con 0x7f74a00ceef0 2023-12-16T01:26:33.754 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:26:33.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f748006ae40 msgr2=0x7f748006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f748006ae40 0x7f748006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74a0073a70 tx=0x7f7488007e80 comp rx=0 tx=0).stop 2023-12-16T01:26:33.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 msgr2=0x7f74a01557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 0x7f74a01557d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f749002bf70 tx=0x7f7490004730 comp rx=0 tx=0).stop 2023-12-16T01:26:33.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 shutdown_connections 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74a0153c70 0x7f74a01565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f748006ae40 0x7f748006d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a0153890 0x7f74a0154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 --2- 172.21.15.107:0/2792799333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74a00ceef0 0x7f74a01557d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 >> 172.21.15.107:0/2792799333 conn(0x7f74a006ba00 msgr2=0x7f74a00cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 shutdown_connections 2023-12-16T01:26:33.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.755+0000 7f74a4990640 1 -- 172.21.15.107:0/2792799333 wait complete. 2023-12-16T01:26:33.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T01:26:33.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.874+0000 7fd231a89640 1 Processor -- start 2023-12-16T01:26:33.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.874+0000 7fd231a89640 1 -- start start 2023-12-16T01:26:33.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.875+0000 7fd231a89640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c0c2e40 0x7fd22c164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.875+0000 7fd231a89640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c06e0f0 con 0x7fd22c1537d0 2023-12-16T01:26:33.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.875+0000 7fd231a89640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c159710 con 0x7fd22c06f160 2023-12-16T01:26:33.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.875+0000 7fd231a89640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0c72d0 con 0x7fd22c0c2e40 2023-12-16T01:26:33.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.875+0000 7fd22b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd22c1537d0 0x7fd22c06a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46400/0 (socket says 172.21.15.107:46400) 2023-12-16T01:26:33.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.875+0000 7fd22b7fe640 1 -- 172.21.15.107:0/676063581 learned_addr learned my addr 172.21.15.107:0/676063581 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:33.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.876+0000 7fd22bfff640 1 --2- 172.21.15.107:0/676063581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c0c2e40 0x7fd22c164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832916104 0 0) 0x7fd22c06e0f0 con 0x7fd22c1537d0 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd214003520 con 0x7fd22c1537d0 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277265598 0 0) 0x7fd22c159710 con 0x7fd22c06f160 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c06e0f0 con 0x7fd22c06f160 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22bfff640 1 -- 172.21.15.107:0/676063581 >> v1:172.21.15.157:6789/0 conn(0x7fd22c06f160 legacy=0x7fd22c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22bfff640 1 -- 172.21.15.107:0/676063581 >> v1:172.21.15.107:6789/0 conn(0x7fd22c1537d0 legacy=0x7fd22c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.878+0000 7fd22bfff640 1 -- 172.21.15.107:0/676063581 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0c7590 con 0x7fd22c0c2e40 2023-12-16T01:26:33.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.880+0000 7fd22bfff640 1 --2- 172.21.15.107:0/676063581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c0c2e40 0x7fd22c164f90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd224009dc0 tx=0x7fd22402bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d240930dd20214d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:33.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.884+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22402cd50 con 0x7fd22c0c2e40 2023-12-16T01:26:33.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.884+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd224034440 con 0x7fd22c0c2e40 2023-12-16T01:26:33.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.884+0000 7fd22a7fc640 1 -- 172.21.15.107:0/676063581 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240347d0 con 0x7fd22c0c2e40 2023-12-16T01:26:33.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 -- 172.21.15.107:0/676063581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c0c2e40 msgr2=0x7fd22c164f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 --2- 172.21.15.107:0/676063581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c0c2e40 0x7fd22c164f90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd224009dc0 tx=0x7fd22402bfa0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 -- 172.21.15.107:0/676063581 shutdown_connections 2023-12-16T01:26:33.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 --2- 172.21.15.107:0/676063581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c0c2e40 0x7fd22c164f90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 -- 172.21.15.107:0/676063581 >> 172.21.15.107:0/676063581 conn(0x7fd22c0cbf60 msgr2=0x7fd22c0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:33.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 -- 172.21.15.107:0/676063581 shutdown_connections 2023-12-16T01:26:33.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.885+0000 7fd231a89640 1 -- 172.21.15.107:0/676063581 wait complete. 2023-12-16T01:26:33.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.886+0000 7fd231a89640 1 Processor -- start 2023-12-16T01:26:33.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.886+0000 7fd231a89640 1 -- start start 2023-12-16T01:26:33.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.887+0000 7fd231a89640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 0x7fd22c1ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.887+0000 7fd231a89640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd22c0c2e40 0x7fd22c15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.887+0000 7fd231a89640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c1537d0 0x7fd22c1f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:33.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.887+0000 7fd231a89640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1461d0 con 0x7fd22c06f160 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.887+0000 7fd231a89640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1497a0 con 0x7fd22c0c2e40 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.887+0000 7fd231a89640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1ef380 con 0x7fd22c1537d0 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.888+0000 7fd22b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 0x7fd22c1ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.888+0000 7fd22b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 0x7fd22c1ef810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59926/0 (socket says 172.21.15.107:59926) 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.888+0000 7fd22b7fe640 1 -- 172.21.15.107:0/3557512161 learned_addr learned my addr 172.21.15.107:0/3557512161 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.888+0000 7fd22affd640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd22c0c2e40 0x7fd22c15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.888+0000 7fd22bfff640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c1537d0 0x7fd22c1f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:33.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.891+0000 7fd22b7fe640 1 -- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c1537d0 msgr2=0x7fd22c1f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.891+0000 7fd22b7fe640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c1537d0 0x7fd22c1f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.891+0000 7fd22b7fe640 1 -- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd22c0c2e40 msgr2=0x7fd22c15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:33.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.891+0000 7fd22b7fe640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd22c0c2e40 0x7fd22c15ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:33.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.891+0000 7fd22b7fe640 1 -- 172.21.15.107:0/3557512161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224009a70 con 0x7fd22c06f160 2023-12-16T01:26:33.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.894+0000 7fd22b7fe640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 0x7fd22c1ef810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c410 tx=0x7fd21c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:33.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.897+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c005ce0 con 0x7fd22c06f160 2023-12-16T01:26:33.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.897+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c005e40 con 0x7fd22c06f160 2023-12-16T01:26:33.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.897+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0072d0 con 0x7fd22c06f160 2023-12-16T01:26:33.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.897+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c0b20c0 con 0x7fd22c06f160 2023-12-16T01:26:33.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.897+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c1491e0 con 0x7fd22c06f160 2023-12-16T01:26:33.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:33.898+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c067500 con 0x7fd22c06f160 2023-12-16T01:26:34.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.137+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd21c007430 con 0x7fd22c06f160 2023-12-16T01:26:34.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.138+0000 7fd213fff640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd21806ae90 0x7fd21806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:34.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.138+0000 7fd22affd640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd21806ae90 0x7fd21806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:34.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.138+0000 7fd22affd640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd21806ae90 0x7fd21806d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd220007fd0 tx=0x7fd220009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:34.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.152+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd21c057f20 con 0x7fd22c06f160 2023-12-16T01:26:34.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.152+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd21c054260 con 0x7fd22c06f160 2023-12-16T01:26:34.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.322+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd22c0c6780 con 0x7fd22c06f160 2023-12-16T01:26:34.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.326+0000 7fd213fff640 1 -- 172.21.15.107:0/3557512161 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd21c057880 con 0x7fd22c06f160 2023-12-16T01:26:34.327 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd21806ae90 msgr2=0x7fd21806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd21806ae90 0x7fd21806d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd220007fd0 tx=0x7fd220009040 comp rx=0 tx=0).stop 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 msgr2=0x7fd22c1ef810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 0x7fd22c1ef810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c410 tx=0x7fd21c00c8d0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 shutdown_connections 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd22c1537d0 0x7fd22c1f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd21806ae90 0x7fd21806d350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd22c0c2e40 0x7fd22c15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 --2- 172.21.15.107:0/3557512161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd22c06f160 0x7fd22c1ef810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 >> 172.21.15.107:0/3557512161 conn(0x7fd22c0cbf60 msgr2=0x7fd22c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:34.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 shutdown_connections 2023-12-16T01:26:34.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.329+0000 7fd231a89640 1 -- 172.21.15.107:0/3557512161 wait complete. 2023-12-16T01:26:34.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T01:26:34.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.441+0000 7f61f1bc9640 1 Processor -- start 2023-12-16T01:26:34.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.441+0000 7f61f1bc9640 1 -- start start 2023-12-16T01:26:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.442+0000 7f61f1bc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec158100 0x7f61ec162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.442+0000 7f61f1bc9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec0c7dd0 con 0x7f61ec0c51c0 2023-12-16T01:26:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.442+0000 7f61f1bc9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec158640 con 0x7f61ec0c4de0 2023-12-16T01:26:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.442+0000 7f61f1bc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec06ec40 con 0x7f61ec158100 2023-12-16T01:26:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.442+0000 7f61eaffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f61ec0c51c0 0x7f61ec1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46416/0 (socket says 172.21.15.107:46416) 2023-12-16T01:26:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.442+0000 7f61eaffd640 1 -- 172.21.15.107:0/2615252787 learned_addr learned my addr 172.21.15.107:0/2615252787 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:34.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.443+0000 7f61ebfff640 1 --2- 172.21.15.107:0/2615252787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec158100 0x7f61ec162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277548160 0 0) 0x7f61ec0c7dd0 con 0x7f61ec0c51c0 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d4003520 con 0x7f61ec0c51c0 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545898995 0 0) 0x7f61ec158640 con 0x7f61ec0c4de0 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ec0c7dd0 con 0x7f61ec0c4de0 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ebfff640 1 -- 172.21.15.107:0/2615252787 >> v1:172.21.15.157:6789/0 conn(0x7f61ec0c4de0 legacy=0x7f61ec06f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ebfff640 1 -- 172.21.15.107:0/2615252787 >> v1:172.21.15.107:6789/0 conn(0x7f61ec0c51c0 legacy=0x7f61ec1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.445+0000 7f61ebfff640 1 -- 172.21.15.107:0/2615252787 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec06fb10 con 0x7f61ec158100 2023-12-16T01:26:34.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.447+0000 7f61ebfff640 1 --2- 172.21.15.107:0/2615252787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec158100 0x7f61ec162ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009dc0 tx=0x7f61e402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb57d8f07b6b8a8f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.451+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e402ccd0 con 0x7f61ec158100 2023-12-16T01:26:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.451+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e402ce30 con 0x7f61ec158100 2023-12-16T01:26:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.451+0000 7f61ea7fc640 1 -- 172.21.15.107:0/2615252787 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4034660 con 0x7f61ec158100 2023-12-16T01:26:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 -- 172.21.15.107:0/2615252787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec158100 msgr2=0x7f61ec162ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/2615252787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec158100 0x7f61ec162ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009dc0 tx=0x7f61e402bf20 comp rx=0 tx=0).stop 2023-12-16T01:26:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 -- 172.21.15.107:0/2615252787 shutdown_connections 2023-12-16T01:26:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/2615252787 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec158100 0x7f61ec162ff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 -- 172.21.15.107:0/2615252787 >> 172.21.15.107:0/2615252787 conn(0x7f61ec0c7f60 msgr2=0x7f61ec0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 -- 172.21.15.107:0/2615252787 shutdown_connections 2023-12-16T01:26:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.452+0000 7f61f1bc9640 1 -- 172.21.15.107:0/2615252787 wait complete. 2023-12-16T01:26:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.453+0000 7f61f1bc9640 1 Processor -- start 2023-12-16T01:26:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 -- start start 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61ec0c4de0 0x7f61ec156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec0c51c0 0x7f61ec153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 0x7f61ec1f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0c3370 con 0x7f61ec158100 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec1533b0 con 0x7f61ec0c4de0 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.454+0000 7f61f1bc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0c3f10 con 0x7f61ec0c51c0 2023-12-16T01:26:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.455+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 0x7f61ec1f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.455+0000 7f61eaffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec0c51c0 0x7f61ec153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.455+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61ec0c4de0 0x7f61ec156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.455+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 0x7f61ec1f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59940/0 (socket says 172.21.15.107:59940) 2023-12-16T01:26:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.455+0000 7f61ebfff640 1 -- 172.21.15.107:0/1860074122 learned_addr learned my addr 172.21.15.107:0/1860074122 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.458+0000 7f61ebfff640 1 -- 172.21.15.107:0/1860074122 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec0c51c0 msgr2=0x7f61ec153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.458+0000 7f61ebfff640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec0c51c0 0x7f61ec153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.458+0000 7f61ebfff640 1 -- 172.21.15.107:0/1860074122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61ec0c4de0 msgr2=0x7f61ec156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.458+0000 7f61ebfff640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61ec0c4de0 0x7f61ec156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.458+0000 7f61ebfff640 1 -- 172.21.15.107:0/1860074122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4009a70 con 0x7f61ec158100 2023-12-16T01:26:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.461+0000 7f61ebfff640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 0x7f61ec1f2ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009ee0 tx=0x7f61e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:34.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.464+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e403e610 con 0x7f61ec158100 2023-12-16T01:26:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.464+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e403e790 con 0x7f61ec158100 2023-12-16T01:26:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.464+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e403eb40 con 0x7f61ec158100 2023-12-16T01:26:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.465+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec0c35c0 con 0x7f61ec158100 2023-12-16T01:26:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.465+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec0c48e0 con 0x7f61ec158100 2023-12-16T01:26:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.466+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec067500 con 0x7f61ec158100 2023-12-16T01:26:34.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.707+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f61e403b050 con 0x7f61ec158100 2023-12-16T01:26:34.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.707+0000 7f61d3fff640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f61d806aec0 0x7f61d806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:34.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.707+0000 7f61eb7fe640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f61d806aec0 0x7f61d806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:34.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.708+0000 7f61eb7fe640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f61d806aec0 0x7f61d806d380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61dc007fd0 tx=0x7f61dc009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:34.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.723+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f61e4034e40 con 0x7f61ec158100 2023-12-16T01:26:34.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.723+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f61e4077180 con 0x7f61ec158100 2023-12-16T01:26:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.902+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61ec1534f0 con 0x7f61ec158100 2023-12-16T01:26:34.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.907+0000 7f61d3fff640 1 -- 172.21.15.107:0/1860074122 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61e40390a0 con 0x7f61ec158100 2023-12-16T01:26:34.908 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-12-16T01:26:34.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f61d806aec0 msgr2=0x7f61d806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f61d806aec0 0x7f61d806d380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61dc007fd0 tx=0x7f61dc009040 comp rx=0 tx=0).stop 2023-12-16T01:26:34.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 msgr2=0x7f61ec1f2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:34.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 0x7f61ec1f2ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009ee0 tx=0x7f61e4004a40 comp rx=0 tx=0).stop 2023-12-16T01:26:34.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 shutdown_connections 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec158100 0x7f61ec1f2ea0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61ec0c51c0 0x7f61ec153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f61d806aec0 0x7f61d806d380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 --2- 172.21.15.107:0/1860074122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61ec0c4de0 0x7f61ec156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 >> 172.21.15.107:0/1860074122 conn(0x7f61ec0c7f60 msgr2=0x7f61ec072450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 shutdown_connections 2023-12-16T01:26:34.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:34.909+0000 7f61f1bc9640 1 -- 172.21.15.107:0/1860074122 wait complete. 2023-12-16T01:26:34.921 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T01:26:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.026+0000 7efd174e0640 1 Processor -- start 2023-12-16T01:26:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.026+0000 7efd174e0640 1 -- start start 2023-12-16T01:26:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.027+0000 7efd174e0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 0x7efd1006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.027+0000 7efd174e0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efd1006f160 0x7efd1006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.027+0000 7efd174e0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1006e0f0 con 0x7efd100c2e40 2023-12-16T01:26:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.027+0000 7efd174e0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd10159710 con 0x7efd1006f160 2023-12-16T01:26:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.027+0000 7efd174e0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd100c72d0 con 0x7efd101537d0 2023-12-16T01:26:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.028+0000 7efd14a7b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efd1006f160 0x7efd1006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.028+0000 7efd1527c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 0x7efd1006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.028+0000 7efd1527c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 0x7efd1006a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54470/0 (socket says 172.21.15.107:54470) 2023-12-16T01:26:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.028+0000 7efd1527c640 1 -- 172.21.15.107:0/1831548727 learned_addr learned my addr 172.21.15.107:0/1831548727 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:35.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.031+0000 7efd1527c640 1 -- 172.21.15.107:0/1831548727 >> v2:172.21.15.157:3300/0 conn(0x7efd1006f160 msgr2=0x7efd1006aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:35.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.031+0000 7efd1527c640 1 --2- 172.21.15.107:0/1831548727 >> v2:172.21.15.157:3300/0 conn(0x7efd1006f160 0x7efd1006aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.031+0000 7efd1527c640 1 -- 172.21.15.107:0/1831548727 >> v1:172.21.15.157:6789/0 conn(0x7efd100c2e40 legacy=0x7efd10159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.031+0000 7efd1527c640 1 -- 172.21.15.107:0/1831548727 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd100c7590 con 0x7efd101537d0 2023-12-16T01:26:35.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.033+0000 7efd1527c640 1 --2- 172.21.15.107:0/1831548727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 0x7efd1006a500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009e50 tx=0x7efd0c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2549c7cd089251ce server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:35.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.037+0000 7efd07fff640 1 -- 172.21.15.107:0/1831548727 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c02cb90 con 0x7efd101537d0 2023-12-16T01:26:35.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.037+0000 7efd07fff640 1 -- 172.21.15.107:0/1831548727 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c02ccf0 con 0x7efd101537d0 2023-12-16T01:26:35.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.037+0000 7efd07fff640 1 -- 172.21.15.107:0/1831548727 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c034610 con 0x7efd101537d0 2023-12-16T01:26:35.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 -- 172.21.15.107:0/1831548727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 msgr2=0x7efd1006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 --2- 172.21.15.107:0/1831548727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 0x7efd1006a500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009e50 tx=0x7efd0c02bff0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 -- 172.21.15.107:0/1831548727 shutdown_connections 2023-12-16T01:26:35.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 --2- 172.21.15.107:0/1831548727 >> v2:172.21.15.157:3300/0 conn(0x7efd1006f160 0x7efd1006aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 --2- 172.21.15.107:0/1831548727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd101537d0 0x7efd1006a500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 -- 172.21.15.107:0/1831548727 >> 172.21.15.107:0/1831548727 conn(0x7efd100cbf60 msgr2=0x7efd100cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:35.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 -- 172.21.15.107:0/1831548727 shutdown_connections 2023-12-16T01:26:35.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.038+0000 7efd174e0640 1 -- 172.21.15.107:0/1831548727 wait complete. 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.039+0000 7efd174e0640 1 Processor -- start 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.039+0000 7efd174e0640 1 -- start start 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd174e0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd1006f160 0x7efd101f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd174e0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 0x7efd100c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd174e0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd101537d0 0x7efd1014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd174e0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100c6460 con 0x7efd100c2e40 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd174e0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd101efee0 con 0x7efd101537d0 2023-12-16T01:26:35.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd174e0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd101ef2d0 con 0x7efd1006f160 2023-12-16T01:26:35.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd15a7d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd101537d0 0x7efd1014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.040+0000 7efd1527c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd1006f160 0x7efd101f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.041+0000 7efd14a7b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 0x7efd100c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.041+0000 7efd14a7b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 0x7efd100c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59942/0 (socket says 172.21.15.107:59942) 2023-12-16T01:26:35.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.041+0000 7efd15a7d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd101537d0 0x7efd1014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:45580/0 (socket says 172.21.15.107:45580) 2023-12-16T01:26:35.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.041+0000 7efd14a7b640 1 -- 172.21.15.107:0/912003521 learned_addr learned my addr 172.21.15.107:0/912003521 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.044+0000 7efd14a7b640 1 -- 172.21.15.107:0/912003521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd1006f160 msgr2=0x7efd101f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.044+0000 7efd14a7b640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd1006f160 0x7efd101f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.044+0000 7efd14a7b640 1 -- 172.21.15.107:0/912003521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd101537d0 msgr2=0x7efd1014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.044+0000 7efd14a7b640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd101537d0 0x7efd1014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.044+0000 7efd14a7b640 1 -- 172.21.15.107:0/912003521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c009b30 con 0x7efd100c2e40 2023-12-16T01:26:35.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.047+0000 7efd14a7b640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 0x7efd100c5a80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e9b0 tx=0x7efd0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.050+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00009670 con 0x7efd100c2e40 2023-12-16T01:26:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.050+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000c9a0 con 0x7efd100c2e40 2023-12-16T01:26:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.050+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd101ef5b0 con 0x7efd100c2e40 2023-12-16T01:26:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.050+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000cd50 con 0x7efd100c2e40 2023-12-16T01:26:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.051+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd101efb70 con 0x7efd100c2e40 2023-12-16T01:26:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.051+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1014ee80 con 0x7efd100c2e40 2023-12-16T01:26:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.071+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7efd00013470 con 0x7efd100c2e40 2023-12-16T01:26:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.071+0000 7efd05ffb640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efcf406ae70 0x7efcf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.071+0000 7efd1527c640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efcf406ae70 0x7efcf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.072+0000 7efd1527c640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efcf406ae70 0x7efcf406d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd0c035000 tx=0x7efd0c030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.074+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efd00058880 con 0x7efd100c2e40 2023-12-16T01:26:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.304+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7efd00054bc0 con 0x7efd100c2e40 2023-12-16T01:26:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.473+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd1014ee80 con 0x7efd100c2e40 2023-12-16T01:26:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.478+0000 7efd05ffb640 1 -- 172.21.15.107:0/912003521 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd1014ee80 con 0x7efd100c2e40 2023-12-16T01:26:35.479 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:26:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.480+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efcf406ae70 msgr2=0x7efcf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.480+0000 7efd174e0640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efcf406ae70 0x7efcf406d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd0c035000 tx=0x7efd0c030000 comp rx=0 tx=0).stop 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 msgr2=0x7efd100c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 0x7efd100c5a80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e9b0 tx=0x7efd0000ee70 comp rx=0 tx=0).stop 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 shutdown_connections 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efcf406ae70 0x7efcf406d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd101537d0 0x7efd1014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd100c2e40 0x7efd100c5a80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 --2- 172.21.15.107:0/912003521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd1006f160 0x7efd101f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 >> 172.21.15.107:0/912003521 conn(0x7efd100cbf60 msgr2=0x7efd100c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 shutdown_connections 2023-12-16T01:26:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.481+0000 7efd174e0640 1 -- 172.21.15.107:0/912003521 wait complete. 2023-12-16T01:26:35.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:26:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.591+0000 7f81446d3640 1 Processor -- start 2023-12-16T01:26:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.591+0000 7f81446d3640 1 -- start start 2023-12-16T01:26:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f81446d3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f813c0c5e60 0x7f813c1651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f81446d3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c159fa0 con 0x7f813c153be0 2023-12-16T01:26:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f81446d3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c153fc0 con 0x7f813c06fa00 2023-12-16T01:26:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f81446d3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0c3340 con 0x7f813c0c5e60 2023-12-16T01:26:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f8141c6e640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f813c06fa00 0x7f813c0c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:60332/0 (socket says 172.21.15.107:60332) 2023-12-16T01:26:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f8141c6e640 1 -- 172.21.15.107:0/1870241221 learned_addr learned my addr 172.21.15.107:0/1870241221 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.592+0000 7f8142c70640 1 --2- 172.21.15.107:0/1870241221 >> v2:172.21.15.107:3300/0 conn(0x7f813c0c5e60 0x7f813c1651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.595+0000 7f814146d640 1 -- 172.21.15.107:0/1870241221 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902680926 0 0) 0x7f813c153fc0 con 0x7f813c06fa00 2023-12-16T01:26:35.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.595+0000 7f814146d640 1 -- 172.21.15.107:0/1870241221 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8124003520 con 0x7f813c06fa00 2023-12-16T01:26:35.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.596+0000 7f8142c70640 1 -- 172.21.15.107:0/1870241221 >> v1:172.21.15.157:6789/0 conn(0x7f813c06fa00 legacy=0x7f813c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.596+0000 7f8142c70640 1 -- 172.21.15.107:0/1870241221 >> v1:172.21.15.107:6789/0 conn(0x7f813c153be0 legacy=0x7f813c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.596+0000 7f8142c70640 1 -- 172.21.15.107:0/1870241221 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c06b7b0 con 0x7f813c0c5e60 2023-12-16T01:26:35.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.600+0000 7f8142c70640 1 --2- 172.21.15.107:0/1870241221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c0c5e60 0x7f813c1651c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81340097a0 tx=0x7f813402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854e8c73ba96082b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:35.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.603+0000 7f814146d640 1 -- 172.21.15.107:0/1870241221 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134030610 con 0x7f813c0c5e60 2023-12-16T01:26:35.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f814146d640 1 -- 172.21.15.107:0/1870241221 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134030770 con 0x7f813c0c5e60 2023-12-16T01:26:35.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f814146d640 1 -- 172.21.15.107:0/1870241221 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134030b00 con 0x7f813c0c5e60 2023-12-16T01:26:35.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 -- 172.21.15.107:0/1870241221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c0c5e60 msgr2=0x7f813c1651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 --2- 172.21.15.107:0/1870241221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c0c5e60 0x7f813c1651c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81340097a0 tx=0x7f813402b960 comp rx=0 tx=0).stop 2023-12-16T01:26:35.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 -- 172.21.15.107:0/1870241221 shutdown_connections 2023-12-16T01:26:35.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 --2- 172.21.15.107:0/1870241221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c0c5e60 0x7f813c1651c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 -- 172.21.15.107:0/1870241221 >> 172.21.15.107:0/1870241221 conn(0x7f813c0c7f60 msgr2=0x7f813c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:35.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 -- 172.21.15.107:0/1870241221 shutdown_connections 2023-12-16T01:26:35.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.604+0000 7f81446d3640 1 -- 172.21.15.107:0/1870241221 wait complete. 2023-12-16T01:26:35.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.605+0000 7f81446d3640 1 Processor -- start 2023-12-16T01:26:35.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 -- start start 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 0x7f813c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f813c0c5e60 0x7f813c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f813c153be0 0x7f813c14cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c1583d0 con 0x7f813c06fa00 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c1ef000 con 0x7f813c0c5e60 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.606+0000 7f81446d3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c159970 con 0x7f813c153be0 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.607+0000 7f814246f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 0x7f813c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.607+0000 7f8141c6e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f813c0c5e60 0x7f813c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.607+0000 7f814246f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 0x7f813c158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59970/0 (socket says 172.21.15.107:59970) 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.607+0000 7f814246f640 1 -- 172.21.15.107:0/90317825 learned_addr learned my addr 172.21.15.107:0/90317825 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:35.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.607+0000 7f8142c70640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f813c153be0 0x7f813c14cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.610+0000 7f814246f640 1 -- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f813c153be0 msgr2=0x7f813c14cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.610+0000 7f814246f640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f813c153be0 0x7f813c14cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.610+0000 7f814246f640 1 -- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f813c0c5e60 msgr2=0x7f813c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:35.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.610+0000 7f814246f640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f813c0c5e60 0x7f813c14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:35.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.610+0000 7f814246f640 1 -- 172.21.15.107:0/90317825 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134009400 con 0x7f813c06fa00 2023-12-16T01:26:35.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.612+0000 7f814246f640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 0x7f813c158dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c340 tx=0x7f812c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:35.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.615+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0052d0 con 0x7f813c06fa00 2023-12-16T01:26:35.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.615+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c005430 con 0x7f813c06fa00 2023-12-16T01:26:35.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.615+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c003850 con 0x7f813c06fa00 2023-12-16T01:26:35.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.615+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c159c50 con 0x7f813c06fa00 2023-12-16T01:26:35.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.616+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c1ef5a0 con 0x7f813c06fa00 2023-12-16T01:26:35.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.617+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c074490 con 0x7f813c06fa00 2023-12-16T01:26:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.635+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f812c0039b0 con 0x7f813c06fa00 2023-12-16T01:26:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.635+0000 7f813affd640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f812806ae40 0x7f812806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.636+0000 7f8141c6e640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f812806ae40 0x7f812806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.636+0000 7f8141c6e640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f812806ae40 0x7f812806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f813c1525c0 tx=0x7f8130001a90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:35.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.639+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f812c001060 con 0x7f813c06fa00 2023-12-16T01:26:35.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:35.873+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f812c0540a0 con 0x7f813c06fa00 2023-12-16T01:26:36.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.093+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f813c067500 con 0x7f813c06fa00 2023-12-16T01:26:36.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.105+0000 7f813affd640 1 -- 172.21.15.107:0/90317825 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6532 (secure 0 0 0) 0x7f812c017020 con 0x7f813c06fa00 2023-12-16T01:26:36.106 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:36.106 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:26:16.623444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T01:26:36.106 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2023-12-16T01:26:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f812806ae40 msgr2=0x7f812806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f812806ae40 0x7f812806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f813c1525c0 tx=0x7f8130001a90 comp rx=0 tx=0).stop 2023-12-16T01:26:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 msgr2=0x7f813c158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 0x7f813c158dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c340 tx=0x7f812c00c800 comp rx=0 tx=0).stop 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 shutdown_connections 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f813c153be0 0x7f813c14cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f812806ae40 0x7f812806d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f813c0c5e60 0x7f813c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 --2- 172.21.15.107:0/90317825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f813c06fa00 0x7f813c158dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 >> 172.21.15.107:0/90317825 conn(0x7f813c0c7f60 msgr2=0x7f813c071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 shutdown_connections 2023-12-16T01:26:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.107+0000 7f81446d3640 1 -- 172.21.15.107:0/90317825 wait complete. 2023-12-16T01:26:36.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:26:36.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.218+0000 7f198b13e640 1 Processor -- start 2023-12-16T01:26:36.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.218+0000 7f198b13e640 1 -- start start 2023-12-16T01:26:36.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.219+0000 7f198b13e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19840728b0 0x7f19840c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.219+0000 7f198b13e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f19840c5fd0 0x7f1984161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.219+0000 7f198b13e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198415b6e0 con 0x7f1984151510 2023-12-16T01:26:36.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.219+0000 7f198b13e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198415a880 con 0x7f19840728b0 2023-12-16T01:26:36.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.219+0000 7f198b13e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840c6460 con 0x7f19840c5fd0 2023-12-16T01:26:36.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.219+0000 7f1983fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19840728b0 0x7f19840c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.220+0000 7f19896db640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f19840c5fd0 0x7f1984161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.220+0000 7f1983fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19840728b0 0x7f19840c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59972/0 (socket says 172.21.15.107:59972) 2023-12-16T01:26:36.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.220+0000 7f1983fff640 1 -- 172.21.15.107:0/2514396320 learned_addr learned my addr 172.21.15.107:0/2514396320 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:36.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.222+0000 7f1983fff640 1 -- 172.21.15.107:0/2514396320 >> v2:172.21.15.157:3300/0 conn(0x7f19840c5fd0 msgr2=0x7f1984161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:36.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.222+0000 7f1983fff640 1 --2- 172.21.15.107:0/2514396320 >> v2:172.21.15.157:3300/0 conn(0x7f19840c5fd0 0x7f1984161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.222+0000 7f1983fff640 1 -- 172.21.15.107:0/2514396320 >> v1:172.21.15.157:6789/0 conn(0x7f1984151510 legacy=0x7f19840cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.222+0000 7f1983fff640 1 -- 172.21.15.107:0/2514396320 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198406f7e0 con 0x7f19840728b0 2023-12-16T01:26:36.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.224+0000 7f1983fff640 1 --2- 172.21.15.107:0/2514396320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840728b0 0x7f19840c5a90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1984070bf0 tx=0x7f197802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15db487e077bc67e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:36.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.227+0000 7f19837fe640 1 -- 172.21.15.107:0/2514396320 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978030860 con 0x7f19840728b0 2023-12-16T01:26:36.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f19837fe640 1 -- 172.21.15.107:0/2514396320 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780309c0 con 0x7f19840728b0 2023-12-16T01:26:36.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f19837fe640 1 -- 172.21.15.107:0/2514396320 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978030d50 con 0x7f19840728b0 2023-12-16T01:26:36.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 -- 172.21.15.107:0/2514396320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840728b0 msgr2=0x7f19840c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 --2- 172.21.15.107:0/2514396320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840728b0 0x7f19840c5a90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1984070bf0 tx=0x7f197802b9a0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 -- 172.21.15.107:0/2514396320 shutdown_connections 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 --2- 172.21.15.107:0/2514396320 >> v2:172.21.15.157:3300/0 conn(0x7f19840c5fd0 0x7f1984161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 --2- 172.21.15.107:0/2514396320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840728b0 0x7f19840c5a90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 -- 172.21.15.107:0/2514396320 >> 172.21.15.107:0/2514396320 conn(0x7f198406cd60 msgr2=0x7f198406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 -- 172.21.15.107:0/2514396320 shutdown_connections 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.228+0000 7f198b13e640 1 -- 172.21.15.107:0/2514396320 wait complete. 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.229+0000 7f198b13e640 1 Processor -- start 2023-12-16T01:26:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 -- start start 2023-12-16T01:26:36.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19840728b0 0x7f1984155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 0x7f1984156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1984151510 0x7f198414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c4850 con 0x7f19840c5fd0 2023-12-16T01:26:36.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984157460 con 0x7f1984151510 2023-12-16T01:26:36.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.230+0000 7f198b13e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c1a90 con 0x7f19840728b0 2023-12-16T01:26:36.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.231+0000 7f1983fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 0x7f1984156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.231+0000 7f19896db640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1984151510 0x7f198414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.231+0000 7f1988eda640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19840728b0 0x7f1984155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.231+0000 7f1983fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 0x7f1984156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59988/0 (socket says 172.21.15.107:59988) 2023-12-16T01:26:36.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.231+0000 7f1983fff640 1 -- 172.21.15.107:0/1978114539 learned_addr learned my addr 172.21.15.107:0/1978114539 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:36.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.235+0000 7f1983fff640 1 -- 172.21.15.107:0/1978114539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19840728b0 msgr2=0x7f1984155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.235+0000 7f1983fff640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19840728b0 0x7f1984155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.235+0000 7f1983fff640 1 -- 172.21.15.107:0/1978114539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1984151510 msgr2=0x7f198414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.235+0000 7f1983fff640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1984151510 0x7f198414bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.235+0000 7f1983fff640 1 -- 172.21.15.107:0/1978114539 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780094d0 con 0x7f19840c5fd0 2023-12-16T01:26:36.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.237+0000 7f1983fff640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 0x7f1984156f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1978000c00 tx=0x7f1978004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.240+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978039a90 con 0x7f19840c5fd0 2023-12-16T01:26:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.240+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978039bf0 con 0x7f19840c5fd0 2023-12-16T01:26:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.240+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19840c1d70 con 0x7f19840c5fd0 2023-12-16T01:26:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.240+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978043410 con 0x7f19840c5fd0 2023-12-16T01:26:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.240+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19840c4d80 con 0x7f19840c5fd0 2023-12-16T01:26:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.241+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984067500 con 0x7f19840c5fd0 2023-12-16T01:26:36.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.480+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f197804d440 con 0x7f19840c5fd0 2023-12-16T01:26:36.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.480+0000 7f19817fa640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f197006aec0 0x7f197006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.481+0000 7f1988eda640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f197006aec0 0x7f197006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.481+0000 7f1988eda640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f197006aec0 0x7f197006d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f197c001f10 tx=0x7f197c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:36.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.495+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f197807abd0 con 0x7f19840c5fd0 2023-12-16T01:26:36.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.495+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1978076f10 con 0x7f19840c5fd0 2023-12-16T01:26:36.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.663+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1984071530 con 0x7f19840c5fd0 2023-12-16T01:26:36.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.700+0000 7f19817fa640 1 -- 172.21.15.107:0/1978114539 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18553 (secure 0 0 0) 0x7f1978034090 con 0x7f19840c5fd0 2023-12-16T01:26:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:36.703 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:26:31.279218+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:26:36.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f197006aec0 msgr2=0x7f197006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f197006aec0 0x7f197006d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f197c001f10 tx=0x7f197c009040 comp rx=0 tx=0).stop 2023-12-16T01:26:36.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 msgr2=0x7f1984156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 0x7f1984156f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1978000c00 tx=0x7f1978004730 comp rx=0 tx=0).stop 2023-12-16T01:26:36.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 shutdown_connections 2023-12-16T01:26:36.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f197006aec0 0x7f197006d380 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1984151510 0x7f198414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19840c5fd0 0x7f1984156f20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 --2- 172.21.15.107:0/1978114539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19840728b0 0x7f1984155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 >> 172.21.15.107:0/1978114539 conn(0x7f198406cd60 msgr2=0x7f198414d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:36.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 shutdown_connections 2023-12-16T01:26:36.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.703+0000 7f198b13e640 1 -- 172.21.15.107:0/1978114539 wait complete. 2023-12-16T01:26:36.716 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:26:36.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.815+0000 7f94ceb01640 1 Processor -- start 2023-12-16T01:26:36.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.815+0000 7f94ceb01640 1 -- start start 2023-12-16T01:26:36.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.816+0000 7f94ceb01640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f94c80710e0 0x7f94c8153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.816+0000 7f94ceb01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 0x7f94c81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.816+0000 7f94ceb01640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80ca6c0 con 0x7f94c8070d00 2023-12-16T01:26:36.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.816+0000 7f94ceb01640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c8159880 con 0x7f94c80710e0 2023-12-16T01:26:36.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.816+0000 7f94ceb01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8159b60 con 0x7f94c80c7700 2023-12-16T01:26:36.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.817+0000 7f94c7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f94c80710e0 0x7f94c8153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.817+0000 7f94cd09e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 0x7f94c81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.817+0000 7f94cd09e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 0x7f94c81538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54508/0 (socket says 172.21.15.107:54508) 2023-12-16T01:26:36.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.817+0000 7f94cd09e640 1 -- 172.21.15.107:0/1065126024 learned_addr learned my addr 172.21.15.107:0/1065126024 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:36.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.820+0000 7f94cd09e640 1 -- 172.21.15.107:0/1065126024 >> v2:172.21.15.157:3300/0 conn(0x7f94c80710e0 msgr2=0x7f94c8153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:36.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.820+0000 7f94cd09e640 1 --2- 172.21.15.107:0/1065126024 >> v2:172.21.15.157:3300/0 conn(0x7f94c80710e0 0x7f94c8153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.820+0000 7f94cd09e640 1 -- 172.21.15.107:0/1065126024 >> v1:172.21.15.157:6789/0 conn(0x7f94c8070d00 legacy=0x7f94c815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.820+0000 7f94cd09e640 1 -- 172.21.15.107:0/1065126024 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8159e40 con 0x7f94c80c7700 2023-12-16T01:26:36.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.822+0000 7f94cd09e640 1 --2- 172.21.15.107:0/1065126024 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 0x7f94c81538c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009e50 tx=0x7f94c002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3b686a5b9afa6f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94c77fe640 1 -- 172.21.15.107:0/1065126024 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c002cb90 con 0x7f94c80c7700 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94c77fe640 1 -- 172.21.15.107:0/1065126024 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c002ccf0 con 0x7f94c80c7700 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94c77fe640 1 -- 172.21.15.107:0/1065126024 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0034610 con 0x7f94c80c7700 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 -- 172.21.15.107:0/1065126024 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 msgr2=0x7f94c81538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 --2- 172.21.15.107:0/1065126024 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 0x7f94c81538c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009e50 tx=0x7f94c002bff0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 -- 172.21.15.107:0/1065126024 shutdown_connections 2023-12-16T01:26:36.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 --2- 172.21.15.107:0/1065126024 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c80c7700 0x7f94c81538c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 --2- 172.21.15.107:0/1065126024 >> v2:172.21.15.157:3300/0 conn(0x7f94c80710e0 0x7f94c8153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 -- 172.21.15.107:0/1065126024 >> 172.21.15.107:0/1065126024 conn(0x7f94c806ab30 msgr2=0x7f94c806ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:36.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 -- 172.21.15.107:0/1065126024 shutdown_connections 2023-12-16T01:26:36.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.826+0000 7f94ceb01640 1 -- 172.21.15.107:0/1065126024 wait complete. 2023-12-16T01:26:36.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.827+0000 7f94ceb01640 1 Processor -- start 2023-12-16T01:26:36.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.827+0000 7f94ceb01640 1 -- start start 2023-12-16T01:26:36.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.828+0000 7f94ceb01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c8070d00 0x7f94c80cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.828+0000 7f94ceb01640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c80710e0 0x7f94c814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.828+0000 7f94ceb01640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c80c7700 0x7f94c815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:36.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.828+0000 7f94ceb01640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815d0d0 con 0x7f94c80c7700 2023-12-16T01:26:36.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.828+0000 7f94ceb01640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815aee0 con 0x7f94c80710e0 2023-12-16T01:26:36.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.828+0000 7f94ceb01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c81eef00 con 0x7f94c8070d00 2023-12-16T01:26:36.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.829+0000 7f94cc89d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c8070d00 0x7f94c80cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.829+0000 7f94cd09e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c80c7700 0x7f94c815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.829+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c80710e0 0x7f94c814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:36.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.829+0000 7f94cd09e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c80c7700 0x7f94c815bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59994/0 (socket says 172.21.15.107:59994) 2023-12-16T01:26:36.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.829+0000 7f94cd09e640 1 -- 172.21.15.107:0/19762784 learned_addr learned my addr 172.21.15.107:0/19762784 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:36.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.832+0000 7f94cc89d640 1 -- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c80710e0 msgr2=0x7f94c814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.832+0000 7f94cc89d640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c80710e0 0x7f94c814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.832+0000 7f94cc89d640 1 -- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c80c7700 msgr2=0x7f94c815bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:36.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.832+0000 7f94cc89d640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c80c7700 0x7f94c815bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:36.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.832+0000 7f94cc89d640 1 -- 172.21.15.107:0/19762784 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c0009b30 con 0x7f94c8070d00 2023-12-16T01:26:36.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.835+0000 7f94cc89d640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c8070d00 0x7f94c80cd4d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c3c0 tx=0x7f94bc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:36.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.838+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0052d0 con 0x7f94c8070d00 2023-12-16T01:26:36.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.839+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc005450 con 0x7f94c8070d00 2023-12-16T01:26:36.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.839+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c815b130 con 0x7f94c8070d00 2023-12-16T01:26:36.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.839+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc007260 con 0x7f94c8070d00 2023-12-16T01:26:36.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.839+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c815b6f0 con 0x7f94c8070d00 2023-12-16T01:26:36.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:36.840+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c8067500 con 0x7f94c8070d00 2023-12-16T01:26:37.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.084+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f94bc0073c0 con 0x7f94c8070d00 2023-12-16T01:26:37.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.085+0000 7f94c57fa640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f94ac06ae90 0x7f94ac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:37.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.085+0000 7f94c7fff640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f94ac06ae90 0x7f94ac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:37.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.085+0000 7f94c7fff640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f94ac06ae90 0x7f94ac06d350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94c814fc40 tx=0x7f94b4009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:37.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.088+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f94bc057e70 con 0x7f94c8070d00 2023-12-16T01:26:37.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.099+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f94bc0541b0 con 0x7f94c8070d00 2023-12-16T01:26:37.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.307+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94c8152680 con 0x7f94c8070d00 2023-12-16T01:26:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.328+0000 7f94c57fa640 1 -- 172.21.15.107:0/19762784 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6532 (secure 0 0 0) 0x7f94bc020090 con 0x7f94c8070d00 2023-12-16T01:26:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:26:37.329 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:26:16.623444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T01:26:37.330 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f94ac06ae90 msgr2=0x7f94ac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f94ac06ae90 0x7f94ac06d350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94c814fc40 tx=0x7f94b4009190 comp rx=0 tx=0).stop 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c8070d00 msgr2=0x7f94c80cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c8070d00 0x7f94c80cd4d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c3c0 tx=0x7f94bc00c880 comp rx=0 tx=0).stop 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 shutdown_connections 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c80c7700 0x7f94c815bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f94ac06ae90 0x7f94ac06d350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c80710e0 0x7f94c814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:37.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 --2- 172.21.15.107:0/19762784 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c8070d00 0x7f94c80cd4d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:37.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 >> 172.21.15.107:0/19762784 conn(0x7f94c806ab30 msgr2=0x7f94c8073ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:37.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 shutdown_connections 2023-12-16T01:26:37.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:37.330+0000 7f94ceb01640 1 -- 172.21.15.107:0/19762784 wait complete. 2023-12-16T01:26:37.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T01:25:48.506111+0000', 'modified': '2023-12-16T01:26:16.623444+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6837/1933485264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 1933485264}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 1933485264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-16T01:26:37.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T01:26:37.945 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-16T01:26:38.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 Processor -- start 2023-12-16T01:26:38.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 -- start start 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c151630 0x7fd00c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd00c157f50 0x7fd00c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c15b9c0 con 0x7fd00c0ca130 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c15ab60 con 0x7fd00c157f50 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.057+0000 7fd0126cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c15ae40 con 0x7fd00c151630 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.058+0000 7fd00b7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd00c157f50 0x7fd00c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.058+0000 7fd00b7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd00c157f50 0x7fd00c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60000/0 (socket says 172.21.15.107:60000) 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.058+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3641620040 learned_addr learned my addr 172.21.15.107:0/3641620040 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.058+0000 7fd00bfff640 1 --2- 172.21.15.107:0/3641620040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c151630 0x7fd00c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.060+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3641620040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c151630 msgr2=0x7fd00c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.060+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/3641620040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c151630 0x7fd00c06f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.060+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3641620040 >> v1:172.21.15.157:6789/0 conn(0x7fd00c0ca130 legacy=0x7fd00c0c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.060+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3641620040 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c15b120 con 0x7fd00c157f50 2023-12-16T01:26:38.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.062+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/3641620040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c0c9bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009870 tx=0x7fcffc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990cb945c07ec8c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd00affd640 1 -- 172.21.15.107:0/3641620040 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc02f840 con 0x7fd00c157f50 2023-12-16T01:26:38.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd00affd640 1 -- 172.21.15.107:0/3641620040 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc02f9a0 con 0x7fd00c157f50 2023-12-16T01:26:38.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd00affd640 1 -- 172.21.15.107:0/3641620040 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc02fd30 con 0x7fd00c157f50 2023-12-16T01:26:38.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 -- 172.21.15.107:0/3641620040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 msgr2=0x7fd00c0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 --2- 172.21.15.107:0/3641620040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c0c9bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009870 tx=0x7fcffc02ba20 comp rx=0 tx=0).stop 2023-12-16T01:26:38.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 -- 172.21.15.107:0/3641620040 shutdown_connections 2023-12-16T01:26:38.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 --2- 172.21.15.107:0/3641620040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c0c9bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 --2- 172.21.15.107:0/3641620040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c151630 0x7fd00c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 -- 172.21.15.107:0/3641620040 >> 172.21.15.107:0/3641620040 conn(0x7fd00c061100 msgr2=0x7fd00c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 -- 172.21.15.107:0/3641620040 shutdown_connections 2023-12-16T01:26:38.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.066+0000 7fd0126cf640 1 -- 172.21.15.107:0/3641620040 wait complete. 2023-12-16T01:26:38.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.067+0000 7fd0126cf640 1 Processor -- start 2023-12-16T01:26:38.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 -- start start 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c0ca130 0x7fd00c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c151630 0x7fd00c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c157330 con 0x7fd00c157f50 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c155e50 con 0x7fd00c151630 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.068+0000 7fd0126cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c1f0300 con 0x7fd00c0ca130 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.069+0000 7fd010c6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.069+0000 7fd00b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c151630 0x7fd00c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.069+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c0ca130 0x7fd00c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.069+0000 7fd010c6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c1f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60004/0 (socket says 172.21.15.107:60004) 2023-12-16T01:26:38.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.069+0000 7fd010c6c640 1 -- 172.21.15.107:0/2796045099 learned_addr learned my addr 172.21.15.107:0/2796045099 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.072+0000 7fd010c6c640 1 -- 172.21.15.107:0/2796045099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c0ca130 msgr2=0x7fd00c156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.072+0000 7fd010c6c640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c0ca130 0x7fd00c156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.072+0000 7fd010c6c640 1 -- 172.21.15.107:0/2796045099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c151630 msgr2=0x7fd00c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.072+0000 7fd010c6c640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c151630 0x7fd00c159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.072+0000 7fd010c6c640 1 -- 172.21.15.107:0/2796045099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0094d0 con 0x7fd00c157f50 2023-12-16T01:26:38.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.075+0000 7fd010c6c640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c1f0790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd00400c6e0 tx=0x7fd00400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.078+0000 7fd008ff9640 1 -- 172.21.15.107:0/2796045099 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004003b70 con 0x7fd00c157f50 2023-12-16T01:26:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.078+0000 7fd008ff9640 1 -- 172.21.15.107:0/2796045099 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004003cf0 con 0x7fd00c157f50 2023-12-16T01:26:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.078+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c1effd0 con 0x7fd00c157f50 2023-12-16T01:26:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.078+0000 7fd008ff9640 1 -- 172.21.15.107:0/2796045099 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004005310 con 0x7fd00c157f50 2023-12-16T01:26:38.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.078+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c14ad10 con 0x7fd00c157f50 2023-12-16T01:26:38.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.081+0000 7fd015261740 1 Processor -- start 2023-12-16T01:26:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.081+0000 7fd015261740 1 -- start start 2023-12-16T01:26:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd015261740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084580 0x5654da086b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da089170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd015261740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d9ff7090 con 0x5654da084580 2023-12-16T01:26:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d9ff4780 con 0x5654da084dc0 2023-12-16T01:26:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654d9ff0070 con 0x5654da084960 2023-12-16T01:26:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da089170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.082+0000 7fd00b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.083+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da089170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54534/0 (socket says 172.21.15.107:54534) 2023-12-16T01:26:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.083+0000 7fd00bfff640 1 -- 172.21.15.107:0/3498638148 learned_addr learned my addr 172.21.15.107:0/3498638148 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.085+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 msgr2=0x5654da089170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.085+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da089170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.085+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3498638148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084580 msgr2=0x5654da086b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.085+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084580 0x5654da086b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.085+0000 7fd00b7fe640 1 -- 172.21.15.107:0/3498638148 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654d9fb2d00 con 0x5654da084dc0 2023-12-16T01:26:38.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.085+0000 7fd00bfff640 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da089170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:26:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.087+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0896b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd00c06e870 tx=0x7fcffc02e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e14cfe058666617 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.090+0000 7fcff1ffb640 1 -- 172.21.15.107:0/3498638148 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc03b040 con 0x5654da084dc0 2023-12-16T01:26:38.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.090+0000 7fcff1ffb640 1 -- 172.21.15.107:0/3498638148 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc02fd30 con 0x5654da084dc0 2023-12-16T01:26:38.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.090+0000 7fcff1ffb640 1 -- 172.21.15.107:0/3498638148 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc02fea0 con 0x5654da084dc0 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 -- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 msgr2=0x5654da0896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0896b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd00c06e870 tx=0x7fcffc02e000 comp rx=0 tx=0).stop 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 -- 172.21.15.107:0/3498638148 shutdown_connections 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0896b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da089170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 --2- 172.21.15.107:0/3498638148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084580 0x5654da086b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 -- 172.21.15.107:0/3498638148 >> 172.21.15.107:0/3498638148 conn(0x5654da085d60 msgr2=0x5654da088410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 -- 172.21.15.107:0/3498638148 shutdown_connections 2023-12-16T01:26:38.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.091+0000 7fd015261740 1 -- 172.21.15.107:0/3498638148 wait complete. 2023-12-16T01:26:38.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.092+0000 7fd015261740 1 -- start start 2023-12-16T01:26:38.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.092+0000 7fd015261740 1 Processor -- start 2023-12-16T01:26:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084960 0x5654da082eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da0d0fd0 0x5654da0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d9fa9e70 con 0x5654da084960 2023-12-16T01:26:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d9fa9b10 con 0x5654da0d0fd0 2023-12-16T01:26:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654d9f6f2e0 con 0x5654da084dc0 2023-12-16T01:26:38.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd015261740 10 client.0 _ll_register_callbacks cb 0x5654d9d01ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T01:26:38.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.093+0000 7fd00b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da0d0fd0 0x5654da0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.094+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54546/0 (socket says 172.21.15.107:54546) 2023-12-16T01:26:38.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.094+0000 7fd00bfff640 1 -- 172.21.15.107:0/2090981622 learned_addr learned my addr 172.21.15.107:0/2090981622 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.097+0000 7fd00bfff640 1 -- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da0d0fd0 msgr2=0x5654da0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.097+0000 7fd00bfff640 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da0d0fd0 0x5654da0cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.097+0000 7fd00bfff640 1 -- 172.21.15.107:0/2090981622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084960 msgr2=0x5654da082eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.097+0000 7fd00bfff640 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084960 0x5654da082eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.097+0000 7fd00bfff640 1 -- 172.21.15.107:0/2090981622 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c15b120 con 0x5654da084dc0 2023-12-16T01:26:38.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.099+0000 7fd00bfff640 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0cbc80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0000149d0 tx=0x7fd000014e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2545ce0efe9fe6de server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.099+0000 7fcfeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.157:3301/0 2023-12-16T01:26:38.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.101+0000 7fd008ff9640 1 -- 172.21.15.107:0/2796045099 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd004005470 con 0x7fd00c157f50 2023-12-16T01:26:38.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.101+0000 7fd008ff9640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcff806ae00 0x7fcff806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.101+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcff806ae00 0x7fcff806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.102+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcff806ae00 0x7fcff806d2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5654d9fe7f80 tx=0x7fcffc008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.102+0000 7fcfeaffd640 1 -- 172.21.15.107:0/2090981622 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000004240 con 0x5654da084dc0 2023-12-16T01:26:38.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.102+0000 7fcfeaffd640 1 -- 172.21.15.107:0/2090981622 <== mon.2 v2:172.21.15.157:3301/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd0000043a0 con 0x5654da084dc0 2023-12-16T01:26:38.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.102+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654d9fe8f00 con 0x5654da084dc0 2023-12-16T01:26:38.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.104+0000 7fcfeaffd640 1 -- 172.21.15.107:0/2090981622 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd000004560 con 0x5654da084dc0 2023-12-16T01:26:38.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.104+0000 7fd015261740 10 client.4628 fetch_fsmap learned FSMap version 10 2023-12-16T01:26:38.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.104+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x5654d9fee6f0 con 0x5654da084dc0 2023-12-16T01:26:38.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.105+0000 7fd008ff9640 1 -- 172.21.15.107:0/2796045099 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd004058050 con 0x7fd00c157f50 2023-12-16T01:26:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fcfeaffd640 1 -- 172.21.15.107:0/2090981622 <== mon.2 v2:172.21.15.157:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654d9fe8f00 con 0x5654da084dc0 2023-12-16T01:26:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fcfeaffd640 1 -- 172.21.15.107:0/2090981622 <== mon.2 v2:172.21.15.157:3301/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fd000011040 con 0x5654da084dc0 2023-12-16T01:26:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fd015261740 10 client.4628 fetch_fsmap finished waiting for FSMap version 10 2023-12-16T01:26:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fd015261740 10 client.4628 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-16T01:26:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fd015261740 20 client.4628 populate_metadata read hostname 'smithi107' 2023-12-16T01:26:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fd015261740 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da0ccdc0 0x5654da0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fd015261740 4 client.4628 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T01:26:38.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.108+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 --> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654d9fe8c20 con 0x5654da0ccdc0 2023-12-16T01:26:38.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.109+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da0ccdc0 0x5654da0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.112+0000 7fd00b7fe640 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da0ccdc0 0x5654da0afde0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3f96c30a89139f server_cookie=f1d8ab1748324581 in_seq=0 out_seq=0 2023-12-16T01:26:38.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.112+0000 7fcfeaffd640 10 client.4628 ms_handle_connect on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fcfeaffd640 1 -- 172.21.15.107:0/2090981622 <== mds.0 v2:172.21.15.157:6836/1933485264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654d9fe8c20 con 0x5654da0ccdc0 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fcfeaffd640 10 client.4628 handle_command_reply: tid=0 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 client.4628 shutdown 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 msgr2=0x5654da0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0cbc80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0000149d0 tx=0x7fd000014e90 comp rx=0 tx=0).stop 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 shutdown_connections 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da0ccdc0 0x5654da0afde0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da0d0fd0 0x5654da0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0cbc80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 --2- 172.21.15.107:0/2090981622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da084960 0x5654da082eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fcfeaffd640 0 client.4628 ms_handle_reset on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 >> 172.21.15.107:0/2090981622 conn(0x5654da084580 msgr2=0x5654da089c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 shutdown_connections 2023-12-16T01:26:38.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.132+0000 7fd015261740 1 -- 172.21.15.107:0/2090981622 wait complete. 2023-12-16T01:26:38.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.133+0000 7fd015261740 20 client.4628 trim_cache size 0 max 16384 2023-12-16T01:26:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.148+0000 7fd015261740 1 Processor -- start 2023-12-16T01:26:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.148+0000 7fd015261740 1 -- start start 2023-12-16T01:26:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.149+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084960 0x5654da0f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.149+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.149+0000 7fd015261740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.149+0000 7fd015261740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654da0b3630 con 0x5654da0d0fd0 2023-12-16T01:26:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.149+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654da084150 con 0x5654da084960 2023-12-16T01:26:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.149+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654da0e1670 con 0x5654da084dc0 2023-12-16T01:26:38.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.168+0000 7fd010c6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.168+0000 7fd010c6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60026/0 (socket says 172.21.15.107:60026) 2023-12-16T01:26:38.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.168+0000 7fd010c6c640 1 -- 172.21.15.107:0/1372564093 learned_addr learned my addr 172.21.15.107:0/1372564093 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.170+0000 7fd010c6c640 1 -- 172.21.15.107:0/1372564093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 msgr2=0x5654da0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.170+0000 7fd010c6c640 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.170+0000 7fd010c6c640 1 -- 172.21.15.107:0/1372564093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084960 msgr2=0x5654da0f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.170+0000 7fd010c6c640 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084960 0x5654da0f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.170+0000 7fd010c6c640 1 -- 172.21.15.107:0/1372564093 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654d9f8bd70 con 0x5654da0d0fd0 2023-12-16T01:26:38.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.172+0000 7fd010c6c640 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0cab30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd00405fe00 tx=0x7fd00405c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e8a8cb03a3630d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fcff27fc640 1 -- 172.21.15.107:0/1372564093 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004054760 con 0x5654da0d0fd0 2023-12-16T01:26:38.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fcff27fc640 1 -- 172.21.15.107:0/1372564093 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0040548c0 con 0x5654da0d0fd0 2023-12-16T01:26:38.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fcff27fc640 1 -- 172.21.15.107:0/1372564093 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040600e0 con 0x5654da0d0fd0 2023-12-16T01:26:38.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fd015261740 1 -- 172.21.15.107:0/1372564093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 msgr2=0x5654da0cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fd015261740 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0cab30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd00405fe00 tx=0x7fd00405c270 comp rx=0 tx=0).stop 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fd015261740 1 -- 172.21.15.107:0/1372564093 shutdown_connections 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.176+0000 7fd015261740 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0cab30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084dc0 0x5654da0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 --2- 172.21.15.107:0/1372564093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084960 0x5654da0f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 -- 172.21.15.107:0/1372564093 >> 172.21.15.107:0/1372564093 conn(0x5654da084580 msgr2=0x5654da0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 -- 172.21.15.107:0/1372564093 shutdown_connections 2023-12-16T01:26:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 -- 172.21.15.107:0/1372564093 wait complete. 2023-12-16T01:26:38.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 -- start start 2023-12-16T01:26:38.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.177+0000 7fd015261740 1 Processor -- start 2023-12-16T01:26:38.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654da0d44b0 con 0x5654da0d0fd0 2023-12-16T01:26:38.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654da0d3fe0 con 0x5654da084dc0 2023-12-16T01:26:38.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654da0e1290 con 0x5654da084960 2023-12-16T01:26:38.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.178+0000 7fd015261740 10 client.0 _ll_register_callbacks cb 0x5654da0882e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T01:26:38.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.179+0000 7fd010c6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.179+0000 7fd010c6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60042/0 (socket says 172.21.15.107:60042) 2023-12-16T01:26:38.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.179+0000 7fd010c6c640 1 -- 172.21.15.107:0/838632574 learned_addr learned my addr 172.21.15.107:0/838632574 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.182+0000 7fd010c6c640 1 -- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 msgr2=0x5654da0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.182+0000 7fd010c6c640 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.182+0000 7fd010c6c640 1 -- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 msgr2=0x5654da0d3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:26:38.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.182+0000 7fd010c6c640 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.182+0000 7fd010c6c640 1 -- 172.21.15.107:0/838632574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c14ad10 con 0x5654da0d0fd0 2023-12-16T01:26:38.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.184+0000 7fd010c6c640 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0a5620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd00405fe00 tx=0x7fd004001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824ce6db845f5f26 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.184+0000 7fcfeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-12-16T01:26:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.187+0000 7fcfeaffd640 1 -- 172.21.15.107:0/838632574 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004073070 con 0x5654da0d0fd0 2023-12-16T01:26:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.187+0000 7fcfeaffd640 1 -- 172.21.15.107:0/838632574 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd00405fea0 con 0x5654da0d0fd0 2023-12-16T01:26:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.187+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcffc02fd30 con 0x5654da0d0fd0 2023-12-16T01:26:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.188+0000 7fcfeaffd640 1 -- 172.21.15.107:0/838632574 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd004060060 con 0x5654da0d0fd0 2023-12-16T01:26:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.189+0000 7fd015261740 10 client.4749 fetch_fsmap learned FSMap version 10 2023-12-16T01:26:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.189+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x5654d9fb1560 con 0x5654da0d0fd0 2023-12-16T01:26:38.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fcfeaffd640 1 -- 172.21.15.107:0/838632574 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc02fd30 con 0x5654da0d0fd0 2023-12-16T01:26:38.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fcfeaffd640 1 -- 172.21.15.107:0/838632574 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fd004019020 con 0x5654da0d0fd0 2023-12-16T01:26:38.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fd015261740 10 client.4749 fetch_fsmap finished waiting for FSMap version 10 2023-12-16T01:26:38.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fd015261740 10 client.4749 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-16T01:26:38.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fd015261740 20 client.4749 populate_metadata read hostname 'smithi107' 2023-12-16T01:26:38.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fd015261740 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da132440 0x5654da132820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fd015261740 4 client.4749 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T01:26:38.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.192+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 --> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5654d9cf06c0 con 0x5654da132440 2023-12-16T01:26:38.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.193+0000 7fd00bfff640 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da132440 0x5654da132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.196+0000 7fd00bfff640 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da132440 0x5654da132820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83842366a28c797 server_cookie=67beaa4a0e42ca0d in_seq=0 out_seq=0 2023-12-16T01:26:38.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.196+0000 7fcfeaffd640 10 client.4749 ms_handle_connect on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:38.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.199+0000 7fcfeaffd640 1 -- 172.21.15.107:0/838632574 <== mds.0 v2:172.21.15.157:6836/1933485264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5654d9cf06c0 con 0x5654da132440 2023-12-16T01:26:38.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.199+0000 7fcfeaffd640 10 client.4749 handle_command_reply: tid=0 2023-12-16T01:26:38.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.199+0000 7fd015261740 1 client.4749 shutdown 2023-12-16T01:26:38.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 msgr2=0x5654da0a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0a5620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd00405fe00 tx=0x7fd004001790 comp rx=0 tx=0).stop 2023-12-16T01:26:38.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 shutdown_connections 2023-12-16T01:26:38.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:6836/1933485264,v1:172.21.15.157:6837/1933485264] conn(0x5654da132440 0x5654da132820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5654da0d0fd0 0x5654da0a5620 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5654da084dc0 0x5654da0d3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 --2- 172.21.15.107:0/838632574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5654da084960 0x5654da0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fcfeaffd640 0 client.4749 ms_handle_reset on v2:172.21.15.157:6836/1933485264 2023-12-16T01:26:38.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 >> 172.21.15.107:0/838632574 conn(0x5654da084580 msgr2=0x5654da0f0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 shutdown_connections 2023-12-16T01:26:38.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 1 -- 172.21.15.107:0/838632574 wait complete. 2023-12-16T01:26:38.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd015261740 20 client.4749 trim_cache size 0 max 16384 2023-12-16T01:26:38.205 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:26:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "928cabe9-0ef6-4aba-be14-8cbcf8a73b88", 2023-12-16T01:26:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2023-12-16T01:26:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4273, 2023-12-16T01:26:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-12-16T01:26:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-12-16T01:26:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-12-16T01:26:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 48.539899290999998, 2023-12-16T01:26:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 10, 2023-12-16T01:26:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 28, 2023-12-16T01:26:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 26, 2023-12-16T01:26:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 56.222155999999998 2023-12-16T01:26:38.210 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:26:38.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcff806ae00 msgr2=0x7fcff806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcff806ae00 0x7fcff806d2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5654d9fe7f80 tx=0x7fcffc008030 comp rx=0 tx=0).stop 2023-12-16T01:26:38.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 msgr2=0x7fd00c1f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c1f0790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd00400c6e0 tx=0x7fd00400cba0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 shutdown_connections 2023-12-16T01:26:38.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd00c157f50 0x7fd00c1f0790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcff806ae00 0x7fcff806d2c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c151630 0x7fd00c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 --2- 172.21.15.107:0/2796045099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd00c0ca130 0x7fd00c156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.200+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 >> 172.21.15.107:0/2796045099 conn(0x7fd00c061100 msgr2=0x7fd00c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.201+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 shutdown_connections 2023-12-16T01:26:38.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.201+0000 7fd0126cf640 1 -- 172.21.15.107:0/2796045099 wait complete. 2023-12-16T01:26:38.215 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-16T01:26:38.231 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-16T01:26:38.231 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-16T01:26:38.231 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-16T01:26:38.231 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T01:26:38.231 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:38.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:38.232 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-12-16T01:26:38.247 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-16T01:26:38.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:38.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T01:26:38.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:38.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2023-12-16T01:26:38.430 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-16T01:26:38.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T01:26:38.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.531+0000 7ffab1009640 1 Processor -- start 2023-12-16T01:26:38.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.531+0000 7ffab1009640 1 -- start start 2023-12-16T01:26:38.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.532+0000 7ffab1009640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffaac0bff00 0x7ffaac159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.532+0000 7ffab1009640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac072b60 con 0x7ffaac1501c0 2023-12-16T01:26:38.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.532+0000 7ffab1009640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac0c1a90 con 0x7ffaac156e60 2023-12-16T01:26:38.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.532+0000 7ffab1009640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac1572d0 con 0x7ffaac0bff00 2023-12-16T01:26:38.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.532+0000 7ffaaad9d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ffaac1501c0 0x7ffaac072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46432/0 (socket says 172.21.15.107:46432) 2023-12-16T01:26:38.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.532+0000 7ffaaad9d640 1 -- 172.21.15.107:0/2973640581 learned_addr learned my addr 172.21.15.107:0/2973640581 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:26:38.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.533+0000 7ffaaa59c640 1 --2- 172.21.15.107:0/2973640581 >> v2:172.21.15.157:3300/0 conn(0x7ffaac0bff00 0x7ffaac159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.535+0000 7ffaa9d9b640 1 -- 172.21.15.107:0/2973640581 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946959072 0 0) 0x7ffaac072b60 con 0x7ffaac1501c0 2023-12-16T01:26:38.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.535+0000 7ffaa9d9b640 1 -- 172.21.15.107:0/2973640581 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa94003520 con 0x7ffaac1501c0 2023-12-16T01:26:38.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.535+0000 7ffaaa59c640 1 -- 172.21.15.107:0/2973640581 >> v1:172.21.15.157:6789/0 conn(0x7ffaac156e60 legacy=0x7ffaac071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.535+0000 7ffaaa59c640 1 -- 172.21.15.107:0/2973640581 >> v1:172.21.15.107:6789/0 conn(0x7ffaac1501c0 legacy=0x7ffaac072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.535+0000 7ffaaa59c640 1 -- 172.21.15.107:0/2973640581 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0c1d30 con 0x7ffaac0bff00 2023-12-16T01:26:38.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.538+0000 7ffaaa59c640 1 --2- 172.21.15.107:0/2973640581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac0bff00 0x7ffaac159860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00097a0 tx=0x7ffaa002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5172ec475a223d50 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.542+0000 7ffaa9d9b640 1 -- 172.21.15.107:0/2973640581 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa002f810 con 0x7ffaac0bff00 2023-12-16T01:26:38.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.542+0000 7ffaa9d9b640 1 -- 172.21.15.107:0/2973640581 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa002f970 con 0x7ffaac0bff00 2023-12-16T01:26:38.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.542+0000 7ffaa9d9b640 1 -- 172.21.15.107:0/2973640581 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa002fd00 con 0x7ffaac0bff00 2023-12-16T01:26:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 -- 172.21.15.107:0/2973640581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac0bff00 msgr2=0x7ffaac159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 --2- 172.21.15.107:0/2973640581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac0bff00 0x7ffaac159860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00097a0 tx=0x7ffaa002b9f0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 -- 172.21.15.107:0/2973640581 shutdown_connections 2023-12-16T01:26:38.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 --2- 172.21.15.107:0/2973640581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac0bff00 0x7ffaac159860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 -- 172.21.15.107:0/2973640581 >> 172.21.15.107:0/2973640581 conn(0x7ffaac06cd60 msgr2=0x7ffaac06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:38.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 -- 172.21.15.107:0/2973640581 shutdown_connections 2023-12-16T01:26:38.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.543+0000 7ffab1009640 1 -- 172.21.15.107:0/2973640581 wait complete. 2023-12-16T01:26:38.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 Processor -- start 2023-12-16T01:26:38.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 -- start start 2023-12-16T01:26:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 0x7ffaac1e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac1501c0 0x7ffaac0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaac156e60 0x7ffaac0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0c9720 con 0x7ffaac0bff00 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac06efb0 con 0x7ffaac1501c0 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.545+0000 7ffab1009640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0c93d0 con 0x7ffaac156e60 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.546+0000 7ffaaad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 0x7ffaac1e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.546+0000 7ffaaa59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac1501c0 0x7ffaac0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.546+0000 7ffaab59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaac156e60 0x7ffaac0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.546+0000 7ffaaad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 0x7ffaac1e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60048/0 (socket says 172.21.15.107:60048) 2023-12-16T01:26:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.546+0000 7ffaaad9d640 1 -- 172.21.15.107:0/2167870887 learned_addr learned my addr 172.21.15.107:0/2167870887 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:26:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.550+0000 7ffaaad9d640 1 -- 172.21.15.107:0/2167870887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaac156e60 msgr2=0x7ffaac0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.550+0000 7ffaaad9d640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaac156e60 0x7ffaac0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.550+0000 7ffaaad9d640 1 -- 172.21.15.107:0/2167870887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac1501c0 msgr2=0x7ffaac0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:38.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.550+0000 7ffaaad9d640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac1501c0 0x7ffaac0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:38.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.550+0000 7ffaaad9d640 1 -- 172.21.15.107:0/2167870887 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009400 con 0x7ffaac0bff00 2023-12-16T01:26:38.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.552+0000 7ffaaad9d640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 0x7ffaac1e2b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00cbf0 tx=0x7ffa9c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.555+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00ad50 con 0x7ffaac0bff00 2023-12-16T01:26:38.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.555+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c012400 con 0x7ffaac0bff00 2023-12-16T01:26:38.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.555+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac0ca5c0 con 0x7ffaac0bff00 2023-12-16T01:26:38.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.555+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c012790 con 0x7ffaac0bff00 2023-12-16T01:26:38.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.556+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac1ed4d0 con 0x7ffaac0bff00 2023-12-16T01:26:38.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.557+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac0c77e0 con 0x7ffaac0bff00 2023-12-16T01:26:38.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.799+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ffa9c007070 con 0x7ffaac0bff00 2023-12-16T01:26:38.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.800+0000 7ffa937fe640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffa9806ae90 0x7ffa9806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:26:38.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.800+0000 7ffaaa59c640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffa9806ae90 0x7ffa9806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:26:38.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.800+0000 7ffaaa59c640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffa9806ae90 0x7ffa9806d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0036000 tx=0x7ffaa0008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:26:38.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.813+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa9c058900 con 0x7ffaac0bff00 2023-12-16T01:26:38.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:38.813+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ffa9c054c40 con 0x7ffaac0bff00 2023-12-16T01:26:39.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.019+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffaac0c9990 con 0x7ffaac0bff00 2023-12-16T01:26:39.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.023+0000 7ffa937fe640 1 -- 172.21.15.107:0/2167870887 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffa9c017070 con 0x7ffaac0bff00 2023-12-16T01:26:39.026 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffa9806ae90 msgr2=0x7ffa9806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffa9806ae90 0x7ffa9806d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0036000 tx=0x7ffaa0008030 comp rx=0 tx=0).stop 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 msgr2=0x7ffaac1e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 0x7ffaac1e2b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00cbf0 tx=0x7ffa9c00a430 comp rx=0 tx=0).stop 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 shutdown_connections 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaac156e60 0x7ffaac0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffa9806ae90 0x7ffa9806d350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac1501c0 0x7ffaac0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 --2- 172.21.15.107:0/2167870887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaac0bff00 0x7ffaac1e2b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 >> 172.21.15.107:0/2167870887 conn(0x7ffaac06cd60 msgr2=0x7ffaac06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 shutdown_connections 2023-12-16T01:26:39.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:39.025+0000 7ffab1009640 1 -- 172.21.15.107:0/2167870887 wait complete. 2023-12-16T01:26:39.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T01:26:39.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T01:26:39.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2023-12-16T01:26:39.037 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T01:26:39.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:39.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T01:26:39.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T01:26:39.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T01:26:39.038 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T01:26:39.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.038 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2023-12-16T01:26:39.053 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T01:26:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T01:26:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T01:26:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T01:26:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-12-16T01:26:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2023-12-16T01:26:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-12-16T01:26:39.055 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T01:26:39.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T01:26:39.055 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:39.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.161 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T01:26:39.185 INFO:teuthology.orchestra.run.smithi107.stdout:1 2023-12-16T01:26:39.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.187 DEBUG:teuthology.orchestra.run.smithi107:> route 2023-12-16T01:26:39.244 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2023-12-16T01:26:39.245 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T01:26:39.245 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T01:26:39.245 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T01:26:39.245 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T01:26:39.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.245 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:39.245 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:39.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T01:26:39.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T01:26:39.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T01:26:39.246 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:39.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.340 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-12-16T01:26:39.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.355 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2023-12-16T01:26:39.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.410 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:39.410 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:39.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:39.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T01:26:39.410 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:39.492 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T01:26:39.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.492 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:39.492 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:39.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T01:26:39.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T01:26:39.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T01:26:39.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T01:26:39.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T01:26:39.493 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:39.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.617 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-12-16T01:26:39.617 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-12-16T01:26:39.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2023-12-16T01:26:39.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T01:26:39.617 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-12-16T01:26:39.659 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-16T01:26:39.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T01:26:39.659 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T01:26:39.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T01:26:39.716 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:39.771 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T01:26:39.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:39.839 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:39.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:39.897 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:39.949 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-16T01:26:39.949 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-16T01:26:39.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:40.018 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:40.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:40.078 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:41.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:41.260 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:41.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:41.318 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:42.472 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:42.500 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:42.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:42.558 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:43.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:43.738 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:43.794 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:43.794 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:43.794 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:43.795 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:43.796 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:43.797 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:43.797 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:43.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:43.797 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:44.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:44.980 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:45.036 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:45.036 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:45.036 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:45.037 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:45.038 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:45.039 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:45.039 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:45.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:45.039 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:45.596 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:2023-12-16T01:26:45.515+0000 64d8100 -1 init, newargv = 0x81dec50 newargc=15 2023-12-16T01:26:45.628 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[98038]: starting ceph client 2023-12-16T01:26:46.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-12-16T01:26:46.221 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2023-12-16T01:26:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T01:26:46.279 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:26:46.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:46.281 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-12-16T01:26:46.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[98038]: starting fuse 2023-12-16T01:26:46.312 INFO:teuthology.orchestra.run.smithi107.stdout:42 2023-12-16T01:26:46.312 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-12-16T01:26:46.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo stdin-killer -- python3 -c ' 2023-12-16T01:26:46.312 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2023-12-16T01:26:46.312 DEBUG:teuthology.orchestra.run.smithi107:> import re 2023-12-16T01:26:46.312 DEBUG:teuthology.orchestra.run.smithi107:> import os 2023-12-16T01:26:46.312 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2023-12-16T01:26:46.312 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-16T01:26:46.313 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2023-12-16T01:26:46.314 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2023-12-16T01:26:46.314 DEBUG:teuthology.orchestra.run.smithi107:> return f 2023-12-16T01:26:46.314 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-16T01:26:46.314 DEBUG:teuthology.orchestra.run.smithi107:> 2023-12-16T01:26:46.314 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.0")) 2023-12-16T01:26:46.314 DEBUG:teuthology.orchestra.run.smithi107:> ' 2023-12-16T01:26:46.434 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.0.98038.asok 2023-12-16T01:26:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-16T01:26:46.444 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.98038.asok 2023-12-16T01:26:46.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:46.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.98038.asok status 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "6d933094a156ec7587742e5aa25fba5ba27ec678", 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)", 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "0", 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-16T01:26:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "98038", 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4764, 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4764 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-12-16T01:26:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2324727263 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2324727263 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4764 172.21.15.107:0/2324727263", 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "172.21.15.107:0/2324727263", 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 10, 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 28, 2023-12-16T01:26:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2023-12-16T01:26:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2023-12-16T01:26:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2023-12-16T01:26:46.680 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:26:46.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:46.686 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2023-12-16T01:26:46.687 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:46.738 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2023-12-16T01:26:46.738 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:46.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:26:46.739 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:46.789 INFO:teuthology.run_tasks:Running task workunit... 2023-12-16T01:26:46.803 INFO:tasks.workunit:Pulling workunits from ref 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:26:46.803 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T01:26:46.803 INFO:tasks.workunit:timeout=3h 2023-12-16T01:26:46.804 INFO:tasks.workunit:cleanup=True 2023-12-16T01:26:46.804 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 2ah/42d Inode: 1 Links: 2 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:fusefs_t:s0 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T01:26:46.819 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-12-16 01:25:49.935930553 +0000 2023-12-16T01:26:46.820 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-12-16 01:26:04.545145637 +0000 2023-12-16T01:26:46.820 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2023-12-16T01:26:46.820 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-16T01:26:46.820 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-16T01:26:47.213 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T01:26:47.229 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T01:26:59.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:26:59.194 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:27:29.308 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:27:29.313 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2023-12-16T01:27:36.695 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-12-16T01:27:36.696 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T01:27:36.700 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T01:27:36.725 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T01:27:36.727 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T01:27:36.727 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T01:27:37.404 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T01:27:37.475 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T01:27:37.514 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T01:27:37.516 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T01:27:37.516 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T01:27:37.557 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T01:27:37.560 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:27:37.560 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T01:27:37.615 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-12-16T01:27:37.616 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-12-16T01:27:37.617 DEBUG:teuthology.orchestra.run.smithi107:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-12-16T01:27:37.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ dbench 1 2023-12-16T01:27:37.876 INFO:tasks.workunit.client.0.smithi107.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-16T01:27:37.876 INFO:tasks.workunit.client.0.smithi107.stdout: 2023-12-16T01:27:37.876 INFO:tasks.workunit.client.0.smithi107.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-16T01:27:37.886 INFO:tasks.workunit.client.0.smithi107.stdout:0 of 1 processes prepared for launch 0 sec 2023-12-16T01:27:37.986 INFO:tasks.workunit.client.0.smithi107.stdout:1 of 1 processes prepared for launch 0 sec 2023-12-16T01:27:37.986 INFO:tasks.workunit.client.0.smithi107.stdout:releasing clients 2023-12-16T01:27:38.986 INFO:tasks.workunit.client.0.smithi107.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 34.420 ms 2023-12-16T01:27:39.986 INFO:tasks.workunit.client.0.smithi107.stdout: 1 113 2.62 MB/sec warmup 2 sec latency 205.531 ms 2023-12-16T01:27:40.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 155 2.18 MB/sec warmup 3 sec latency 191.026 ms 2023-12-16T01:27:41.986 INFO:tasks.workunit.client.0.smithi107.stdout: 1 199 1.96 MB/sec warmup 4 sec latency 177.661 ms 2023-12-16T01:27:42.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 247 1.88 MB/sec warmup 5 sec latency 172.873 ms 2023-12-16T01:27:43.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 287 1.78 MB/sec warmup 6 sec latency 173.540 ms 2023-12-16T01:27:44.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 331 1.71 MB/sec warmup 7 sec latency 225.580 ms 2023-12-16T01:27:45.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 373 1.66 MB/sec warmup 8 sec latency 249.412 ms 2023-12-16T01:27:46.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 405 1.59 MB/sec warmup 9 sec latency 298.297 ms 2023-12-16T01:27:47.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 442 1.55 MB/sec warmup 10 sec latency 403.242 ms 2023-12-16T01:27:48.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 477 1.52 MB/sec warmup 11 sec latency 286.536 ms 2023-12-16T01:27:49.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 511 1.48 MB/sec warmup 12 sec latency 219.260 ms 2023-12-16T01:27:50.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 603 1.61 MB/sec warmup 13 sec latency 296.825 ms 2023-12-16T01:27:51.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 614 1.50 MB/sec warmup 14 sec latency 387.762 ms 2023-12-16T01:27:52.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 648 1.40 MB/sec warmup 15 sec latency 496.449 ms 2023-12-16T01:27:53.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 664 1.32 MB/sec warmup 16 sec latency 420.871 ms 2023-12-16T01:27:54.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 683 1.25 MB/sec warmup 17 sec latency 413.154 ms 2023-12-16T01:27:55.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 716 1.18 MB/sec warmup 18 sec latency 299.824 ms 2023-12-16T01:27:56.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 746 1.12 MB/sec warmup 19 sec latency 309.325 ms 2023-12-16T01:27:57.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 778 1.07 MB/sec warmup 20 sec latency 316.432 ms 2023-12-16T01:27:58.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 812 1.02 MB/sec warmup 21 sec latency 301.775 ms 2023-12-16T01:27:59.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:27:59.453 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:27:59.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 823 0.98 MB/sec warmup 22 sec latency 349.544 ms 2023-12-16T01:28:00.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 854 0.94 MB/sec warmup 23 sec latency 360.990 ms 2023-12-16T01:28:01.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 873 0.90 MB/sec warmup 24 sec latency 336.261 ms 2023-12-16T01:28:02.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 903 0.87 MB/sec warmup 25 sec latency 287.870 ms 2023-12-16T01:28:03.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 928 0.84 MB/sec warmup 26 sec latency 287.414 ms 2023-12-16T01:28:04.987 INFO:tasks.workunit.client.0.smithi107.stdout: 1 937 0.81 MB/sec warmup 27 sec latency 311.997 ms 2023-12-16T01:28:05.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 969 0.78 MB/sec warmup 28 sec latency 330.247 ms 2023-12-16T01:28:06.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 995 0.76 MB/sec warmup 29 sec latency 315.264 ms 2023-12-16T01:28:07.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1033 0.76 MB/sec warmup 30 sec latency 434.274 ms 2023-12-16T01:28:08.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1047 0.74 MB/sec warmup 31 sec latency 333.145 ms 2023-12-16T01:28:09.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1063 0.72 MB/sec warmup 32 sec latency 318.713 ms 2023-12-16T01:28:10.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1099 0.70 MB/sec warmup 33 sec latency 304.022 ms 2023-12-16T01:28:11.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1118 0.68 MB/sec warmup 34 sec latency 337.844 ms 2023-12-16T01:28:12.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1157 0.66 MB/sec warmup 35 sec latency 163.212 ms 2023-12-16T01:28:13.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1169 0.64 MB/sec warmup 36 sec latency 335.283 ms 2023-12-16T01:28:14.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1181 0.62 MB/sec warmup 37 sec latency 314.945 ms 2023-12-16T01:28:15.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1214 0.61 MB/sec warmup 38 sec latency 382.129 ms 2023-12-16T01:28:16.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1248 0.59 MB/sec warmup 39 sec latency 212.377 ms 2023-12-16T01:28:17.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1278 0.58 MB/sec warmup 40 sec latency 311.921 ms 2023-12-16T01:28:18.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1284 0.56 MB/sec warmup 41 sec latency 330.854 ms 2023-12-16T01:28:19.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1378 0.62 MB/sec warmup 42 sec latency 333.085 ms 2023-12-16T01:28:20.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1393 0.60 MB/sec warmup 43 sec latency 314.521 ms 2023-12-16T01:28:21.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1417 0.59 MB/sec warmup 44 sec latency 322.383 ms 2023-12-16T01:28:22.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1447 0.58 MB/sec warmup 45 sec latency 312.586 ms 2023-12-16T01:28:23.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1466 0.57 MB/sec warmup 46 sec latency 287.738 ms 2023-12-16T01:28:24.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1490 0.55 MB/sec warmup 47 sec latency 344.099 ms 2023-12-16T01:28:25.988 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1516 0.54 MB/sec warmup 48 sec latency 309.809 ms 2023-12-16T01:28:26.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1532 0.53 MB/sec warmup 49 sec latency 302.646 ms 2023-12-16T01:28:27.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1560 0.52 MB/sec warmup 50 sec latency 439.295 ms 2023-12-16T01:28:28.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1589 0.51 MB/sec warmup 51 sec latency 104.734 ms 2023-12-16T01:28:29.605 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:28:29.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:28:29.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1610 0.50 MB/sec warmup 52 sec latency 316.664 ms 2023-12-16T01:28:30.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1636 0.49 MB/sec warmup 53 sec latency 310.947 ms 2023-12-16T01:28:31.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1653 0.49 MB/sec warmup 54 sec latency 312.156 ms 2023-12-16T01:28:32.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1689 0.48 MB/sec warmup 55 sec latency 422.316 ms 2023-12-16T01:28:33.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1707 0.47 MB/sec warmup 56 sec latency 294.131 ms 2023-12-16T01:28:34.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1772 0.46 MB/sec warmup 57 sec latency 284.528 ms 2023-12-16T01:28:35.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1806 0.45 MB/sec warmup 58 sec latency 294.406 ms 2023-12-16T01:28:36.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1826 0.45 MB/sec warmup 59 sec latency 345.239 ms 2023-12-16T01:28:37.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1849 0.44 MB/sec warmup 60 sec latency 292.614 ms 2023-12-16T01:28:38.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1865 0.43 MB/sec warmup 61 sec latency 307.066 ms 2023-12-16T01:28:39.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1898 0.43 MB/sec warmup 62 sec latency 363.520 ms 2023-12-16T01:28:40.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1912 0.42 MB/sec warmup 63 sec latency 311.980 ms 2023-12-16T01:28:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1972 0.41 MB/sec warmup 64 sec latency 303.282 ms 2023-12-16T01:28:42.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 1997 0.41 MB/sec warmup 65 sec latency 303.741 ms 2023-12-16T01:28:43.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2034 0.40 MB/sec warmup 66 sec latency 290.396 ms 2023-12-16T01:28:44.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2053 0.40 MB/sec warmup 67 sec latency 308.901 ms 2023-12-16T01:28:45.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2079 0.39 MB/sec warmup 68 sec latency 314.893 ms 2023-12-16T01:28:46.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2093 0.39 MB/sec warmup 69 sec latency 327.749 ms 2023-12-16T01:28:47.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2138 0.38 MB/sec warmup 70 sec latency 415.924 ms 2023-12-16T01:28:48.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2160 0.38 MB/sec warmup 71 sec latency 346.329 ms 2023-12-16T01:28:49.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2179 0.37 MB/sec warmup 72 sec latency 330.873 ms 2023-12-16T01:28:50.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2202 0.37 MB/sec warmup 73 sec latency 319.786 ms 2023-12-16T01:28:51.989 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2264 0.36 MB/sec warmup 74 sec latency 282.824 ms 2023-12-16T01:28:52.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2303 0.37 MB/sec warmup 75 sec latency 277.776 ms 2023-12-16T01:28:53.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2321 0.37 MB/sec warmup 76 sec latency 459.050 ms 2023-12-16T01:28:54.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2335 0.36 MB/sec warmup 77 sec latency 310.519 ms 2023-12-16T01:28:55.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2358 0.36 MB/sec warmup 78 sec latency 305.516 ms 2023-12-16T01:28:56.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2364 0.35 MB/sec warmup 79 sec latency 552.714 ms 2023-12-16T01:28:57.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2371 0.35 MB/sec warmup 80 sec latency 497.285 ms 2023-12-16T01:28:58.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2391 0.35 MB/sec warmup 81 sec latency 315.903 ms 2023-12-16T01:28:59.669 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:28:59.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:28:59.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2410 0.34 MB/sec warmup 82 sec latency 332.441 ms 2023-12-16T01:29:00.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2431 0.34 MB/sec warmup 83 sec latency 329.380 ms 2023-12-16T01:29:01.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2442 0.33 MB/sec warmup 84 sec latency 304.043 ms 2023-12-16T01:29:02.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2470 0.34 MB/sec warmup 85 sec latency 190.621 ms 2023-12-16T01:29:03.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2494 0.33 MB/sec warmup 86 sec latency 335.797 ms 2023-12-16T01:29:04.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2549 0.33 MB/sec warmup 87 sec latency 326.207 ms 2023-12-16T01:29:05.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2559 0.33 MB/sec warmup 88 sec latency 307.474 ms 2023-12-16T01:29:06.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2580 0.33 MB/sec warmup 89 sec latency 287.938 ms 2023-12-16T01:29:07.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2596 0.32 MB/sec warmup 90 sec latency 345.308 ms 2023-12-16T01:29:08.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2608 0.32 MB/sec warmup 91 sec latency 284.990 ms 2023-12-16T01:29:09.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2618 0.32 MB/sec warmup 92 sec latency 293.130 ms 2023-12-16T01:29:10.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2720 0.34 MB/sec warmup 93 sec latency 309.407 ms 2023-12-16T01:29:11.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2761 0.34 MB/sec warmup 94 sec latency 333.775 ms 2023-12-16T01:29:12.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2780 0.34 MB/sec warmup 95 sec latency 230.492 ms 2023-12-16T01:29:13.990 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2880 0.34 MB/sec warmup 96 sec latency 331.094 ms 2023-12-16T01:29:14.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2918 0.35 MB/sec warmup 97 sec latency 156.072 ms 2023-12-16T01:29:15.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2943 0.34 MB/sec warmup 98 sec latency 315.981 ms 2023-12-16T01:29:16.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2974 0.34 MB/sec warmup 99 sec latency 360.252 ms 2023-12-16T01:29:17.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 2994 0.34 MB/sec warmup 100 sec latency 389.308 ms 2023-12-16T01:29:18.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3017 0.33 MB/sec warmup 101 sec latency 317.695 ms 2023-12-16T01:29:19.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3167 0.33 MB/sec warmup 102 sec latency 333.169 ms 2023-12-16T01:29:20.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3188 0.33 MB/sec warmup 103 sec latency 331.299 ms 2023-12-16T01:29:21.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3232 0.33 MB/sec warmup 104 sec latency 354.084 ms 2023-12-16T01:29:22.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3275 0.34 MB/sec warmup 105 sec latency 303.324 ms 2023-12-16T01:29:23.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3282 0.33 MB/sec warmup 106 sec latency 320.497 ms 2023-12-16T01:29:24.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3286 0.33 MB/sec warmup 107 sec latency 337.647 ms 2023-12-16T01:29:25.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3291 0.33 MB/sec warmup 108 sec latency 378.169 ms 2023-12-16T01:29:26.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3294 0.32 MB/sec warmup 109 sec latency 395.644 ms 2023-12-16T01:29:27.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3298 0.32 MB/sec warmup 110 sec latency 345.917 ms 2023-12-16T01:29:28.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3306 0.32 MB/sec warmup 111 sec latency 416.251 ms 2023-12-16T01:29:29.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:29:29.786 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:29:29.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3309 0.32 MB/sec warmup 112 sec latency 357.963 ms 2023-12-16T01:29:30.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3312 0.31 MB/sec warmup 113 sec latency 335.150 ms 2023-12-16T01:29:31.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3316 0.31 MB/sec warmup 114 sec latency 340.107 ms 2023-12-16T01:29:32.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3319 0.31 MB/sec warmup 115 sec latency 346.846 ms 2023-12-16T01:29:33.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3324 0.30 MB/sec warmup 116 sec latency 306.083 ms 2023-12-16T01:29:34.991 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3327 0.30 MB/sec warmup 117 sec latency 314.104 ms 2023-12-16T01:29:35.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3332 0.30 MB/sec warmup 118 sec latency 312.319 ms 2023-12-16T01:29:36.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3335 0.30 MB/sec warmup 119 sec latency 296.991 ms 2023-12-16T01:29:38.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3372 0.07 MB/sec execute 1 sec latency 431.521 ms 2023-12-16T01:29:39.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3393 0.05 MB/sec execute 2 sec latency 294.911 ms 2023-12-16T01:29:40.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3493 0.99 MB/sec execute 3 sec latency 326.471 ms 2023-12-16T01:29:41.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3530 0.75 MB/sec execute 4 sec latency 145.408 ms 2023-12-16T01:29:42.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3551 0.61 MB/sec execute 5 sec latency 290.454 ms 2023-12-16T01:29:43.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3573 0.51 MB/sec execute 6 sec latency 292.326 ms 2023-12-16T01:29:44.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3588 0.44 MB/sec execute 7 sec latency 349.813 ms 2023-12-16T01:29:45.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3642 0.41 MB/sec execute 8 sec latency 363.959 ms 2023-12-16T01:29:46.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3666 0.37 MB/sec execute 9 sec latency 315.744 ms 2023-12-16T01:29:47.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3677 0.33 MB/sec execute 10 sec latency 452.195 ms 2023-12-16T01:29:48.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3702 0.31 MB/sec execute 11 sec latency 310.256 ms 2023-12-16T01:29:49.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3756 0.37 MB/sec execute 12 sec latency 146.671 ms 2023-12-16T01:29:50.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3774 0.34 MB/sec execute 13 sec latency 298.167 ms 2023-12-16T01:29:51.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3789 0.31 MB/sec execute 14 sec latency 184.328 ms 2023-12-16T01:29:52.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3797 0.29 MB/sec execute 15 sec latency 201.931 ms 2023-12-16T01:29:53.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3814 0.27 MB/sec execute 16 sec latency 201.763 ms 2023-12-16T01:29:54.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3830 0.26 MB/sec execute 17 sec latency 152.572 ms 2023-12-16T01:29:55.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3848 0.24 MB/sec execute 18 sec latency 141.829 ms 2023-12-16T01:29:56.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3864 0.23 MB/sec execute 19 sec latency 170.871 ms 2023-12-16T01:29:57.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3876 0.22 MB/sec execute 20 sec latency 456.871 ms 2023-12-16T01:29:58.992 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3896 0.22 MB/sec execute 21 sec latency 308.279 ms 2023-12-16T01:29:59.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:29:59.907 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:29:59.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3905 0.21 MB/sec execute 22 sec latency 310.976 ms 2023-12-16T01:30:00.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3927 0.20 MB/sec execute 23 sec latency 294.152 ms 2023-12-16T01:30:01.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3939 0.20 MB/sec execute 24 sec latency 180.587 ms 2023-12-16T01:30:02.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3952 0.19 MB/sec execute 25 sec latency 193.465 ms 2023-12-16T01:30:03.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3968 0.18 MB/sec execute 26 sec latency 148.241 ms 2023-12-16T01:30:04.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 3984 0.17 MB/sec execute 27 sec latency 162.454 ms 2023-12-16T01:30:05.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4001 0.17 MB/sec execute 28 sec latency 180.656 ms 2023-12-16T01:30:06.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4018 0.16 MB/sec execute 29 sec latency 144.065 ms 2023-12-16T01:30:07.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4028 0.16 MB/sec execute 30 sec latency 489.216 ms 2023-12-16T01:30:08.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4037 0.15 MB/sec execute 31 sec latency 330.624 ms 2023-12-16T01:30:09.993 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4058 0.15 MB/sec execute 32 sec latency 290.015 ms 2023-12-16T01:30:10.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4071 0.14 MB/sec execute 33 sec latency 303.285 ms 2023-12-16T01:30:11.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4096 0.14 MB/sec execute 34 sec latency 310.439 ms 2023-12-16T01:30:12.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4117 0.13 MB/sec execute 35 sec latency 218.880 ms 2023-12-16T01:30:13.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4148 0.13 MB/sec execute 36 sec latency 181.915 ms 2023-12-16T01:30:14.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4165 0.13 MB/sec execute 37 sec latency 366.648 ms 2023-12-16T01:30:15.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4176 0.12 MB/sec execute 38 sec latency 303.275 ms 2023-12-16T01:30:16.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4216 0.12 MB/sec execute 39 sec latency 305.181 ms 2023-12-16T01:30:17.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4224 0.12 MB/sec execute 40 sec latency 412.000 ms 2023-12-16T01:30:18.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4252 0.12 MB/sec execute 41 sec latency 326.520 ms 2023-12-16T01:30:19.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4281 0.12 MB/sec execute 42 sec latency 325.593 ms 2023-12-16T01:30:20.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4315 0.12 MB/sec execute 43 sec latency 215.151 ms 2023-12-16T01:30:21.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4349 0.12 MB/sec execute 44 sec latency 323.568 ms 2023-12-16T01:30:22.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4383 0.12 MB/sec execute 45 sec latency 242.427 ms 2023-12-16T01:30:23.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4393 0.11 MB/sec execute 46 sec latency 336.870 ms 2023-12-16T01:30:24.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4424 0.11 MB/sec execute 47 sec latency 328.812 ms 2023-12-16T01:30:25.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4443 0.11 MB/sec execute 48 sec latency 325.021 ms 2023-12-16T01:30:26.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4473 0.11 MB/sec execute 49 sec latency 297.794 ms 2023-12-16T01:30:27.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4498 0.11 MB/sec execute 50 sec latency 462.005 ms 2023-12-16T01:30:28.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4504 0.11 MB/sec execute 51 sec latency 320.626 ms 2023-12-16T01:30:29.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:30:29.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:30:29.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4538 0.11 MB/sec execute 52 sec latency 296.287 ms 2023-12-16T01:30:30.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4563 0.11 MB/sec execute 53 sec latency 250.776 ms 2023-12-16T01:30:31.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4602 0.12 MB/sec execute 54 sec latency 313.514 ms 2023-12-16T01:30:32.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4616 0.12 MB/sec execute 55 sec latency 302.698 ms 2023-12-16T01:30:33.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4632 0.12 MB/sec execute 56 sec latency 316.994 ms 2023-12-16T01:30:34.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4668 0.12 MB/sec execute 57 sec latency 304.732 ms 2023-12-16T01:30:35.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4695 0.12 MB/sec execute 58 sec latency 304.718 ms 2023-12-16T01:30:36.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4726 0.11 MB/sec execute 59 sec latency 300.370 ms 2023-12-16T01:30:37.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4736 0.11 MB/sec execute 60 sec latency 387.443 ms 2023-12-16T01:30:38.994 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4764 0.11 MB/sec execute 61 sec latency 304.706 ms 2023-12-16T01:30:39.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4787 0.11 MB/sec execute 62 sec latency 393.050 ms 2023-12-16T01:30:40.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4817 0.11 MB/sec execute 63 sec latency 290.934 ms 2023-12-16T01:30:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4846 0.11 MB/sec execute 64 sec latency 322.068 ms 2023-12-16T01:30:42.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4851 0.11 MB/sec execute 65 sec latency 432.726 ms 2023-12-16T01:30:43.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4947 0.15 MB/sec execute 66 sec latency 303.487 ms 2023-12-16T01:30:44.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4963 0.15 MB/sec execute 67 sec latency 328.530 ms 2023-12-16T01:30:45.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 4985 0.14 MB/sec execute 68 sec latency 300.478 ms 2023-12-16T01:30:46.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5014 0.14 MB/sec execute 69 sec latency 265.305 ms 2023-12-16T01:30:47.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5032 0.14 MB/sec execute 70 sec latency 422.827 ms 2023-12-16T01:30:48.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5056 0.14 MB/sec execute 71 sec latency 446.301 ms 2023-12-16T01:30:49.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5089 0.14 MB/sec execute 72 sec latency 331.077 ms 2023-12-16T01:30:50.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5117 0.13 MB/sec execute 73 sec latency 287.294 ms 2023-12-16T01:30:51.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5139 0.13 MB/sec execute 74 sec latency 305.924 ms 2023-12-16T01:30:52.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5166 0.13 MB/sec execute 75 sec latency 328.861 ms 2023-12-16T01:30:53.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5179 0.13 MB/sec execute 76 sec latency 313.605 ms 2023-12-16T01:30:54.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5206 0.13 MB/sec execute 77 sec latency 338.269 ms 2023-12-16T01:30:55.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5227 0.13 MB/sec execute 78 sec latency 343.689 ms 2023-12-16T01:30:56.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5263 0.13 MB/sec execute 79 sec latency 338.182 ms 2023-12-16T01:30:57.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5286 0.12 MB/sec execute 80 sec latency 403.659 ms 2023-12-16T01:30:58.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5338 0.12 MB/sec execute 81 sec latency 310.924 ms 2023-12-16T01:30:59.995 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5382 0.12 MB/sec execute 82 sec latency 310.743 ms 2023-12-16T01:31:00.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:31:00.133 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:31:00.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5393 0.12 MB/sec execute 83 sec latency 319.640 ms 2023-12-16T01:31:01.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5420 0.12 MB/sec execute 84 sec latency 311.024 ms 2023-12-16T01:31:02.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5433 0.12 MB/sec execute 85 sec latency 288.925 ms 2023-12-16T01:31:03.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5463 0.12 MB/sec execute 86 sec latency 369.475 ms 2023-12-16T01:31:04.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5483 0.12 MB/sec execute 87 sec latency 300.319 ms 2023-12-16T01:31:05.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5538 0.12 MB/sec execute 88 sec latency 280.326 ms 2023-12-16T01:31:06.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5562 0.12 MB/sec execute 89 sec latency 316.987 ms 2023-12-16T01:31:07.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5603 0.11 MB/sec execute 90 sec latency 423.474 ms 2023-12-16T01:31:08.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5616 0.11 MB/sec execute 91 sec latency 297.215 ms 2023-12-16T01:31:09.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5641 0.11 MB/sec execute 92 sec latency 335.488 ms 2023-12-16T01:31:10.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5655 0.11 MB/sec execute 93 sec latency 355.901 ms 2023-12-16T01:31:11.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5702 0.11 MB/sec execute 94 sec latency 321.210 ms 2023-12-16T01:31:12.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5735 0.11 MB/sec execute 95 sec latency 363.402 ms 2023-12-16T01:31:13.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5744 0.11 MB/sec execute 96 sec latency 303.991 ms 2023-12-16T01:31:14.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5782 0.11 MB/sec execute 97 sec latency 306.624 ms 2023-12-16T01:31:15.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5853 0.12 MB/sec execute 98 sec latency 292.064 ms 2023-12-16T01:31:16.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5866 0.12 MB/sec execute 99 sec latency 290.141 ms 2023-12-16T01:31:17.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5881 0.12 MB/sec execute 100 sec latency 440.860 ms 2023-12-16T01:31:18.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5895 0.11 MB/sec execute 101 sec latency 473.929 ms 2023-12-16T01:31:19.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5921 0.11 MB/sec execute 102 sec latency 306.607 ms 2023-12-16T01:31:20.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5924 0.11 MB/sec execute 103 sec latency 550.362 ms 2023-12-16T01:31:21.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5931 0.11 MB/sec execute 104 sec latency 327.540 ms 2023-12-16T01:31:22.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5955 0.11 MB/sec execute 105 sec latency 325.385 ms 2023-12-16T01:31:23.996 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5976 0.11 MB/sec execute 106 sec latency 285.669 ms 2023-12-16T01:31:24.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 5992 0.11 MB/sec execute 107 sec latency 384.499 ms 2023-12-16T01:31:25.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6009 0.11 MB/sec execute 108 sec latency 310.764 ms 2023-12-16T01:31:26.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6042 0.11 MB/sec execute 109 sec latency 310.142 ms 2023-12-16T01:31:27.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6054 0.11 MB/sec execute 110 sec latency 339.850 ms 2023-12-16T01:31:28.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6107 0.11 MB/sec execute 111 sec latency 438.422 ms 2023-12-16T01:31:29.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6118 0.11 MB/sec execute 112 sec latency 312.620 ms 2023-12-16T01:31:30.269 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:31:30.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:31:30.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6139 0.11 MB/sec execute 113 sec latency 317.946 ms 2023-12-16T01:31:31.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6158 0.11 MB/sec execute 114 sec latency 309.277 ms 2023-12-16T01:31:32.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6173 0.11 MB/sec execute 115 sec latency 314.586 ms 2023-12-16T01:31:33.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6179 0.11 MB/sec execute 116 sec latency 348.456 ms 2023-12-16T01:31:34.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6302 0.13 MB/sec execute 117 sec latency 316.927 ms 2023-12-16T01:31:35.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6317 0.13 MB/sec execute 118 sec latency 362.308 ms 2023-12-16T01:31:36.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6337 0.13 MB/sec execute 119 sec latency 302.248 ms 2023-12-16T01:31:37.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6435 0.13 MB/sec execute 120 sec latency 298.130 ms 2023-12-16T01:31:38.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6473 0.14 MB/sec execute 121 sec latency 193.719 ms 2023-12-16T01:31:39.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6500 0.14 MB/sec execute 122 sec latency 308.166 ms 2023-12-16T01:31:40.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6530 0.14 MB/sec execute 123 sec latency 403.434 ms 2023-12-16T01:31:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6549 0.14 MB/sec execute 124 sec latency 210.258 ms 2023-12-16T01:31:42.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6578 0.14 MB/sec execute 125 sec latency 304.977 ms 2023-12-16T01:31:43.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6724 0.14 MB/sec execute 126 sec latency 336.274 ms 2023-12-16T01:31:44.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6744 0.14 MB/sec execute 127 sec latency 294.876 ms 2023-12-16T01:31:45.997 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6820 0.15 MB/sec execute 128 sec latency 216.076 ms 2023-12-16T01:31:46.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6834 0.15 MB/sec execute 129 sec latency 301.138 ms 2023-12-16T01:31:47.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6837 0.15 MB/sec execute 130 sec latency 332.762 ms 2023-12-16T01:31:48.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6841 0.15 MB/sec execute 131 sec latency 398.673 ms 2023-12-16T01:31:49.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6846 0.14 MB/sec execute 132 sec latency 333.520 ms 2023-12-16T01:31:50.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6849 0.14 MB/sec execute 133 sec latency 378.408 ms 2023-12-16T01:31:51.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6858 0.14 MB/sec execute 134 sec latency 401.430 ms 2023-12-16T01:31:52.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6862 0.14 MB/sec execute 135 sec latency 330.679 ms 2023-12-16T01:31:53.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6866 0.14 MB/sec execute 136 sec latency 322.815 ms 2023-12-16T01:31:54.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6869 0.14 MB/sec execute 137 sec latency 313.557 ms 2023-12-16T01:31:55.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6874 0.14 MB/sec execute 138 sec latency 297.784 ms 2023-12-16T01:31:56.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6878 0.14 MB/sec execute 139 sec latency 297.987 ms 2023-12-16T01:31:57.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6881 0.14 MB/sec execute 140 sec latency 312.145 ms 2023-12-16T01:31:58.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6886 0.14 MB/sec execute 141 sec latency 438.109 ms 2023-12-16T01:31:59.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6890 0.13 MB/sec execute 142 sec latency 306.347 ms 2023-12-16T01:32:00.509 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:32:00.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:32:00.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6897 0.13 MB/sec execute 143 sec latency 313.041 ms 2023-12-16T01:32:01.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6926 0.13 MB/sec execute 144 sec latency 138.294 ms 2023-12-16T01:32:02.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 6946 0.13 MB/sec execute 145 sec latency 339.489 ms 2023-12-16T01:32:03.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7046 0.15 MB/sec execute 146 sec latency 349.576 ms 2023-12-16T01:32:04.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7082 0.15 MB/sec execute 147 sec latency 118.135 ms 2023-12-16T01:32:05.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7107 0.15 MB/sec execute 148 sec latency 295.943 ms 2023-12-16T01:32:06.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7123 0.15 MB/sec execute 149 sec latency 323.841 ms 2023-12-16T01:32:07.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7135 0.15 MB/sec execute 150 sec latency 419.705 ms 2023-12-16T01:32:08.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7185 0.15 MB/sec execute 151 sec latency 550.361 ms 2023-12-16T01:32:09.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7211 0.15 MB/sec execute 152 sec latency 300.710 ms 2023-12-16T01:32:10.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7228 0.15 MB/sec execute 153 sec latency 303.733 ms 2023-12-16T01:32:11.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7247 0.15 MB/sec execute 154 sec latency 291.702 ms 2023-12-16T01:32:12.998 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7301 0.15 MB/sec execute 155 sec latency 140.473 ms 2023-12-16T01:32:13.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7317 0.15 MB/sec execute 156 sec latency 299.525 ms 2023-12-16T01:32:14.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7333 0.15 MB/sec execute 157 sec latency 190.460 ms 2023-12-16T01:32:15.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7341 0.15 MB/sec execute 158 sec latency 207.160 ms 2023-12-16T01:32:16.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7358 0.15 MB/sec execute 159 sec latency 195.944 ms 2023-12-16T01:32:17.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7373 0.15 MB/sec execute 160 sec latency 271.815 ms 2023-12-16T01:32:18.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7389 0.15 MB/sec execute 161 sec latency 255.520 ms 2023-12-16T01:32:19.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7407 0.15 MB/sec execute 162 sec latency 144.068 ms 2023-12-16T01:32:20.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7420 0.14 MB/sec execute 163 sec latency 294.963 ms 2023-12-16T01:32:21.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7440 0.15 MB/sec execute 164 sec latency 305.192 ms 2023-12-16T01:32:22.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7458 0.14 MB/sec execute 165 sec latency 313.088 ms 2023-12-16T01:32:23.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7472 0.14 MB/sec execute 166 sec latency 318.074 ms 2023-12-16T01:32:24.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7483 0.14 MB/sec execute 167 sec latency 179.601 ms 2023-12-16T01:32:25.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7499 0.14 MB/sec execute 168 sec latency 192.869 ms 2023-12-16T01:32:26.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7517 0.14 MB/sec execute 169 sec latency 144.466 ms 2023-12-16T01:32:27.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7531 0.14 MB/sec execute 170 sec latency 162.458 ms 2023-12-16T01:32:28.999 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7549 0.14 MB/sec execute 171 sec latency 166.881 ms 2023-12-16T01:32:30.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7566 0.14 MB/sec execute 172 sec latency 160.308 ms 2023-12-16T01:32:30.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:32:30.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:32:31.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7576 0.14 MB/sec execute 173 sec latency 300.863 ms 2023-12-16T01:32:32.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7587 0.14 MB/sec execute 174 sec latency 337.543 ms 2023-12-16T01:32:33.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7604 0.14 MB/sec execute 175 sec latency 326.446 ms 2023-12-16T01:32:34.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7626 0.14 MB/sec execute 176 sec latency 310.121 ms 2023-12-16T01:32:35.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7645 0.13 MB/sec execute 177 sec latency 308.964 ms 2023-12-16T01:32:36.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7665 0.13 MB/sec execute 178 sec latency 215.119 ms 2023-12-16T01:32:37.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7695 0.13 MB/sec execute 179 sec latency 88.745 ms 2023-12-16T01:32:38.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7706 0.13 MB/sec execute 180 sec latency 387.681 ms 2023-12-16T01:32:39.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7721 0.13 MB/sec execute 181 sec latency 335.471 ms 2023-12-16T01:32:40.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7758 0.13 MB/sec execute 182 sec latency 282.555 ms 2023-12-16T01:32:41.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7767 0.13 MB/sec execute 183 sec latency 324.779 ms 2023-12-16T01:32:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7795 0.13 MB/sec execute 184 sec latency 331.486 ms 2023-12-16T01:32:43.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7824 0.13 MB/sec execute 185 sec latency 301.624 ms 2023-12-16T01:32:44.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7859 0.13 MB/sec execute 186 sec latency 307.609 ms 2023-12-16T01:32:45.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7892 0.13 MB/sec execute 187 sec latency 294.902 ms 2023-12-16T01:32:46.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7926 0.13 MB/sec execute 188 sec latency 333.006 ms 2023-12-16T01:32:47.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7935 0.13 MB/sec execute 189 sec latency 358.090 ms 2023-12-16T01:32:48.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7969 0.13 MB/sec execute 190 sec latency 329.665 ms 2023-12-16T01:32:49.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 7992 0.13 MB/sec execute 191 sec latency 325.690 ms 2023-12-16T01:32:50.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8016 0.13 MB/sec execute 192 sec latency 275.387 ms 2023-12-16T01:32:51.000 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8041 0.13 MB/sec execute 193 sec latency 306.087 ms 2023-12-16T01:32:52.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8048 0.13 MB/sec execute 194 sec latency 305.593 ms 2023-12-16T01:32:53.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8081 0.13 MB/sec execute 195 sec latency 306.270 ms 2023-12-16T01:32:54.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8111 0.13 MB/sec execute 196 sec latency 314.976 ms 2023-12-16T01:32:55.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8148 0.13 MB/sec execute 197 sec latency 316.133 ms 2023-12-16T01:32:56.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8158 0.13 MB/sec execute 198 sec latency 297.726 ms 2023-12-16T01:32:57.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8194 0.13 MB/sec execute 199 sec latency 316.072 ms 2023-12-16T01:32:58.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8210 0.13 MB/sec execute 200 sec latency 308.293 ms 2023-12-16T01:32:59.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8239 0.13 MB/sec execute 201 sec latency 500.209 ms 2023-12-16T01:33:00.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8269 0.13 MB/sec execute 202 sec latency 294.816 ms 2023-12-16T01:33:00.800 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:33:00.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:33:01.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8278 0.13 MB/sec execute 203 sec latency 301.068 ms 2023-12-16T01:33:02.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8308 0.13 MB/sec execute 204 sec latency 315.004 ms 2023-12-16T01:33:03.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8333 0.13 MB/sec execute 205 sec latency 313.689 ms 2023-12-16T01:33:04.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8359 0.13 MB/sec execute 206 sec latency 332.306 ms 2023-12-16T01:33:05.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8388 0.13 MB/sec execute 207 sec latency 317.363 ms 2023-12-16T01:33:06.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8405 0.13 MB/sec execute 208 sec latency 351.761 ms 2023-12-16T01:33:07.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8490 0.14 MB/sec execute 209 sec latency 292.086 ms 2023-12-16T01:33:08.001 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8506 0.14 MB/sec execute 210 sec latency 303.847 ms 2023-12-16T01:33:09.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8526 0.14 MB/sec execute 211 sec latency 454.021 ms 2023-12-16T01:33:10.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8556 0.14 MB/sec execute 212 sec latency 331.221 ms 2023-12-16T01:33:11.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8575 0.14 MB/sec execute 213 sec latency 290.737 ms 2023-12-16T01:33:12.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8599 0.14 MB/sec execute 214 sec latency 324.451 ms 2023-12-16T01:33:13.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8632 0.13 MB/sec execute 215 sec latency 328.809 ms 2023-12-16T01:33:14.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8651 0.13 MB/sec execute 216 sec latency 305.805 ms 2023-12-16T01:33:15.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8678 0.13 MB/sec execute 217 sec latency 317.388 ms 2023-12-16T01:33:16.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8705 0.13 MB/sec execute 218 sec latency 303.691 ms 2023-12-16T01:33:17.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8720 0.13 MB/sec execute 219 sec latency 325.916 ms 2023-12-16T01:33:18.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8749 0.13 MB/sec execute 220 sec latency 308.634 ms 2023-12-16T01:33:19.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8761 0.13 MB/sec execute 221 sec latency 502.880 ms 2023-12-16T01:33:20.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8806 0.13 MB/sec execute 222 sec latency 266.183 ms 2023-12-16T01:33:21.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8815 0.13 MB/sec execute 223 sec latency 305.095 ms 2023-12-16T01:33:22.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8880 0.13 MB/sec execute 224 sec latency 314.135 ms 2023-12-16T01:33:23.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8914 0.13 MB/sec execute 225 sec latency 307.601 ms 2023-12-16T01:33:24.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8934 0.13 MB/sec execute 226 sec latency 335.504 ms 2023-12-16T01:33:25.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8962 0.13 MB/sec execute 227 sec latency 301.915 ms 2023-12-16T01:33:26.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 8976 0.13 MB/sec execute 228 sec latency 286.026 ms 2023-12-16T01:33:27.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9007 0.13 MB/sec execute 229 sec latency 329.800 ms 2023-12-16T01:33:28.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9021 0.13 MB/sec execute 230 sec latency 305.903 ms 2023-12-16T01:33:29.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9077 0.13 MB/sec execute 231 sec latency 452.816 ms 2023-12-16T01:33:30.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9106 0.13 MB/sec execute 232 sec latency 294.840 ms 2023-12-16T01:33:30.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:33:30.957 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:33:31.002 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9141 0.13 MB/sec execute 233 sec latency 291.358 ms 2023-12-16T01:33:32.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9159 0.13 MB/sec execute 234 sec latency 310.973 ms 2023-12-16T01:33:33.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9185 0.13 MB/sec execute 235 sec latency 307.954 ms 2023-12-16T01:33:34.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9199 0.13 MB/sec execute 236 sec latency 306.840 ms 2023-12-16T01:33:35.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9244 0.12 MB/sec execute 237 sec latency 326.732 ms 2023-12-16T01:33:36.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9274 0.12 MB/sec execute 238 sec latency 352.072 ms 2023-12-16T01:33:37.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9286 0.12 MB/sec execute 239 sec latency 334.945 ms 2023-12-16T01:33:38.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9307 0.12 MB/sec execute 240 sec latency 329.763 ms 2023-12-16T01:33:39.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9367 0.12 MB/sec execute 241 sec latency 306.548 ms 2023-12-16T01:33:40.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9407 0.13 MB/sec execute 242 sec latency 312.949 ms 2023-12-16T01:33:41.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9425 0.13 MB/sec execute 243 sec latency 436.115 ms 2023-12-16T01:33:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9439 0.13 MB/sec execute 244 sec latency 307.205 ms 2023-12-16T01:33:43.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9462 0.13 MB/sec execute 245 sec latency 303.864 ms 2023-12-16T01:33:44.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9468 0.13 MB/sec execute 246 sec latency 318.898 ms 2023-12-16T01:33:45.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9475 0.12 MB/sec execute 247 sec latency 533.694 ms 2023-12-16T01:33:46.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9498 0.12 MB/sec execute 248 sec latency 310.122 ms 2023-12-16T01:33:47.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9514 0.12 MB/sec execute 249 sec latency 249.092 ms 2023-12-16T01:33:48.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9536 0.12 MB/sec execute 250 sec latency 328.191 ms 2023-12-16T01:33:49.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9551 0.12 MB/sec execute 251 sec latency 470.152 ms 2023-12-16T01:33:50.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9574 0.12 MB/sec execute 252 sec latency 207.550 ms 2023-12-16T01:33:51.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9598 0.12 MB/sec execute 253 sec latency 312.293 ms 2023-12-16T01:33:52.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9651 0.13 MB/sec execute 254 sec latency 303.591 ms 2023-12-16T01:33:53.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9662 0.12 MB/sec execute 255 sec latency 305.802 ms 2023-12-16T01:33:54.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9682 0.12 MB/sec execute 256 sec latency 310.774 ms 2023-12-16T01:33:55.003 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9698 0.12 MB/sec execute 257 sec latency 334.881 ms 2023-12-16T01:33:56.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9711 0.12 MB/sec execute 258 sec latency 317.859 ms 2023-12-16T01:33:57.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9723 0.12 MB/sec execute 259 sec latency 315.782 ms 2023-12-16T01:33:58.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9846 0.13 MB/sec execute 260 sec latency 293.303 ms 2023-12-16T01:33:59.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9861 0.13 MB/sec execute 261 sec latency 398.811 ms 2023-12-16T01:34:00.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9880 0.13 MB/sec execute 262 sec latency 294.296 ms 2023-12-16T01:34:01.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 9980 0.13 MB/sec execute 263 sec latency 303.495 ms 2023-12-16T01:34:01.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:34:01.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:34:02.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10025 0.14 MB/sec execute 264 sec latency 145.729 ms 2023-12-16T01:34:03.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10065 0.14 MB/sec execute 265 sec latency 302.577 ms 2023-12-16T01:34:03.870 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:09:01.162 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:03.940 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:09:01.232 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:03.950 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:09:01.174 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:03.986 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:09:01.210 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:04.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10074 0.14 MB/sec execute 266 sec latency 324.501 ms 2023-12-16T01:34:04.018 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:09:01.242 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:04.048 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:09:01.272 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:04.316 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:09:01.608 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:04.421 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:09:01.645 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:04.451 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:09:01.675 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:05.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10093 0.14 MB/sec execute 267 sec latency 199.670 ms 2023-12-16T01:34:06.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10116 0.14 MB/sec execute 268 sec latency 319.477 ms 2023-12-16T01:34:07.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10266 0.14 MB/sec execute 269 sec latency 299.230 ms 2023-12-16T01:34:08.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10287 0.14 MB/sec execute 270 sec latency 318.322 ms 2023-12-16T01:34:09.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10323 0.14 MB/sec execute 271 sec latency 458.375 ms 2023-12-16T01:34:10.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10372 0.14 MB/sec execute 272 sec latency 309.879 ms 2023-12-16T01:34:11.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10381 0.14 MB/sec execute 273 sec latency 287.431 ms 2023-12-16T01:34:12.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10386 0.14 MB/sec execute 274 sec latency 297.495 ms 2023-12-16T01:34:13.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10391 0.14 MB/sec execute 275 sec latency 379.768 ms 2023-12-16T01:34:14.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10394 0.14 MB/sec execute 276 sec latency 371.814 ms 2023-12-16T01:34:15.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10398 0.14 MB/sec execute 277 sec latency 375.372 ms 2023-12-16T01:34:16.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10406 0.14 MB/sec execute 278 sec latency 375.188 ms 2023-12-16T01:34:17.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10409 0.14 MB/sec execute 279 sec latency 308.587 ms 2023-12-16T01:34:18.004 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10412 0.14 MB/sec execute 280 sec latency 333.018 ms 2023-12-16T01:34:19.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10416 0.14 MB/sec execute 281 sec latency 483.261 ms 2023-12-16T01:34:20.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10421 0.14 MB/sec execute 282 sec latency 309.038 ms 2023-12-16T01:34:21.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10424 0.14 MB/sec execute 283 sec latency 289.550 ms 2023-12-16T01:34:22.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10430 0.13 MB/sec execute 284 sec latency 299.579 ms 2023-12-16T01:34:23.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10433 0.13 MB/sec execute 285 sec latency 294.029 ms 2023-12-16T01:34:24.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10436 0.13 MB/sec execute 286 sec latency 300.656 ms 2023-12-16T01:34:25.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10464 0.13 MB/sec execute 287 sec latency 306.744 ms 2023-12-16T01:34:26.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10490 0.13 MB/sec execute 288 sec latency 136.172 ms 2023-12-16T01:34:27.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10496 0.13 MB/sec execute 289 sec latency 328.079 ms 2023-12-16T01:34:28.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10614 0.14 MB/sec execute 290 sec latency 324.045 ms 2023-12-16T01:34:29.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10644 0.14 MB/sec execute 291 sec latency 288.970 ms 2023-12-16T01:34:30.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10659 0.14 MB/sec execute 292 sec latency 326.040 ms 2023-12-16T01:34:31.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10680 0.14 MB/sec execute 293 sec latency 332.436 ms 2023-12-16T01:34:31.311 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:34:31.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:34:32.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10730 0.14 MB/sec execute 294 sec latency 308.108 ms 2023-12-16T01:34:33.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10756 0.14 MB/sec execute 295 sec latency 316.368 ms 2023-12-16T01:34:34.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10768 0.14 MB/sec execute 296 sec latency 381.979 ms 2023-12-16T01:34:35.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10787 0.14 MB/sec execute 297 sec latency 328.577 ms 2023-12-16T01:34:36.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10828 0.14 MB/sec execute 298 sec latency 137.109 ms 2023-12-16T01:34:37.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10863 0.14 MB/sec execute 299 sec latency 305.620 ms 2023-12-16T01:34:38.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10879 0.14 MB/sec execute 300 sec latency 191.444 ms 2023-12-16T01:34:39.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10887 0.14 MB/sec execute 301 sec latency 206.646 ms 2023-12-16T01:34:40.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10902 0.14 MB/sec execute 302 sec latency 188.351 ms 2023-12-16T01:34:41.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10918 0.14 MB/sec execute 303 sec latency 157.391 ms 2023-12-16T01:34:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10937 0.14 MB/sec execute 304 sec latency 168.259 ms 2023-12-16T01:34:43.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10951 0.14 MB/sec execute 305 sec latency 172.164 ms 2023-12-16T01:34:43.127 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:09:40.419 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.131 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:09:40.423 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.136 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:09:40.360 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.140 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:09:40.364 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.143 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:09:40.367 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.143 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:09:40.367 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.179 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:09:40.471 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.192 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:09:40.416 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:43.192 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:09:40.416 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:34:44.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10966 0.14 MB/sec execute 306 sec latency 282.327 ms 2023-12-16T01:34:45.005 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10986 0.14 MB/sec execute 307 sec latency 298.955 ms 2023-12-16T01:34:46.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 10995 0.14 MB/sec execute 308 sec latency 305.431 ms 2023-12-16T01:34:47.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11017 0.14 MB/sec execute 309 sec latency 301.689 ms 2023-12-16T01:34:48.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11028 0.14 MB/sec execute 310 sec latency 181.264 ms 2023-12-16T01:34:49.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11041 0.14 MB/sec execute 311 sec latency 264.122 ms 2023-12-16T01:34:50.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11057 0.14 MB/sec execute 312 sec latency 156.205 ms 2023-12-16T01:34:51.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11074 0.14 MB/sec execute 313 sec latency 145.407 ms 2023-12-16T01:34:52.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11091 0.14 MB/sec execute 314 sec latency 157.241 ms 2023-12-16T01:34:53.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11107 0.14 MB/sec execute 315 sec latency 162.385 ms 2023-12-16T01:34:54.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11118 0.14 MB/sec execute 316 sec latency 334.540 ms 2023-12-16T01:34:55.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11128 0.14 MB/sec execute 317 sec latency 329.182 ms 2023-12-16T01:34:56.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11148 0.14 MB/sec execute 318 sec latency 307.515 ms 2023-12-16T01:34:57.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11161 0.13 MB/sec execute 319 sec latency 331.878 ms 2023-12-16T01:34:58.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11186 0.13 MB/sec execute 320 sec latency 311.148 ms 2023-12-16T01:34:59.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11207 0.13 MB/sec execute 321 sec latency 246.142 ms 2023-12-16T01:35:00.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11238 0.13 MB/sec execute 322 sec latency 190.422 ms 2023-12-16T01:35:01.006 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11251 0.13 MB/sec execute 323 sec latency 441.839 ms 2023-12-16T01:35:01.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:35:01.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:35:02.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11265 0.13 MB/sec execute 324 sec latency 374.312 ms 2023-12-16T01:35:03.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11275 0.13 MB/sec execute 325 sec latency 374.891 ms 2023-12-16T01:35:04.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11309 0.13 MB/sec execute 326 sec latency 473.082 ms 2023-12-16T01:35:05.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11335 0.13 MB/sec execute 327 sec latency 293.678 ms 2023-12-16T01:35:06.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11365 0.13 MB/sec execute 328 sec latency 284.791 ms 2023-12-16T01:35:07.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11404 0.13 MB/sec execute 329 sec latency 263.642 ms 2023-12-16T01:35:08.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11433 0.13 MB/sec execute 330 sec latency 341.922 ms 2023-12-16T01:35:09.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11472 0.13 MB/sec execute 331 sec latency 226.882 ms 2023-12-16T01:35:10.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11477 0.13 MB/sec execute 332 sec latency 331.635 ms 2023-12-16T01:35:11.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11513 0.13 MB/sec execute 333 sec latency 301.694 ms 2023-12-16T01:35:12.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11532 0.13 MB/sec execute 334 sec latency 362.913 ms 2023-12-16T01:35:13.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11561 0.13 MB/sec execute 335 sec latency 289.680 ms 2023-12-16T01:35:14.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11587 0.13 MB/sec execute 336 sec latency 317.672 ms 2023-12-16T01:35:15.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11592 0.13 MB/sec execute 337 sec latency 318.919 ms 2023-12-16T01:35:16.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11622 0.13 MB/sec execute 338 sec latency 292.755 ms 2023-12-16T01:35:17.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11652 0.13 MB/sec execute 339 sec latency 248.039 ms 2023-12-16T01:35:18.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11690 0.13 MB/sec execute 340 sec latency 330.156 ms 2023-12-16T01:35:19.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11704 0.13 MB/sec execute 341 sec latency 312.483 ms 2023-12-16T01:35:20.007 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11719 0.13 MB/sec execute 342 sec latency 324.868 ms 2023-12-16T01:35:21.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11756 0.13 MB/sec execute 343 sec latency 290.801 ms 2023-12-16T01:35:22.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11774 0.13 MB/sec execute 344 sec latency 318.444 ms 2023-12-16T01:35:23.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11814 0.13 MB/sec execute 345 sec latency 185.858 ms 2023-12-16T01:35:24.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11825 0.13 MB/sec execute 346 sec latency 449.226 ms 2023-12-16T01:35:25.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11836 0.13 MB/sec execute 347 sec latency 307.415 ms 2023-12-16T01:35:26.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11870 0.13 MB/sec execute 348 sec latency 297.807 ms 2023-12-16T01:35:27.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11904 0.13 MB/sec execute 349 sec latency 221.438 ms 2023-12-16T01:35:28.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11934 0.13 MB/sec execute 350 sec latency 354.046 ms 2023-12-16T01:35:29.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 11940 0.13 MB/sec execute 351 sec latency 416.055 ms 2023-12-16T01:35:30.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12034 0.14 MB/sec execute 352 sec latency 321.015 ms 2023-12-16T01:35:31.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12050 0.14 MB/sec execute 353 sec latency 332.340 ms 2023-12-16T01:35:31.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:35:31.536 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:35:32.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12073 0.14 MB/sec execute 354 sec latency 294.441 ms 2023-12-16T01:35:33.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12103 0.14 MB/sec execute 355 sec latency 327.954 ms 2023-12-16T01:35:34.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12122 0.13 MB/sec execute 356 sec latency 381.843 ms 2023-12-16T01:35:35.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12145 0.13 MB/sec execute 357 sec latency 344.963 ms 2023-12-16T01:35:36.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12172 0.13 MB/sec execute 358 sec latency 324.770 ms 2023-12-16T01:35:37.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12190 0.13 MB/sec execute 359 sec latency 301.262 ms 2023-12-16T01:35:38.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12221 0.13 MB/sec execute 360 sec latency 289.184 ms 2023-12-16T01:35:39.008 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12244 0.13 MB/sec execute 361 sec latency 253.887 ms 2023-12-16T01:35:40.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12267 0.13 MB/sec execute 362 sec latency 323.791 ms 2023-12-16T01:35:41.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12296 0.13 MB/sec execute 363 sec latency 301.898 ms 2023-12-16T01:35:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12317 0.13 MB/sec execute 364 sec latency 302.191 ms 2023-12-16T01:35:43.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12353 0.13 MB/sec execute 365 sec latency 253.230 ms 2023-12-16T01:35:44.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12368 0.13 MB/sec execute 366 sec latency 370.395 ms 2023-12-16T01:35:45.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12427 0.13 MB/sec execute 367 sec latency 228.417 ms 2023-12-16T01:35:46.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12462 0.13 MB/sec execute 368 sec latency 307.632 ms 2023-12-16T01:35:47.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12484 0.13 MB/sec execute 369 sec latency 340.844 ms 2023-12-16T01:35:48.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12511 0.13 MB/sec execute 370 sec latency 309.584 ms 2023-12-16T01:35:49.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12526 0.13 MB/sec execute 371 sec latency 296.151 ms 2023-12-16T01:35:50.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12556 0.13 MB/sec execute 372 sec latency 340.836 ms 2023-12-16T01:35:51.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12571 0.13 MB/sec execute 373 sec latency 332.542 ms 2023-12-16T01:35:52.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12631 0.13 MB/sec execute 374 sec latency 295.981 ms 2023-12-16T01:35:53.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12655 0.13 MB/sec execute 375 sec latency 287.355 ms 2023-12-16T01:35:54.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12695 0.13 MB/sec execute 376 sec latency 399.001 ms 2023-12-16T01:35:55.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12708 0.13 MB/sec execute 377 sec latency 302.064 ms 2023-12-16T01:35:56.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12734 0.13 MB/sec execute 378 sec latency 305.803 ms 2023-12-16T01:35:57.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12748 0.13 MB/sec execute 379 sec latency 340.409 ms 2023-12-16T01:35:58.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12794 0.13 MB/sec execute 380 sec latency 359.462 ms 2023-12-16T01:35:59.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12828 0.13 MB/sec execute 381 sec latency 331.527 ms 2023-12-16T01:36:00.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12836 0.13 MB/sec execute 382 sec latency 338.912 ms 2023-12-16T01:36:01.009 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12858 0.13 MB/sec execute 383 sec latency 333.343 ms 2023-12-16T01:36:01.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:36:01.758 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:36:02.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12927 0.13 MB/sec execute 384 sec latency 307.024 ms 2023-12-16T01:36:03.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12957 0.13 MB/sec execute 385 sec latency 300.202 ms 2023-12-16T01:36:04.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12975 0.13 MB/sec execute 386 sec latency 597.122 ms 2023-12-16T01:36:05.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 12989 0.13 MB/sec execute 387 sec latency 309.635 ms 2023-12-16T01:36:06.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13012 0.13 MB/sec execute 388 sec latency 313.489 ms 2023-12-16T01:36:07.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13018 0.13 MB/sec execute 389 sec latency 298.316 ms 2023-12-16T01:36:08.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13025 0.13 MB/sec execute 390 sec latency 543.047 ms 2023-12-16T01:36:09.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13048 0.13 MB/sec execute 391 sec latency 314.195 ms 2023-12-16T01:36:10.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13064 0.13 MB/sec execute 392 sec latency 220.929 ms 2023-12-16T01:36:11.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13086 0.13 MB/sec execute 393 sec latency 344.893 ms 2023-12-16T01:36:12.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13102 0.13 MB/sec execute 394 sec latency 303.733 ms 2023-12-16T01:36:13.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13124 0.13 MB/sec execute 395 sec latency 320.096 ms 2023-12-16T01:36:14.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13148 0.13 MB/sec execute 396 sec latency 322.480 ms 2023-12-16T01:36:15.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13201 0.13 MB/sec execute 397 sec latency 315.767 ms 2023-12-16T01:36:16.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13212 0.13 MB/sec execute 398 sec latency 331.075 ms 2023-12-16T01:36:17.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13232 0.13 MB/sec execute 399 sec latency 306.946 ms 2023-12-16T01:36:18.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13249 0.13 MB/sec execute 400 sec latency 340.906 ms 2023-12-16T01:36:19.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13267 0.13 MB/sec execute 401 sec latency 329.040 ms 2023-12-16T01:36:20.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13273 0.13 MB/sec execute 402 sec latency 354.120 ms 2023-12-16T01:36:21.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13397 0.13 MB/sec execute 403 sec latency 336.560 ms 2023-12-16T01:36:22.010 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13412 0.13 MB/sec execute 404 sec latency 316.955 ms 2023-12-16T01:36:23.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13431 0.13 MB/sec execute 405 sec latency 294.357 ms 2023-12-16T01:36:24.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13531 0.13 MB/sec execute 406 sec latency 305.956 ms 2023-12-16T01:36:25.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13576 0.14 MB/sec execute 407 sec latency 133.582 ms 2023-12-16T01:36:26.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13616 0.14 MB/sec execute 408 sec latency 306.204 ms 2023-12-16T01:36:27.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13626 0.14 MB/sec execute 409 sec latency 331.862 ms 2023-12-16T01:36:28.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13644 0.14 MB/sec execute 410 sec latency 292.231 ms 2023-12-16T01:36:29.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13673 0.14 MB/sec execute 411 sec latency 309.732 ms 2023-12-16T01:36:30.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13819 0.14 MB/sec execute 412 sec latency 312.902 ms 2023-12-16T01:36:31.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13839 0.14 MB/sec execute 413 sec latency 307.883 ms 2023-12-16T01:36:31.834 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:36:31.837 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:36:32.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13913 0.14 MB/sec execute 414 sec latency 201.807 ms 2023-12-16T01:36:33.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13929 0.14 MB/sec execute 415 sec latency 307.890 ms 2023-12-16T01:36:34.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13932 0.14 MB/sec execute 416 sec latency 405.865 ms 2023-12-16T01:36:35.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13936 0.14 MB/sec execute 417 sec latency 308.817 ms 2023-12-16T01:36:36.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13941 0.14 MB/sec execute 418 sec latency 366.115 ms 2023-12-16T01:36:37.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13944 0.14 MB/sec execute 419 sec latency 388.993 ms 2023-12-16T01:36:38.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13951 0.14 MB/sec execute 420 sec latency 418.475 ms 2023-12-16T01:36:39.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13956 0.14 MB/sec execute 421 sec latency 355.922 ms 2023-12-16T01:36:40.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13960 0.14 MB/sec execute 422 sec latency 321.348 ms 2023-12-16T01:36:41.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13963 0.14 MB/sec execute 423 sec latency 306.597 ms 2023-12-16T01:36:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13967 0.14 MB/sec execute 424 sec latency 305.706 ms 2023-12-16T01:36:43.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13972 0.13 MB/sec execute 425 sec latency 305.778 ms 2023-12-16T01:36:44.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13975 0.13 MB/sec execute 426 sec latency 379.805 ms 2023-12-16T01:36:45.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13980 0.13 MB/sec execute 427 sec latency 311.484 ms 2023-12-16T01:36:46.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13983 0.13 MB/sec execute 428 sec latency 304.720 ms 2023-12-16T01:36:47.011 INFO:tasks.workunit.client.0.smithi107.stdout: 1 13990 0.13 MB/sec execute 429 sec latency 306.915 ms 2023-12-16T01:36:48.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14015 0.13 MB/sec execute 430 sec latency 136.454 ms 2023-12-16T01:36:49.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14040 0.13 MB/sec execute 431 sec latency 231.832 ms 2023-12-16T01:36:50.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14047 0.13 MB/sec execute 432 sec latency 327.502 ms 2023-12-16T01:36:51.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14176 0.14 MB/sec execute 433 sec latency 305.910 ms 2023-12-16T01:36:52.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14197 0.14 MB/sec execute 434 sec latency 308.437 ms 2023-12-16T01:36:53.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14218 0.14 MB/sec execute 435 sec latency 304.975 ms 2023-12-16T01:36:54.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14232 0.14 MB/sec execute 436 sec latency 442.007 ms 2023-12-16T01:36:55.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14283 0.14 MB/sec execute 437 sec latency 128.497 ms 2023-12-16T01:36:56.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14312 0.14 MB/sec execute 438 sec latency 313.109 ms 2023-12-16T01:36:57.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14326 0.14 MB/sec execute 439 sec latency 408.018 ms 2023-12-16T01:36:58.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14347 0.14 MB/sec execute 440 sec latency 332.645 ms 2023-12-16T01:36:59.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14397 0.14 MB/sec execute 441 sec latency 187.268 ms 2023-12-16T01:37:00.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14415 0.14 MB/sec execute 442 sec latency 307.637 ms 2023-12-16T01:37:01.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14429 0.14 MB/sec execute 443 sec latency 184.207 ms 2023-12-16T01:37:01.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:37:01.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:37:02.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14439 0.14 MB/sec execute 444 sec latency 210.237 ms 2023-12-16T01:37:03.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14455 0.14 MB/sec execute 445 sec latency 171.398 ms 2023-12-16T01:37:04.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14469 0.14 MB/sec execute 446 sec latency 312.370 ms 2023-12-16T01:37:05.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14486 0.14 MB/sec execute 447 sec latency 167.563 ms 2023-12-16T01:37:06.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14503 0.14 MB/sec execute 448 sec latency 167.307 ms 2023-12-16T01:37:07.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14515 0.14 MB/sec execute 449 sec latency 288.135 ms 2023-12-16T01:37:08.012 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14535 0.14 MB/sec execute 450 sec latency 309.693 ms 2023-12-16T01:37:09.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14553 0.14 MB/sec execute 451 sec latency 317.487 ms 2023-12-16T01:37:10.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14567 0.14 MB/sec execute 452 sec latency 299.435 ms 2023-12-16T01:37:11.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14578 0.14 MB/sec execute 453 sec latency 193.789 ms 2023-12-16T01:37:12.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14592 0.14 MB/sec execute 454 sec latency 220.004 ms 2023-12-16T01:37:13.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14610 0.14 MB/sec execute 455 sec latency 154.059 ms 2023-12-16T01:37:14.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14623 0.14 MB/sec execute 456 sec latency 346.868 ms 2023-12-16T01:37:15.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14640 0.14 MB/sec execute 457 sec latency 153.978 ms 2023-12-16T01:37:16.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14657 0.14 MB/sec execute 458 sec latency 140.390 ms 2023-12-16T01:37:17.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14670 0.14 MB/sec execute 459 sec latency 323.498 ms 2023-12-16T01:37:18.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14679 0.13 MB/sec execute 460 sec latency 306.679 ms 2023-12-16T01:37:19.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14699 0.13 MB/sec execute 461 sec latency 305.366 ms 2023-12-16T01:37:20.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14721 0.13 MB/sec execute 462 sec latency 301.927 ms 2023-12-16T01:37:21.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14741 0.13 MB/sec execute 463 sec latency 288.287 ms 2023-12-16T01:37:22.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14760 0.13 MB/sec execute 464 sec latency 244.887 ms 2023-12-16T01:37:23.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14789 0.13 MB/sec execute 465 sec latency 92.303 ms 2023-12-16T01:37:24.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14802 0.13 MB/sec execute 466 sec latency 453.264 ms 2023-12-16T01:37:25.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14815 0.13 MB/sec execute 467 sec latency 395.904 ms 2023-12-16T01:37:26.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14852 0.13 MB/sec execute 468 sec latency 316.795 ms 2023-12-16T01:37:27.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14861 0.13 MB/sec execute 469 sec latency 392.000 ms 2023-12-16T01:37:28.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14888 0.13 MB/sec execute 470 sec latency 311.712 ms 2023-12-16T01:37:29.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14917 0.13 MB/sec execute 471 sec latency 307.749 ms 2023-12-16T01:37:30.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14951 0.13 MB/sec execute 472 sec latency 258.833 ms 2023-12-16T01:37:31.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 14985 0.13 MB/sec execute 473 sec latency 310.306 ms 2023-12-16T01:37:32.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15019 0.13 MB/sec execute 474 sec latency 314.177 ms 2023-12-16T01:37:32.305 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:37:32.308 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:37:33.013 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15029 0.13 MB/sec execute 475 sec latency 332.064 ms 2023-12-16T01:37:34.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15061 0.13 MB/sec execute 476 sec latency 408.391 ms 2023-12-16T01:37:35.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15082 0.13 MB/sec execute 477 sec latency 368.499 ms 2023-12-16T01:37:36.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15109 0.13 MB/sec execute 478 sec latency 291.001 ms 2023-12-16T01:37:37.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15134 0.13 MB/sec execute 479 sec latency 322.709 ms 2023-12-16T01:37:38.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15142 0.13 MB/sec execute 480 sec latency 319.426 ms 2023-12-16T01:37:39.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15174 0.13 MB/sec execute 481 sec latency 304.974 ms 2023-12-16T01:37:40.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15200 0.13 MB/sec execute 482 sec latency 313.229 ms 2023-12-16T01:37:41.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15238 0.13 MB/sec execute 483 sec latency 310.656 ms 2023-12-16T01:37:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15252 0.13 MB/sec execute 484 sec latency 353.487 ms 2023-12-16T01:37:43.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15268 0.13 MB/sec execute 485 sec latency 337.437 ms 2023-12-16T01:37:44.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15304 0.13 MB/sec execute 486 sec latency 328.864 ms 2023-12-16T01:37:45.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15331 0.13 MB/sec execute 487 sec latency 318.720 ms 2023-12-16T01:37:46.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15363 0.13 MB/sec execute 488 sec latency 291.701 ms 2023-12-16T01:37:47.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15372 0.13 MB/sec execute 489 sec latency 314.276 ms 2023-12-16T01:37:48.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15402 0.13 MB/sec execute 490 sec latency 296.264 ms 2023-12-16T01:37:49.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15427 0.13 MB/sec execute 491 sec latency 331.235 ms 2023-12-16T01:37:50.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15454 0.13 MB/sec execute 492 sec latency 341.474 ms 2023-12-16T01:37:51.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15482 0.13 MB/sec execute 493 sec latency 384.457 ms 2023-12-16T01:37:52.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15498 0.13 MB/sec execute 494 sec latency 329.159 ms 2023-12-16T01:37:53.014 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15583 0.14 MB/sec execute 495 sec latency 282.507 ms 2023-12-16T01:37:54.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15598 0.14 MB/sec execute 496 sec latency 374.435 ms 2023-12-16T01:37:55.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15620 0.14 MB/sec execute 497 sec latency 302.652 ms 2023-12-16T01:37:56.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15650 0.13 MB/sec execute 498 sec latency 186.678 ms 2023-12-16T01:37:57.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15676 0.13 MB/sec execute 499 sec latency 333.949 ms 2023-12-16T01:37:58.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15692 0.13 MB/sec execute 500 sec latency 283.043 ms 2023-12-16T01:37:59.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15725 0.13 MB/sec execute 501 sec latency 354.491 ms 2023-12-16T01:38:00.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15754 0.13 MB/sec execute 502 sec latency 296.155 ms 2023-12-16T01:38:01.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15775 0.13 MB/sec execute 503 sec latency 322.425 ms 2023-12-16T01:38:02.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15804 0.13 MB/sec execute 504 sec latency 300.646 ms 2023-12-16T01:38:02.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:38:02.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:38:03.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15817 0.13 MB/sec execute 505 sec latency 303.822 ms 2023-12-16T01:38:04.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15842 0.13 MB/sec execute 506 sec latency 444.629 ms 2023-12-16T01:38:05.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15863 0.13 MB/sec execute 507 sec latency 317.713 ms 2023-12-16T01:38:06.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15900 0.13 MB/sec execute 508 sec latency 276.911 ms 2023-12-16T01:38:07.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15937 0.13 MB/sec execute 509 sec latency 290.097 ms 2023-12-16T01:38:08.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 15988 0.13 MB/sec execute 510 sec latency 298.906 ms 2023-12-16T01:38:09.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16021 0.13 MB/sec execute 511 sec latency 320.962 ms 2023-12-16T01:38:10.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16035 0.13 MB/sec execute 512 sec latency 303.616 ms 2023-12-16T01:38:10.557 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:13:07.848 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.569 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:13:07.792 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.570 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:13:07.794 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.571 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:13:07.795 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.608 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:13:07.899 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.616 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:13:07.840 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.680 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:13:07.971 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.711 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:13:07.935 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:10.715 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:13:07.939 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:38:11.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16059 0.13 MB/sec execute 513 sec latency 311.338 ms 2023-12-16T01:38:12.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16070 0.13 MB/sec execute 514 sec latency 307.064 ms 2023-12-16T01:38:13.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16104 0.13 MB/sec execute 515 sec latency 352.646 ms 2023-12-16T01:38:14.015 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16114 0.13 MB/sec execute 516 sec latency 433.705 ms 2023-12-16T01:38:15.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16174 0.13 MB/sec execute 517 sec latency 284.815 ms 2023-12-16T01:38:16.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16198 0.13 MB/sec execute 518 sec latency 283.499 ms 2023-12-16T01:38:17.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16241 0.13 MB/sec execute 519 sec latency 295.279 ms 2023-12-16T01:38:18.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16255 0.13 MB/sec execute 520 sec latency 331.652 ms 2023-12-16T01:38:19.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16277 0.13 MB/sec execute 521 sec latency 330.036 ms 2023-12-16T01:38:20.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16293 0.13 MB/sec execute 522 sec latency 334.671 ms 2023-12-16T01:38:21.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16338 0.13 MB/sec execute 523 sec latency 338.487 ms 2023-12-16T01:38:22.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16371 0.13 MB/sec execute 524 sec latency 334.622 ms 2023-12-16T01:38:23.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16380 0.13 MB/sec execute 525 sec latency 344.498 ms 2023-12-16T01:38:24.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16410 0.13 MB/sec execute 526 sec latency 466.193 ms 2023-12-16T01:38:25.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16489 0.13 MB/sec execute 527 sec latency 299.078 ms 2023-12-16T01:38:26.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16499 0.13 MB/sec execute 528 sec latency 320.540 ms 2023-12-16T01:38:27.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16518 0.13 MB/sec execute 529 sec latency 440.070 ms 2023-12-16T01:38:28.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16531 0.13 MB/sec execute 530 sec latency 324.888 ms 2023-12-16T01:38:29.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16555 0.13 MB/sec execute 531 sec latency 298.964 ms 2023-12-16T01:38:30.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16560 0.13 MB/sec execute 532 sec latency 380.816 ms 2023-12-16T01:38:31.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16567 0.13 MB/sec execute 533 sec latency 549.009 ms 2023-12-16T01:38:32.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16591 0.13 MB/sec execute 534 sec latency 291.628 ms 2023-12-16T01:38:32.508 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:38:32.511 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:38:33.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16606 0.13 MB/sec execute 535 sec latency 334.393 ms 2023-12-16T01:38:34.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16628 0.13 MB/sec execute 536 sec latency 348.050 ms 2023-12-16T01:38:35.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16644 0.13 MB/sec execute 537 sec latency 325.868 ms 2023-12-16T01:38:36.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16666 0.13 MB/sec execute 538 sec latency 282.771 ms 2023-12-16T01:38:37.016 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16691 0.13 MB/sec execute 539 sec latency 329.184 ms 2023-12-16T01:38:38.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16744 0.13 MB/sec execute 540 sec latency 326.296 ms 2023-12-16T01:38:39.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16755 0.13 MB/sec execute 541 sec latency 315.513 ms 2023-12-16T01:38:40.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16775 0.13 MB/sec execute 542 sec latency 301.601 ms 2023-12-16T01:38:41.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16795 0.13 MB/sec execute 543 sec latency 307.189 ms 2023-12-16T01:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16810 0.13 MB/sec execute 544 sec latency 297.625 ms 2023-12-16T01:38:43.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16816 0.13 MB/sec execute 545 sec latency 317.243 ms 2023-12-16T01:38:44.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16913 0.13 MB/sec execute 546 sec latency 330.109 ms 2023-12-16T01:38:45.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16953 0.13 MB/sec execute 547 sec latency 307.381 ms 2023-12-16T01:38:46.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 16973 0.13 MB/sec execute 548 sec latency 344.053 ms 2023-12-16T01:38:47.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17072 0.13 MB/sec execute 549 sec latency 312.155 ms 2023-12-16T01:38:48.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17109 0.14 MB/sec execute 550 sec latency 182.551 ms 2023-12-16T01:38:49.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17135 0.14 MB/sec execute 551 sec latency 285.235 ms 2023-12-16T01:38:50.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17166 0.14 MB/sec execute 552 sec latency 324.189 ms 2023-12-16T01:38:51.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17186 0.13 MB/sec execute 553 sec latency 386.634 ms 2023-12-16T01:38:52.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17210 0.13 MB/sec execute 554 sec latency 301.365 ms 2023-12-16T01:38:53.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17359 0.14 MB/sec execute 555 sec latency 303.773 ms 2023-12-16T01:38:54.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17380 0.14 MB/sec execute 556 sec latency 379.017 ms 2023-12-16T01:38:55.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17404 0.14 MB/sec execute 557 sec latency 325.995 ms 2023-12-16T01:38:56.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17465 0.14 MB/sec execute 558 sec latency 299.244 ms 2023-12-16T01:38:57.017 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17474 0.14 MB/sec execute 559 sec latency 303.854 ms 2023-12-16T01:38:58.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17479 0.14 MB/sec execute 560 sec latency 315.661 ms 2023-12-16T01:38:59.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17484 0.14 MB/sec execute 561 sec latency 395.883 ms 2023-12-16T01:39:00.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17487 0.14 MB/sec execute 562 sec latency 393.419 ms 2023-12-16T01:39:01.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17491 0.14 MB/sec execute 563 sec latency 337.363 ms 2023-12-16T01:39:02.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17499 0.14 MB/sec execute 564 sec latency 340.273 ms 2023-12-16T01:39:02.623 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:39:02.625 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:39:03.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17503 0.14 MB/sec execute 565 sec latency 329.912 ms 2023-12-16T01:39:04.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17505 0.14 MB/sec execute 566 sec latency 421.862 ms 2023-12-16T01:39:05.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17510 0.13 MB/sec execute 567 sec latency 318.512 ms 2023-12-16T01:39:06.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17514 0.13 MB/sec execute 568 sec latency 299.982 ms 2023-12-16T01:39:07.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17517 0.13 MB/sec execute 569 sec latency 309.840 ms 2023-12-16T01:39:08.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17523 0.13 MB/sec execute 570 sec latency 300.554 ms 2023-12-16T01:39:09.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17526 0.13 MB/sec execute 571 sec latency 303.373 ms 2023-12-16T01:39:10.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17529 0.13 MB/sec execute 572 sec latency 306.503 ms 2023-12-16T01:39:11.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17556 0.13 MB/sec execute 573 sec latency 291.876 ms 2023-12-16T01:39:12.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17583 0.13 MB/sec execute 574 sec latency 130.061 ms 2023-12-16T01:39:13.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17589 0.13 MB/sec execute 575 sec latency 312.261 ms 2023-12-16T01:39:14.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17709 0.14 MB/sec execute 576 sec latency 306.486 ms 2023-12-16T01:39:15.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17737 0.14 MB/sec execute 577 sec latency 295.027 ms 2023-12-16T01:39:16.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17752 0.14 MB/sec execute 578 sec latency 313.383 ms 2023-12-16T01:39:17.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17773 0.14 MB/sec execute 579 sec latency 293.801 ms 2023-12-16T01:39:18.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17823 0.14 MB/sec execute 580 sec latency 391.882 ms 2023-12-16T01:39:19.018 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17849 0.14 MB/sec execute 581 sec latency 327.838 ms 2023-12-16T01:39:20.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17866 0.14 MB/sec execute 582 sec latency 313.051 ms 2023-12-16T01:39:21.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17885 0.14 MB/sec execute 583 sec latency 297.348 ms 2023-12-16T01:39:22.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17939 0.14 MB/sec execute 584 sec latency 138.067 ms 2023-12-16T01:39:23.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17957 0.14 MB/sec execute 585 sec latency 299.384 ms 2023-12-16T01:39:24.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17972 0.14 MB/sec execute 586 sec latency 207.082 ms 2023-12-16T01:39:25.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17980 0.14 MB/sec execute 587 sec latency 199.603 ms 2023-12-16T01:39:26.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 17995 0.14 MB/sec execute 588 sec latency 242.927 ms 2023-12-16T01:39:27.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18011 0.14 MB/sec execute 589 sec latency 164.504 ms 2023-12-16T01:39:28.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18028 0.14 MB/sec execute 590 sec latency 157.973 ms 2023-12-16T01:39:29.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18043 0.14 MB/sec execute 591 sec latency 266.226 ms 2023-12-16T01:39:30.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18057 0.14 MB/sec execute 592 sec latency 292.421 ms 2023-12-16T01:39:31.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18079 0.14 MB/sec execute 593 sec latency 299.446 ms 2023-12-16T01:39:32.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18090 0.14 MB/sec execute 594 sec latency 312.397 ms 2023-12-16T01:39:32.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:39:32.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:39:33.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18110 0.14 MB/sec execute 595 sec latency 307.591 ms 2023-12-16T01:39:34.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18121 0.14 MB/sec execute 596 sec latency 192.978 ms 2023-12-16T01:39:35.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18135 0.14 MB/sec execute 597 sec latency 190.743 ms 2023-12-16T01:39:36.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18151 0.14 MB/sec execute 598 sec latency 167.254 ms 2023-12-16T01:39:37.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 18168 0.14 MB/sec execute 599 sec latency 165.052 ms 2023-12-16T01:39:38.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 600 sec 2023-12-16T01:39:39.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 601 sec 2023-12-16T01:39:40.019 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 602 sec 2023-12-16T01:39:41.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 603 sec 2023-12-16T01:39:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 604 sec 2023-12-16T01:39:43.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 605 sec 2023-12-16T01:39:44.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 606 sec 2023-12-16T01:39:45.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 607 sec 2023-12-16T01:39:46.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 608 sec 2023-12-16T01:39:47.020 INFO:tasks.workunit.client.0.smithi107.stdout: 1 cleanup 609 sec 2023-12-16T01:39:47.101 INFO:tasks.workunit.client.0.smithi107.stdout: 0 cleanup 609 sec 2023-12-16T01:39:47.101 INFO:tasks.workunit.client.0.smithi107.stdout: 2023-12-16T01:39:47.101 INFO:tasks.workunit.client.0.smithi107.stdout: Operation Count AvgLat MaxLat 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: ---------------------------------------- 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: NTCreateX 2614 64.475 346.862 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Close 1896 1.133 11.231 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Rename 108 178.811 339.537 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Unlink 538 70.016 170.749 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Qpathinfo 2338 34.298 370.371 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Qfileinfo 396 0.940 4.445 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Qfsinfo 435 6.388 59.789 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Sfileinfo 200 11.406 21.593 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: Find 877 311.996 597.117 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: WriteX 1254 3.996 111.921 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: ReadX 3999 0.022 1.740 2023-12-16T01:39:47.102 INFO:tasks.workunit.client.0.smithi107.stdout: LockX 8 16.220 19.974 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stdout: UnlockX 8 19.443 52.243 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stdout: Flush 172 45.139 121.411 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stdout: 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stdout:Throughput 0.135497 MB/sec 1 clients 1 procs max_latency=597.122 ms 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stderr:+ dbench 10 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-16T01:39:47.103 INFO:tasks.workunit.client.0.smithi107.stdout: 2023-12-16T01:39:47.104 INFO:tasks.workunit.client.0.smithi107.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-16T01:39:47.104 INFO:tasks.workunit.client.0.smithi107.stdout:8 of 10 processes prepared for launch 0 sec 2023-12-16T01:39:47.203 INFO:tasks.workunit.client.0.smithi107.stdout:10 of 10 processes prepared for launch 0 sec 2023-12-16T01:39:47.203 INFO:tasks.workunit.client.0.smithi107.stdout:releasing clients 2023-12-16T01:39:48.203 INFO:tasks.workunit.client.0.smithi107.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.898 ms 2023-12-16T01:39:49.203 INFO:tasks.workunit.client.0.smithi107.stdout: 2 8 1.05 MB/sec warmup 2 sec latency 2000.006 ms 2023-12-16T01:39:50.203 INFO:tasks.workunit.client.0.smithi107.stdout: 2 15 1.40 MB/sec warmup 3 sec latency 571.343 ms 2023-12-16T01:39:51.203 INFO:tasks.workunit.client.0.smithi107.stdout: 3 25 2.10 MB/sec warmup 4 sec latency 575.398 ms 2023-12-16T01:39:52.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 40 3.05 MB/sec warmup 5 sec latency 744.343 ms 2023-12-16T01:39:53.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 57 3.99 MB/sec warmup 6 sec latency 807.792 ms 2023-12-16T01:39:54.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 73 4.58 MB/sec warmup 7 sec latency 773.374 ms 2023-12-16T01:39:55.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 89 5.05 MB/sec warmup 8 sec latency 797.535 ms 2023-12-16T01:39:56.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 104 5.34 MB/sec warmup 9 sec latency 854.933 ms 2023-12-16T01:39:57.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 117 5.38 MB/sec warmup 10 sec latency 1075.197 ms 2023-12-16T01:39:58.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 123 5.07 MB/sec warmup 11 sec latency 964.797 ms 2023-12-16T01:39:59.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 131 4.85 MB/sec warmup 12 sec latency 1064.578 ms 2023-12-16T01:40:00.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 136 4.59 MB/sec warmup 13 sec latency 1476.544 ms 2023-12-16T01:40:01.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 142 4.39 MB/sec warmup 14 sec latency 1167.811 ms 2023-12-16T01:40:02.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 148 4.21 MB/sec warmup 15 sec latency 1272.225 ms 2023-12-16T01:40:02.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:40:02.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:40:03.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 155 4.07 MB/sec warmup 16 sec latency 1073.260 ms 2023-12-16T01:40:04.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 159 3.93 MB/sec warmup 17 sec latency 1441.624 ms 2023-12-16T01:40:05.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 162 3.75 MB/sec warmup 18 sec latency 2071.555 ms 2023-12-16T01:40:06.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 166 3.62 MB/sec warmup 19 sec latency 2602.157 ms 2023-12-16T01:40:07.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 173 3.53 MB/sec warmup 20 sec latency 2694.304 ms 2023-12-16T01:40:08.203 INFO:tasks.workunit.client.0.smithi107.stdout: 10 178 3.43 MB/sec warmup 21 sec latency 1220.842 ms 2023-12-16T01:40:09.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 185 3.39 MB/sec warmup 22 sec latency 1447.675 ms 2023-12-16T01:40:10.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 192 3.34 MB/sec warmup 23 sec latency 2001.319 ms 2023-12-16T01:40:11.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 197 3.27 MB/sec warmup 24 sec latency 1239.815 ms 2023-12-16T01:40:12.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 202 3.20 MB/sec warmup 25 sec latency 1397.700 ms 2023-12-16T01:40:13.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 207 3.13 MB/sec warmup 26 sec latency 1451.765 ms 2023-12-16T01:40:14.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 213 3.09 MB/sec warmup 27 sec latency 1632.791 ms 2023-12-16T01:40:15.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 214 2.98 MB/sec warmup 28 sec latency 2143.536 ms 2023-12-16T01:40:16.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 221 2.96 MB/sec warmup 29 sec latency 2134.236 ms 2023-12-16T01:40:17.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 229 2.94 MB/sec warmup 30 sec latency 1452.402 ms 2023-12-16T01:40:18.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 235 2.91 MB/sec warmup 31 sec latency 1280.580 ms 2023-12-16T01:40:19.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 239 2.87 MB/sec warmup 32 sec latency 1480.718 ms 2023-12-16T01:40:20.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 244 2.83 MB/sec warmup 33 sec latency 1614.294 ms 2023-12-16T01:40:21.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 251 2.80 MB/sec warmup 34 sec latency 1685.458 ms 2023-12-16T01:40:22.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 257 2.77 MB/sec warmup 35 sec latency 1766.576 ms 2023-12-16T01:40:23.204 INFO:tasks.workunit.client.0.smithi107.stdout: 10 262 2.75 MB/sec warmup 36 sec latency 1670.559 ms 2023-12-16T01:40:24.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 268 2.72 MB/sec warmup 37 sec latency 1919.047 ms 2023-12-16T01:40:25.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 270 2.67 MB/sec warmup 38 sec latency 2418.116 ms 2023-12-16T01:40:26.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 274 2.63 MB/sec warmup 39 sec latency 3200.178 ms 2023-12-16T01:40:27.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 280 2.62 MB/sec warmup 40 sec latency 2321.641 ms 2023-12-16T01:40:28.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 285 2.59 MB/sec warmup 41 sec latency 1866.148 ms 2023-12-16T01:40:29.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 289 2.56 MB/sec warmup 42 sec latency 1563.477 ms 2023-12-16T01:40:30.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 297 2.56 MB/sec warmup 43 sec latency 1984.841 ms 2023-12-16T01:40:31.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 301 2.52 MB/sec warmup 44 sec latency 1553.879 ms 2023-12-16T01:40:32.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 307 2.51 MB/sec warmup 45 sec latency 1698.477 ms 2023-12-16T01:40:32.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:40:32.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:40:33.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 314 2.50 MB/sec warmup 46 sec latency 1556.062 ms 2023-12-16T01:40:34.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 319 2.48 MB/sec warmup 47 sec latency 1763.519 ms 2023-12-16T01:40:35.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 323 2.45 MB/sec warmup 48 sec latency 1545.196 ms 2023-12-16T01:40:36.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 327 2.43 MB/sec warmup 49 sec latency 2221.941 ms 2023-12-16T01:40:37.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 331 2.40 MB/sec warmup 50 sec latency 2247.502 ms 2023-12-16T01:40:38.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 338 2.39 MB/sec warmup 51 sec latency 1515.216 ms 2023-12-16T01:40:39.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 342 2.37 MB/sec warmup 52 sec latency 1593.335 ms 2023-12-16T01:40:40.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 348 2.36 MB/sec warmup 53 sec latency 2006.751 ms 2023-12-16T01:40:41.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 355 2.36 MB/sec warmup 54 sec latency 1292.435 ms 2023-12-16T01:40:42.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 361 2.35 MB/sec warmup 55 sec latency 1509.162 ms 2023-12-16T01:40:43.205 INFO:tasks.workunit.client.0.smithi107.stdout: 10 367 2.34 MB/sec warmup 56 sec latency 1496.738 ms 2023-12-16T01:40:44.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 371 2.33 MB/sec warmup 57 sec latency 1442.753 ms 2023-12-16T01:40:45.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 373 2.30 MB/sec warmup 58 sec latency 2442.856 ms 2023-12-16T01:40:46.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 379 2.29 MB/sec warmup 59 sec latency 2763.066 ms 2023-12-16T01:40:47.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 385 2.28 MB/sec warmup 60 sec latency 1888.092 ms 2023-12-16T01:40:48.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 391 2.28 MB/sec warmup 61 sec latency 1522.988 ms 2023-12-16T01:40:49.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 397 2.27 MB/sec warmup 62 sec latency 1691.143 ms 2023-12-16T01:40:50.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 403 2.27 MB/sec warmup 63 sec latency 1673.191 ms 2023-12-16T01:40:51.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 406 2.25 MB/sec warmup 64 sec latency 1349.285 ms 2023-12-16T01:40:52.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 413 2.25 MB/sec warmup 65 sec latency 1553.034 ms 2023-12-16T01:40:53.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 418 2.24 MB/sec warmup 66 sec latency 1596.935 ms 2023-12-16T01:40:54.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 422 2.23 MB/sec warmup 67 sec latency 1739.808 ms 2023-12-16T01:40:55.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 426 2.21 MB/sec warmup 68 sec latency 1976.668 ms 2023-12-16T01:40:56.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 430 2.20 MB/sec warmup 69 sec latency 2382.116 ms 2023-12-16T01:40:57.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 438 2.20 MB/sec warmup 70 sec latency 2041.287 ms 2023-12-16T01:40:58.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 443 2.19 MB/sec warmup 71 sec latency 1396.683 ms 2023-12-16T01:40:59.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 449 2.19 MB/sec warmup 72 sec latency 1707.302 ms 2023-12-16T01:41:00.206 INFO:tasks.workunit.client.0.smithi107.stdout: 10 455 2.19 MB/sec warmup 73 sec latency 1773.491 ms 2023-12-16T01:41:01.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 460 2.19 MB/sec warmup 74 sec latency 2024.414 ms 2023-12-16T01:41:02.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 470 2.20 MB/sec warmup 75 sec latency 1670.350 ms 2023-12-16T01:41:02.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:41:02.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:41:03.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 475 2.19 MB/sec warmup 76 sec latency 1640.478 ms 2023-12-16T01:41:04.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 480 2.19 MB/sec warmup 77 sec latency 2456.936 ms 2023-12-16T01:41:05.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 482 2.16 MB/sec warmup 78 sec latency 3456.999 ms 2023-12-16T01:41:06.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 484 2.14 MB/sec warmup 79 sec latency 4457.052 ms 2023-12-16T01:41:07.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 489 2.14 MB/sec warmup 80 sec latency 5457.109 ms 2023-12-16T01:41:08.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 496 2.14 MB/sec warmup 81 sec latency 5984.233 ms 2023-12-16T01:41:09.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 499 2.12 MB/sec warmup 82 sec latency 1135.666 ms 2023-12-16T01:41:10.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 502 2.11 MB/sec warmup 83 sec latency 1633.782 ms 2023-12-16T01:41:11.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 508 2.10 MB/sec warmup 84 sec latency 2290.521 ms 2023-12-16T01:41:12.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 511 2.09 MB/sec warmup 85 sec latency 3290.569 ms 2023-12-16T01:41:13.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 519 2.10 MB/sec warmup 86 sec latency 4080.342 ms 2023-12-16T01:41:14.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 533 2.13 MB/sec warmup 87 sec latency 1186.231 ms 2023-12-16T01:41:15.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 536 2.13 MB/sec warmup 88 sec latency 2186.306 ms 2023-12-16T01:41:16.207 INFO:tasks.workunit.client.0.smithi107.stdout: 10 552 2.16 MB/sec warmup 89 sec latency 3186.351 ms 2023-12-16T01:41:17.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 568 2.18 MB/sec warmup 90 sec latency 3891.118 ms 2023-12-16T01:41:18.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 572 2.16 MB/sec warmup 91 sec latency 2331.796 ms 2023-12-16T01:41:19.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 577 2.16 MB/sec warmup 92 sec latency 2494.020 ms 2023-12-16T01:41:20.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 583 2.16 MB/sec warmup 93 sec latency 2863.984 ms 2023-12-16T01:41:21.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 599 2.19 MB/sec warmup 94 sec latency 3237.871 ms 2023-12-16T01:41:22.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 612 2.21 MB/sec warmup 95 sec latency 2788.224 ms 2023-12-16T01:41:23.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 613 2.19 MB/sec warmup 96 sec latency 2500.604 ms 2023-12-16T01:41:24.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 618 2.16 MB/sec warmup 97 sec latency 2367.910 ms 2023-12-16T01:41:25.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 618 2.14 MB/sec warmup 98 sec latency 3297.784 ms 2023-12-16T01:41:26.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 628 2.12 MB/sec warmup 99 sec latency 3441.562 ms 2023-12-16T01:41:27.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 631 2.10 MB/sec warmup 100 sec latency 3395.347 ms 2023-12-16T01:41:28.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 633 2.08 MB/sec warmup 101 sec latency 3440.399 ms 2023-12-16T01:41:29.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 638 2.06 MB/sec warmup 102 sec latency 2520.289 ms 2023-12-16T01:41:30.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 642 2.04 MB/sec warmup 103 sec latency 2642.271 ms 2023-12-16T01:41:31.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 650 2.03 MB/sec warmup 104 sec latency 2414.152 ms 2023-12-16T01:41:32.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 652 2.01 MB/sec warmup 105 sec latency 2612.948 ms 2023-12-16T01:41:33.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:41:33.139 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:41:33.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 652 1.99 MB/sec warmup 106 sec latency 2611.452 ms 2023-12-16T01:41:34.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 653 1.97 MB/sec warmup 107 sec latency 2648.089 ms 2023-12-16T01:41:35.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 656 1.95 MB/sec warmup 108 sec latency 2861.945 ms 2023-12-16T01:41:36.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 663 1.94 MB/sec warmup 109 sec latency 3151.820 ms 2023-12-16T01:41:37.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 668 1.92 MB/sec warmup 110 sec latency 3000.126 ms 2023-12-16T01:41:38.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 671 1.90 MB/sec warmup 111 sec latency 2776.614 ms 2023-12-16T01:41:39.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 674 1.89 MB/sec warmup 112 sec latency 2972.834 ms 2023-12-16T01:41:39.216 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:16:36.508 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.225 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:16:36.513 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.279 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:16:36.503 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.280 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:16:36.504 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.296 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:16:36.520 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.298 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:16:36.522 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.320 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:16:36.612 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.357 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:16:36.581 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:39.376 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:16:36.600 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:41:40.208 INFO:tasks.workunit.client.0.smithi107.stdout: 10 676 1.87 MB/sec warmup 113 sec latency 2866.959 ms 2023-12-16T01:41:41.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 680 1.86 MB/sec warmup 114 sec latency 2739.936 ms 2023-12-16T01:41:42.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 686 1.84 MB/sec warmup 115 sec latency 2825.061 ms 2023-12-16T01:41:43.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 690 1.83 MB/sec warmup 116 sec latency 2819.950 ms 2023-12-16T01:41:44.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 697 1.81 MB/sec warmup 117 sec latency 2899.412 ms 2023-12-16T01:41:45.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 700 1.80 MB/sec warmup 118 sec latency 2245.197 ms 2023-12-16T01:41:46.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 705 1.78 MB/sec warmup 119 sec latency 3070.611 ms 2023-12-16T01:41:48.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 713 0.18 MB/sec execute 1 sec latency 3569.248 ms 2023-12-16T01:41:49.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 720 0.20 MB/sec execute 2 sec latency 3380.611 ms 2023-12-16T01:41:50.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 727 0.16 MB/sec execute 3 sec latency 3657.569 ms 2023-12-16T01:41:51.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 733 0.12 MB/sec execute 4 sec latency 3661.588 ms 2023-12-16T01:41:52.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 736 0.14 MB/sec execute 5 sec latency 3082.398 ms 2023-12-16T01:41:53.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 738 0.12 MB/sec execute 6 sec latency 3876.891 ms 2023-12-16T01:41:54.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 745 0.15 MB/sec execute 7 sec latency 3421.108 ms 2023-12-16T01:41:55.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 748 0.14 MB/sec execute 8 sec latency 3582.058 ms 2023-12-16T01:41:56.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 754 0.13 MB/sec execute 9 sec latency 3744.203 ms 2023-12-16T01:41:57.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 757 0.12 MB/sec execute 10 sec latency 3278.663 ms 2023-12-16T01:41:58.209 INFO:tasks.workunit.client.0.smithi107.stdout: 10 761 0.12 MB/sec execute 11 sec latency 3379.126 ms 2023-12-16T01:41:59.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 768 0.12 MB/sec execute 12 sec latency 3123.325 ms 2023-12-16T01:42:00.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 771 0.12 MB/sec execute 13 sec latency 3215.328 ms 2023-12-16T01:42:01.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 774 0.11 MB/sec execute 14 sec latency 3387.729 ms 2023-12-16T01:42:02.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 779 0.11 MB/sec execute 15 sec latency 2956.374 ms 2023-12-16T01:42:03.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 789 0.12 MB/sec execute 16 sec latency 3269.857 ms 2023-12-16T01:42:03.226 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:42:03.229 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:42:04.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 794 0.12 MB/sec execute 17 sec latency 2357.013 ms 2023-12-16T01:42:05.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 797 0.12 MB/sec execute 18 sec latency 3357.041 ms 2023-12-16T01:42:06.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 801 0.12 MB/sec execute 19 sec latency 3493.013 ms 2023-12-16T01:42:07.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 807 0.12 MB/sec execute 20 sec latency 3284.760 ms 2023-12-16T01:42:08.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 811 0.12 MB/sec execute 21 sec latency 3101.330 ms 2023-12-16T01:42:09.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 817 0.12 MB/sec execute 22 sec latency 3082.804 ms 2023-12-16T01:42:10.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 818 0.12 MB/sec execute 23 sec latency 2973.139 ms 2023-12-16T01:42:11.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 818 0.11 MB/sec execute 24 sec latency 2976.607 ms 2023-12-16T01:42:12.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 820 0.11 MB/sec execute 25 sec latency 2831.651 ms 2023-12-16T01:42:13.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 824 0.11 MB/sec execute 26 sec latency 2223.238 ms 2023-12-16T01:42:14.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 825 0.10 MB/sec execute 27 sec latency 2411.801 ms 2023-12-16T01:42:15.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 831 0.10 MB/sec execute 28 sec latency 2415.263 ms 2023-12-16T01:42:16.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 835 0.10 MB/sec execute 29 sec latency 2445.888 ms 2023-12-16T01:42:17.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 841 0.10 MB/sec execute 30 sec latency 2518.642 ms 2023-12-16T01:42:18.210 INFO:tasks.workunit.client.0.smithi107.stdout: 10 845 0.10 MB/sec execute 31 sec latency 2466.663 ms 2023-12-16T01:42:19.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 850 0.11 MB/sec execute 32 sec latency 2322.056 ms 2023-12-16T01:42:20.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 857 0.11 MB/sec execute 33 sec latency 2760.704 ms 2023-12-16T01:42:21.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 858 0.11 MB/sec execute 34 sec latency 2685.072 ms 2023-12-16T01:42:22.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 861 0.11 MB/sec execute 35 sec latency 2670.721 ms 2023-12-16T01:42:23.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 864 0.10 MB/sec execute 36 sec latency 2798.271 ms 2023-12-16T01:42:24.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 865 0.10 MB/sec execute 37 sec latency 2625.796 ms 2023-12-16T01:42:25.124 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:17:22.415 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.127 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:17:22.418 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.149 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:17:22.441 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.181 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:17:22.404 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.185 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:17:22.409 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.190 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:17:22.413 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.194 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:17:22.417 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 869 0.10 MB/sec execute 38 sec latency 3076.764 ms 2023-12-16T01:42:25.212 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:17:22.436 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:25.221 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:17:22.444 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:42:26.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 873 0.10 MB/sec execute 39 sec latency 3491.159 ms 2023-12-16T01:42:27.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 876 0.10 MB/sec execute 40 sec latency 3523.053 ms 2023-12-16T01:42:28.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 878 0.10 MB/sec execute 41 sec latency 3203.401 ms 2023-12-16T01:42:29.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 883 0.10 MB/sec execute 42 sec latency 2849.309 ms 2023-12-16T01:42:30.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 888 0.10 MB/sec execute 43 sec latency 2768.786 ms 2023-12-16T01:42:31.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 890 0.10 MB/sec execute 44 sec latency 3113.567 ms 2023-12-16T01:42:32.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 894 0.10 MB/sec execute 45 sec latency 3337.037 ms 2023-12-16T01:42:33.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 902 0.11 MB/sec execute 46 sec latency 3388.858 ms 2023-12-16T01:42:33.313 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:42:33.315 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:42:34.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 906 0.10 MB/sec execute 47 sec latency 1728.016 ms 2023-12-16T01:42:35.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 908 0.10 MB/sec execute 48 sec latency 2728.067 ms 2023-12-16T01:42:36.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 911 0.10 MB/sec execute 49 sec latency 3615.711 ms 2023-12-16T01:42:37.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 917 0.11 MB/sec execute 50 sec latency 3664.527 ms 2023-12-16T01:42:38.211 INFO:tasks.workunit.client.0.smithi107.stdout: 10 920 0.10 MB/sec execute 51 sec latency 3377.369 ms 2023-12-16T01:42:39.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 923 0.10 MB/sec execute 52 sec latency 2292.451 ms 2023-12-16T01:42:40.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 925 0.10 MB/sec execute 53 sec latency 3292.495 ms 2023-12-16T01:42:41.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 929 0.10 MB/sec execute 54 sec latency 3711.309 ms 2023-12-16T01:42:42.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 929 0.10 MB/sec execute 55 sec latency 3050.169 ms 2023-12-16T01:42:43.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 930 0.10 MB/sec execute 56 sec latency 2715.699 ms 2023-12-16T01:42:44.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 931 0.10 MB/sec execute 57 sec latency 2321.196 ms 2023-12-16T01:42:45.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 933 0.10 MB/sec execute 58 sec latency 2344.744 ms 2023-12-16T01:42:46.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 936 0.09 MB/sec execute 59 sec latency 2622.711 ms 2023-12-16T01:42:47.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 938 0.09 MB/sec execute 60 sec latency 1218.971 ms 2023-12-16T01:42:48.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 939 0.09 MB/sec execute 61 sec latency 2219.029 ms 2023-12-16T01:42:49.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 943 0.09 MB/sec execute 62 sec latency 2465.341 ms 2023-12-16T01:42:50.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 945 0.09 MB/sec execute 63 sec latency 2380.489 ms 2023-12-16T01:42:51.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 947 0.10 MB/sec execute 64 sec latency 2662.378 ms 2023-12-16T01:42:52.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 956 0.10 MB/sec execute 65 sec latency 2702.175 ms 2023-12-16T01:42:53.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 960 0.10 MB/sec execute 66 sec latency 2545.208 ms 2023-12-16T01:42:54.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 961 0.10 MB/sec execute 67 sec latency 2542.691 ms 2023-12-16T01:42:55.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 970 0.10 MB/sec execute 68 sec latency 2685.611 ms 2023-12-16T01:42:56.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 977 0.11 MB/sec execute 69 sec latency 2134.745 ms 2023-12-16T01:42:57.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 982 0.12 MB/sec execute 70 sec latency 2463.266 ms 2023-12-16T01:42:58.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 985 0.12 MB/sec execute 71 sec latency 3135.962 ms 2023-12-16T01:42:59.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 990 0.12 MB/sec execute 72 sec latency 3461.015 ms 2023-12-16T01:43:00.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 997 0.12 MB/sec execute 73 sec latency 3856.717 ms 2023-12-16T01:43:01.212 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1003 0.13 MB/sec execute 74 sec latency 1492.315 ms 2023-12-16T01:43:02.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1009 0.14 MB/sec execute 75 sec latency 2492.372 ms 2023-12-16T01:43:03.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1009 0.14 MB/sec execute 76 sec latency 3492.447 ms 2023-12-16T01:43:03.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:43:03.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:43:04.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1011 0.14 MB/sec execute 77 sec latency 3553.194 ms 2023-12-16T01:43:05.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1023 0.18 MB/sec execute 78 sec latency 3020.625 ms 2023-12-16T01:43:06.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1032 0.21 MB/sec execute 79 sec latency 2881.646 ms 2023-12-16T01:43:07.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1032 0.21 MB/sec execute 80 sec latency 2631.716 ms 2023-12-16T01:43:08.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1034 0.20 MB/sec execute 81 sec latency 2750.363 ms 2023-12-16T01:43:09.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1039 0.20 MB/sec execute 82 sec latency 2082.422 ms 2023-12-16T01:43:10.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1039 0.20 MB/sec execute 83 sec latency 2170.904 ms 2023-12-16T01:43:11.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1040 0.20 MB/sec execute 84 sec latency 2834.412 ms 2023-12-16T01:43:12.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1044 0.20 MB/sec execute 85 sec latency 3195.743 ms 2023-12-16T01:43:13.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1049 0.19 MB/sec execute 86 sec latency 2628.828 ms 2023-12-16T01:43:14.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1051 0.19 MB/sec execute 87 sec latency 2253.385 ms 2023-12-16T01:43:15.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1052 0.19 MB/sec execute 88 sec latency 2550.336 ms 2023-12-16T01:43:16.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1052 0.19 MB/sec execute 89 sec latency 2826.933 ms 2023-12-16T01:43:17.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1056 0.19 MB/sec execute 90 sec latency 2805.997 ms 2023-12-16T01:43:18.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1058 0.18 MB/sec execute 91 sec latency 2807.886 ms 2023-12-16T01:43:19.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1059 0.18 MB/sec execute 92 sec latency 2719.346 ms 2023-12-16T01:43:20.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1061 0.18 MB/sec execute 93 sec latency 2740.642 ms 2023-12-16T01:43:21.213 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1066 0.18 MB/sec execute 94 sec latency 3049.038 ms 2023-12-16T01:43:22.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1070 0.18 MB/sec execute 95 sec latency 3108.144 ms 2023-12-16T01:43:23.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1073 0.18 MB/sec execute 96 sec latency 2505.373 ms 2023-12-16T01:43:24.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1076 0.17 MB/sec execute 97 sec latency 3043.399 ms 2023-12-16T01:43:25.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1081 0.17 MB/sec execute 98 sec latency 3219.090 ms 2023-12-16T01:43:26.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1090 0.17 MB/sec execute 99 sec latency 3114.196 ms 2023-12-16T01:43:27.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1095 0.17 MB/sec execute 100 sec latency 1436.525 ms 2023-12-16T01:43:28.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1098 0.17 MB/sec execute 101 sec latency 2436.556 ms 2023-12-16T01:43:29.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1099 0.17 MB/sec execute 102 sec latency 3436.637 ms 2023-12-16T01:43:30.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1101 0.17 MB/sec execute 103 sec latency 3754.376 ms 2023-12-16T01:43:31.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1106 0.17 MB/sec execute 104 sec latency 3628.698 ms 2023-12-16T01:43:32.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1110 0.16 MB/sec execute 105 sec latency 4089.022 ms 2023-12-16T01:43:33.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1113 0.16 MB/sec execute 106 sec latency 3361.730 ms 2023-12-16T01:43:33.545 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:43:33.548 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:43:34.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1115 0.16 MB/sec execute 107 sec latency 2592.707 ms 2023-12-16T01:43:35.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1121 0.16 MB/sec execute 108 sec latency 2718.757 ms 2023-12-16T01:43:36.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1125 0.16 MB/sec execute 109 sec latency 2864.175 ms 2023-12-16T01:43:37.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1128 0.16 MB/sec execute 110 sec latency 2927.453 ms 2023-12-16T01:43:38.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1132 0.16 MB/sec execute 111 sec latency 2413.167 ms 2023-12-16T01:43:39.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1135 0.16 MB/sec execute 112 sec latency 2125.334 ms 2023-12-16T01:43:40.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1142 0.16 MB/sec execute 113 sec latency 2153.165 ms 2023-12-16T01:43:41.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1145 0.16 MB/sec execute 114 sec latency 2641.602 ms 2023-12-16T01:43:42.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1152 0.15 MB/sec execute 115 sec latency 2957.703 ms 2023-12-16T01:43:43.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1156 0.15 MB/sec execute 116 sec latency 2574.554 ms 2023-12-16T01:43:44.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1161 0.15 MB/sec execute 117 sec latency 1389.539 ms 2023-12-16T01:43:45.214 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1162 0.15 MB/sec execute 118 sec latency 2336.807 ms 2023-12-16T01:43:46.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1165 0.15 MB/sec execute 119 sec latency 2906.026 ms 2023-12-16T01:43:47.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1167 0.15 MB/sec execute 120 sec latency 2674.949 ms 2023-12-16T01:43:48.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1171 0.15 MB/sec execute 121 sec latency 2470.164 ms 2023-12-16T01:43:49.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1173 0.15 MB/sec execute 122 sec latency 2799.937 ms 2023-12-16T01:43:50.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1176 0.15 MB/sec execute 123 sec latency 2674.183 ms 2023-12-16T01:43:51.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1176 0.14 MB/sec execute 124 sec latency 3320.961 ms 2023-12-16T01:43:52.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1179 0.14 MB/sec execute 125 sec latency 3232.969 ms 2023-12-16T01:43:53.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1181 0.14 MB/sec execute 126 sec latency 3107.559 ms 2023-12-16T01:43:54.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1183 0.14 MB/sec execute 127 sec latency 2856.591 ms 2023-12-16T01:43:55.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1185 0.14 MB/sec execute 128 sec latency 2912.565 ms 2023-12-16T01:43:56.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1190 0.14 MB/sec execute 129 sec latency 2989.713 ms 2023-12-16T01:43:57.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1193 0.14 MB/sec execute 130 sec latency 2619.864 ms 2023-12-16T01:43:58.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1198 0.14 MB/sec execute 131 sec latency 1087.603 ms 2023-12-16T01:43:59.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1199 0.14 MB/sec execute 132 sec latency 2087.630 ms 2023-12-16T01:44:00.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1201 0.14 MB/sec execute 133 sec latency 3087.661 ms 2023-12-16T01:44:01.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1205 0.14 MB/sec execute 134 sec latency 3924.661 ms 2023-12-16T01:44:02.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1215 0.14 MB/sec execute 135 sec latency 3800.768 ms 2023-12-16T01:44:03.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1219 0.14 MB/sec execute 136 sec latency 1461.819 ms 2023-12-16T01:44:03.696 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:44:03.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:44:04.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1224 0.13 MB/sec execute 137 sec latency 2461.860 ms 2023-12-16T01:44:05.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1227 0.13 MB/sec execute 138 sec latency 3072.151 ms 2023-12-16T01:44:06.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1229 0.13 MB/sec execute 139 sec latency 3840.683 ms 2023-12-16T01:44:07.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1233 0.13 MB/sec execute 140 sec latency 3592.593 ms 2023-12-16T01:44:08.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1238 0.13 MB/sec execute 141 sec latency 3679.196 ms 2023-12-16T01:44:09.215 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1244 0.13 MB/sec execute 142 sec latency 3299.060 ms 2023-12-16T01:44:10.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1249 0.13 MB/sec execute 143 sec latency 3003.654 ms 2023-12-16T01:44:11.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1254 0.13 MB/sec execute 144 sec latency 3328.373 ms 2023-12-16T01:44:12.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1259 0.13 MB/sec execute 145 sec latency 3579.288 ms 2023-12-16T01:44:13.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1263 0.14 MB/sec execute 146 sec latency 3555.673 ms 2023-12-16T01:44:14.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1270 0.15 MB/sec execute 147 sec latency 2749.232 ms 2023-12-16T01:44:15.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1272 0.15 MB/sec execute 148 sec latency 3228.971 ms 2023-12-16T01:44:16.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1275 0.15 MB/sec execute 149 sec latency 2677.748 ms 2023-12-16T01:44:17.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1280 0.15 MB/sec execute 150 sec latency 3439.088 ms 2023-12-16T01:44:18.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1286 0.15 MB/sec execute 151 sec latency 3585.451 ms 2023-12-16T01:44:19.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1292 0.15 MB/sec execute 152 sec latency 4069.263 ms 2023-12-16T01:44:20.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1298 0.16 MB/sec execute 153 sec latency 3941.011 ms 2023-12-16T01:44:21.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1299 0.16 MB/sec execute 154 sec latency 3730.062 ms 2023-12-16T01:44:22.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1300 0.16 MB/sec execute 155 sec latency 3636.671 ms 2023-12-16T01:44:23.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1300 0.16 MB/sec execute 156 sec latency 3199.834 ms 2023-12-16T01:44:24.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1301 0.16 MB/sec execute 157 sec latency 2385.685 ms 2023-12-16T01:44:25.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1312 0.18 MB/sec execute 158 sec latency 2662.113 ms 2023-12-16T01:44:26.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1320 0.19 MB/sec execute 159 sec latency 2801.207 ms 2023-12-16T01:44:27.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1322 0.19 MB/sec execute 160 sec latency 2762.648 ms 2023-12-16T01:44:28.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1323 0.19 MB/sec execute 161 sec latency 2446.236 ms 2023-12-16T01:44:29.216 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1351 0.24 MB/sec execute 162 sec latency 2201.042 ms 2023-12-16T01:44:30.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1379 0.29 MB/sec execute 163 sec latency 2430.870 ms 2023-12-16T01:44:31.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1380 0.29 MB/sec execute 164 sec latency 2643.339 ms 2023-12-16T01:44:32.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1383 0.29 MB/sec execute 165 sec latency 2722.145 ms 2023-12-16T01:44:33.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1383 0.29 MB/sec execute 166 sec latency 2568.501 ms 2023-12-16T01:44:33.860 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:44:33.862 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:44:34.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1385 0.29 MB/sec execute 167 sec latency 2366.593 ms 2023-12-16T01:44:35.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1387 0.28 MB/sec execute 168 sec latency 2504.515 ms 2023-12-16T01:44:36.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1389 0.28 MB/sec execute 169 sec latency 2550.454 ms 2023-12-16T01:44:37.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1393 0.28 MB/sec execute 170 sec latency 2722.270 ms 2023-12-16T01:44:38.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1395 0.28 MB/sec execute 171 sec latency 2630.156 ms 2023-12-16T01:44:39.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1397 0.28 MB/sec execute 172 sec latency 2333.522 ms 2023-12-16T01:44:40.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1401 0.28 MB/sec execute 173 sec latency 2170.636 ms 2023-12-16T01:44:41.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1407 0.28 MB/sec execute 174 sec latency 2561.092 ms 2023-12-16T01:44:42.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1411 0.27 MB/sec execute 175 sec latency 2676.691 ms 2023-12-16T01:44:43.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1412 0.27 MB/sec execute 176 sec latency 2423.359 ms 2023-12-16T01:44:44.217 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1413 0.27 MB/sec execute 177 sec latency 2616.734 ms 2023-12-16T01:44:45.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1418 0.27 MB/sec execute 178 sec latency 2477.051 ms 2023-12-16T01:44:46.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1427 0.27 MB/sec execute 179 sec latency 2264.367 ms 2023-12-16T01:44:47.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1432 0.27 MB/sec execute 180 sec latency 1474.456 ms 2023-12-16T01:44:48.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1434 0.26 MB/sec execute 181 sec latency 2474.496 ms 2023-12-16T01:44:49.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1435 0.26 MB/sec execute 182 sec latency 2962.190 ms 2023-12-16T01:44:50.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1440 0.26 MB/sec execute 183 sec latency 2455.117 ms 2023-12-16T01:44:51.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1449 0.26 MB/sec execute 184 sec latency 2021.688 ms 2023-12-16T01:44:52.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1452 0.26 MB/sec execute 185 sec latency 1672.415 ms 2023-12-16T01:44:53.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1458 0.26 MB/sec execute 186 sec latency 2672.442 ms 2023-12-16T01:44:54.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1459 0.26 MB/sec execute 187 sec latency 3672.470 ms 2023-12-16T01:44:55.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1460 0.26 MB/sec execute 188 sec latency 3825.914 ms 2023-12-16T01:44:56.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1462 0.25 MB/sec execute 189 sec latency 3010.592 ms 2023-12-16T01:44:57.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1468 0.25 MB/sec execute 190 sec latency 2660.654 ms 2023-12-16T01:44:58.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1475 0.25 MB/sec execute 191 sec latency 1913.492 ms 2023-12-16T01:44:59.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1477 0.25 MB/sec execute 192 sec latency 1691.290 ms 2023-12-16T01:45:00.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1479 0.25 MB/sec execute 193 sec latency 1990.086 ms 2023-12-16T01:45:01.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1482 0.25 MB/sec execute 194 sec latency 1865.661 ms 2023-12-16T01:45:02.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1486 0.25 MB/sec execute 195 sec latency 2493.736 ms 2023-12-16T01:45:03.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1488 0.25 MB/sec execute 196 sec latency 2706.422 ms 2023-12-16T01:45:03.923 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:45:03.926 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:45:04.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1495 0.25 MB/sec execute 197 sec latency 2801.321 ms 2023-12-16T01:45:05.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1499 0.24 MB/sec execute 198 sec latency 2323.828 ms 2023-12-16T01:45:06.218 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1501 0.24 MB/sec execute 199 sec latency 1884.953 ms 2023-12-16T01:45:07.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1504 0.24 MB/sec execute 200 sec latency 2453.251 ms 2023-12-16T01:45:08.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1506 0.24 MB/sec execute 201 sec latency 2639.475 ms 2023-12-16T01:45:09.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1510 0.24 MB/sec execute 202 sec latency 2912.188 ms 2023-12-16T01:45:10.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1514 0.24 MB/sec execute 203 sec latency 2631.899 ms 2023-12-16T01:45:11.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1516 0.24 MB/sec execute 204 sec latency 2748.120 ms 2023-12-16T01:45:12.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1522 0.24 MB/sec execute 205 sec latency 3264.224 ms 2023-12-16T01:45:13.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1525 0.24 MB/sec execute 206 sec latency 3206.535 ms 2023-12-16T01:45:14.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1528 0.23 MB/sec execute 207 sec latency 3413.480 ms 2023-12-16T01:45:15.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1533 0.23 MB/sec execute 208 sec latency 2861.880 ms 2023-12-16T01:45:16.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1538 0.23 MB/sec execute 209 sec latency 2947.541 ms 2023-12-16T01:45:17.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1542 0.23 MB/sec execute 210 sec latency 3405.115 ms 2023-12-16T01:45:18.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1545 0.23 MB/sec execute 211 sec latency 3539.692 ms 2023-12-16T01:45:19.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1547 0.23 MB/sec execute 212 sec latency 3319.935 ms 2023-12-16T01:45:20.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1549 0.23 MB/sec execute 213 sec latency 2639.826 ms 2023-12-16T01:45:21.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1552 0.23 MB/sec execute 214 sec latency 2844.486 ms 2023-12-16T01:45:22.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1554 0.23 MB/sec execute 215 sec latency 3542.388 ms 2023-12-16T01:45:23.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1561 0.23 MB/sec execute 216 sec latency 3395.004 ms 2023-12-16T01:45:24.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1563 0.23 MB/sec execute 217 sec latency 3545.100 ms 2023-12-16T01:45:25.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1570 0.22 MB/sec execute 218 sec latency 3589.983 ms 2023-12-16T01:45:26.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1573 0.22 MB/sec execute 219 sec latency 2468.428 ms 2023-12-16T01:45:27.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1577 0.22 MB/sec execute 220 sec latency 2953.087 ms 2023-12-16T01:45:28.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1580 0.22 MB/sec execute 221 sec latency 3057.780 ms 2023-12-16T01:45:29.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1583 0.22 MB/sec execute 222 sec latency 2883.916 ms 2023-12-16T01:45:30.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1587 0.22 MB/sec execute 223 sec latency 3199.363 ms 2023-12-16T01:45:31.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1592 0.22 MB/sec execute 224 sec latency 2127.810 ms 2023-12-16T01:45:32.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1595 0.22 MB/sec execute 225 sec latency 2189.460 ms 2023-12-16T01:45:33.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1599 0.22 MB/sec execute 226 sec latency 1609.445 ms 2023-12-16T01:45:34.137 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:45:34.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:45:34.219 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1601 0.22 MB/sec execute 227 sec latency 2609.483 ms 2023-12-16T01:45:35.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1606 0.22 MB/sec execute 228 sec latency 2991.702 ms 2023-12-16T01:45:36.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1609 0.22 MB/sec execute 229 sec latency 1320.795 ms 2023-12-16T01:45:37.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1610 0.21 MB/sec execute 230 sec latency 2253.724 ms 2023-12-16T01:45:38.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1615 0.21 MB/sec execute 231 sec latency 2421.117 ms 2023-12-16T01:45:39.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1620 0.21 MB/sec execute 232 sec latency 2430.984 ms 2023-12-16T01:45:40.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1624 0.21 MB/sec execute 233 sec latency 1860.068 ms 2023-12-16T01:45:41.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1624 0.21 MB/sec execute 234 sec latency 2710.993 ms 2023-12-16T01:45:42.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1629 0.21 MB/sec execute 235 sec latency 2993.576 ms 2023-12-16T01:45:43.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1634 0.21 MB/sec execute 236 sec latency 1485.964 ms 2023-12-16T01:45:44.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1638 0.21 MB/sec execute 237 sec latency 2211.501 ms 2023-12-16T01:45:45.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1639 0.21 MB/sec execute 238 sec latency 2383.328 ms 2023-12-16T01:45:46.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1642 0.21 MB/sec execute 239 sec latency 2840.132 ms 2023-12-16T01:45:47.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1646 0.21 MB/sec execute 240 sec latency 3123.185 ms 2023-12-16T01:45:48.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1651 0.21 MB/sec execute 241 sec latency 2242.622 ms 2023-12-16T01:45:49.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1656 0.21 MB/sec execute 242 sec latency 2618.623 ms 2023-12-16T01:45:50.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1661 0.20 MB/sec execute 243 sec latency 2870.206 ms 2023-12-16T01:45:51.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1668 0.20 MB/sec execute 244 sec latency 3091.006 ms 2023-12-16T01:45:52.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1671 0.20 MB/sec execute 245 sec latency 3767.869 ms 2023-12-16T01:45:53.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1675 0.20 MB/sec execute 246 sec latency 3443.647 ms 2023-12-16T01:45:54.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1677 0.20 MB/sec execute 247 sec latency 4055.045 ms 2023-12-16T01:45:55.220 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1678 0.20 MB/sec execute 248 sec latency 4033.950 ms 2023-12-16T01:45:56.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1682 0.20 MB/sec execute 249 sec latency 3739.108 ms 2023-12-16T01:45:57.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1685 0.20 MB/sec execute 250 sec latency 4345.645 ms 2023-12-16T01:45:58.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1691 0.20 MB/sec execute 251 sec latency 4371.401 ms 2023-12-16T01:45:59.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1694 0.20 MB/sec execute 252 sec latency 4531.214 ms 2023-12-16T01:46:00.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1699 0.20 MB/sec execute 253 sec latency 4742.653 ms 2023-12-16T01:46:01.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1704 0.20 MB/sec execute 254 sec latency 4694.546 ms 2023-12-16T01:46:02.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1708 0.20 MB/sec execute 255 sec latency 4516.907 ms 2023-12-16T01:46:03.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1714 0.20 MB/sec execute 256 sec latency 3652.065 ms 2023-12-16T01:46:04.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:46:04.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:46:04.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1718 0.20 MB/sec execute 257 sec latency 4169.077 ms 2023-12-16T01:46:05.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1723 0.19 MB/sec execute 258 sec latency 4494.498 ms 2023-12-16T01:46:06.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1726 0.19 MB/sec execute 259 sec latency 3556.180 ms 2023-12-16T01:46:07.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1727 0.19 MB/sec execute 260 sec latency 4556.249 ms 2023-12-16T01:46:08.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1731 0.19 MB/sec execute 261 sec latency 4604.229 ms 2023-12-16T01:46:09.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1735 0.19 MB/sec execute 262 sec latency 4075.448 ms 2023-12-16T01:46:10.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1736 0.19 MB/sec execute 263 sec latency 3187.034 ms 2023-12-16T01:46:11.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1741 0.19 MB/sec execute 264 sec latency 4187.063 ms 2023-12-16T01:46:12.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1746 0.19 MB/sec execute 265 sec latency 4378.914 ms 2023-12-16T01:46:13.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1750 0.19 MB/sec execute 266 sec latency 4441.230 ms 2023-12-16T01:46:14.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1753 0.19 MB/sec execute 267 sec latency 3592.496 ms 2023-12-16T01:46:15.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1760 0.19 MB/sec execute 268 sec latency 2988.104 ms 2023-12-16T01:46:16.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1766 0.19 MB/sec execute 269 sec latency 2811.479 ms 2023-12-16T01:46:17.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1770 0.19 MB/sec execute 270 sec latency 3496.380 ms 2023-12-16T01:46:18.221 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1773 0.19 MB/sec execute 271 sec latency 3843.138 ms 2023-12-16T01:46:19.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1778 0.19 MB/sec execute 272 sec latency 3649.022 ms 2023-12-16T01:46:20.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1788 0.19 MB/sec execute 273 sec latency 3844.586 ms 2023-12-16T01:46:21.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1791 0.19 MB/sec execute 274 sec latency 3490.967 ms 2023-12-16T01:46:22.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1796 0.18 MB/sec execute 275 sec latency 3750.034 ms 2023-12-16T01:46:23.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1798 0.18 MB/sec execute 276 sec latency 4307.896 ms 2023-12-16T01:46:24.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1800 0.18 MB/sec execute 277 sec latency 4276.238 ms 2023-12-16T01:46:25.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1802 0.18 MB/sec execute 278 sec latency 3481.122 ms 2023-12-16T01:46:26.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1806 0.18 MB/sec execute 279 sec latency 3193.917 ms 2023-12-16T01:46:27.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1810 0.18 MB/sec execute 280 sec latency 3876.531 ms 2023-12-16T01:46:28.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1813 0.18 MB/sec execute 281 sec latency 3898.156 ms 2023-12-16T01:46:29.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1816 0.18 MB/sec execute 282 sec latency 3276.157 ms 2023-12-16T01:46:30.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1821 0.18 MB/sec execute 283 sec latency 3490.862 ms 2023-12-16T01:46:31.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1825 0.18 MB/sec execute 284 sec latency 2545.710 ms 2023-12-16T01:46:32.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1827 0.18 MB/sec execute 285 sec latency 2197.550 ms 2023-12-16T01:46:33.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1828 0.18 MB/sec execute 286 sec latency 2429.846 ms 2023-12-16T01:46:34.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1832 0.18 MB/sec execute 287 sec latency 2757.892 ms 2023-12-16T01:46:34.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:46:34.357 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:46:35.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1837 0.18 MB/sec execute 288 sec latency 2433.250 ms 2023-12-16T01:46:36.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1839 0.18 MB/sec execute 289 sec latency 2167.163 ms 2023-12-16T01:46:37.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1842 0.18 MB/sec execute 290 sec latency 2390.029 ms 2023-12-16T01:46:38.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1845 0.18 MB/sec execute 291 sec latency 2520.200 ms 2023-12-16T01:46:39.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1849 0.18 MB/sec execute 292 sec latency 2456.047 ms 2023-12-16T01:46:40.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1851 0.18 MB/sec execute 293 sec latency 2328.748 ms 2023-12-16T01:46:41.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1856 0.17 MB/sec execute 294 sec latency 2430.187 ms 2023-12-16T01:46:42.222 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1859 0.17 MB/sec execute 295 sec latency 2640.109 ms 2023-12-16T01:46:43.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1863 0.17 MB/sec execute 296 sec latency 2532.240 ms 2023-12-16T01:46:44.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1865 0.17 MB/sec execute 297 sec latency 2377.299 ms 2023-12-16T01:46:45.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1866 0.17 MB/sec execute 298 sec latency 2226.368 ms 2023-12-16T01:46:46.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1872 0.17 MB/sec execute 299 sec latency 2315.048 ms 2023-12-16T01:46:47.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1877 0.17 MB/sec execute 300 sec latency 1391.591 ms 2023-12-16T01:46:48.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1877 0.17 MB/sec execute 301 sec latency 2242.883 ms 2023-12-16T01:46:49.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1882 0.17 MB/sec execute 302 sec latency 2341.096 ms 2023-12-16T01:46:50.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1890 0.17 MB/sec execute 303 sec latency 2327.840 ms 2023-12-16T01:46:51.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1895 0.17 MB/sec execute 304 sec latency 2235.384 ms 2023-12-16T01:46:52.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1896 0.17 MB/sec execute 305 sec latency 2386.908 ms 2023-12-16T01:46:53.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1902 0.17 MB/sec execute 306 sec latency 2671.614 ms 2023-12-16T01:46:54.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1908 0.17 MB/sec execute 307 sec latency 2573.482 ms 2023-12-16T01:46:55.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1909 0.17 MB/sec execute 308 sec latency 2791.994 ms 2023-12-16T01:46:56.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1915 0.17 MB/sec execute 309 sec latency 2558.850 ms 2023-12-16T01:46:57.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1918 0.17 MB/sec execute 310 sec latency 3032.022 ms 2023-12-16T01:46:58.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1922 0.17 MB/sec execute 311 sec latency 2811.805 ms 2023-12-16T01:46:59.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1929 0.17 MB/sec execute 312 sec latency 3014.298 ms 2023-12-16T01:47:00.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1932 0.17 MB/sec execute 313 sec latency 3316.902 ms 2023-12-16T01:47:01.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1936 0.17 MB/sec execute 314 sec latency 3302.976 ms 2023-12-16T01:47:02.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1938 0.17 MB/sec execute 315 sec latency 2514.577 ms 2023-12-16T01:47:03.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1939 0.17 MB/sec execute 316 sec latency 2843.942 ms 2023-12-16T01:47:04.223 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1946 0.17 MB/sec execute 317 sec latency 2730.917 ms 2023-12-16T01:47:04.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:47:04.472 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:47:05.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1956 0.16 MB/sec execute 318 sec latency 2351.807 ms 2023-12-16T01:47:06.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1962 0.16 MB/sec execute 319 sec latency 2660.156 ms 2023-12-16T01:47:07.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1963 0.16 MB/sec execute 320 sec latency 2765.873 ms 2023-12-16T01:47:08.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1969 0.16 MB/sec execute 321 sec latency 3361.992 ms 2023-12-16T01:47:09.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1974 0.16 MB/sec execute 322 sec latency 2939.754 ms 2023-12-16T01:47:10.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1975 0.16 MB/sec execute 323 sec latency 2917.612 ms 2023-12-16T01:47:11.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1979 0.16 MB/sec execute 324 sec latency 3701.925 ms 2023-12-16T01:47:12.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1981 0.16 MB/sec execute 325 sec latency 4534.314 ms 2023-12-16T01:47:13.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1986 0.16 MB/sec execute 326 sec latency 4490.864 ms 2023-12-16T01:47:14.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1992 0.16 MB/sec execute 327 sec latency 5036.423 ms 2023-12-16T01:47:15.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 1999 0.16 MB/sec execute 328 sec latency 5130.269 ms 2023-12-16T01:47:16.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2002 0.16 MB/sec execute 329 sec latency 4761.691 ms 2023-12-16T01:47:17.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2004 0.16 MB/sec execute 330 sec latency 3502.604 ms 2023-12-16T01:47:18.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2008 0.16 MB/sec execute 331 sec latency 3389.532 ms 2023-12-16T01:47:19.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2012 0.16 MB/sec execute 332 sec latency 2906.917 ms 2023-12-16T01:47:20.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2016 0.16 MB/sec execute 333 sec latency 2594.933 ms 2023-12-16T01:47:21.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2018 0.16 MB/sec execute 334 sec latency 3361.717 ms 2023-12-16T01:47:22.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2022 0.16 MB/sec execute 335 sec latency 3689.233 ms 2023-12-16T01:47:23.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2026 0.16 MB/sec execute 336 sec latency 3848.599 ms 2023-12-16T01:47:24.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2027 0.16 MB/sec execute 337 sec latency 4619.525 ms 2023-12-16T01:47:25.224 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2032 0.16 MB/sec execute 338 sec latency 3984.136 ms 2023-12-16T01:47:26.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2036 0.16 MB/sec execute 339 sec latency 3251.038 ms 2023-12-16T01:47:27.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2040 0.16 MB/sec execute 340 sec latency 2697.584 ms 2023-12-16T01:47:28.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2043 0.16 MB/sec execute 341 sec latency 2722.278 ms 2023-12-16T01:47:29.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2045 0.16 MB/sec execute 342 sec latency 3110.027 ms 2023-12-16T01:47:30.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2051 0.16 MB/sec execute 343 sec latency 2833.525 ms 2023-12-16T01:47:31.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2054 0.16 MB/sec execute 344 sec latency 2227.671 ms 2023-12-16T01:47:32.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2054 0.16 MB/sec execute 345 sec latency 2655.420 ms 2023-12-16T01:47:33.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2059 0.16 MB/sec execute 346 sec latency 2752.489 ms 2023-12-16T01:47:34.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2060 0.16 MB/sec execute 347 sec latency 2465.519 ms 2023-12-16T01:47:34.600 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:47:34.603 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:47:35.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2062 0.16 MB/sec execute 348 sec latency 2249.073 ms 2023-12-16T01:47:36.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2064 0.15 MB/sec execute 349 sec latency 2481.152 ms 2023-12-16T01:47:37.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2067 0.15 MB/sec execute 350 sec latency 2626.206 ms 2023-12-16T01:47:38.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2071 0.15 MB/sec execute 351 sec latency 2557.586 ms 2023-12-16T01:47:39.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2072 0.15 MB/sec execute 352 sec latency 2570.269 ms 2023-12-16T01:47:40.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2076 0.15 MB/sec execute 353 sec latency 2686.846 ms 2023-12-16T01:47:41.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2080 0.15 MB/sec execute 354 sec latency 2746.913 ms 2023-12-16T01:47:42.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2081 0.15 MB/sec execute 355 sec latency 2690.008 ms 2023-12-16T01:47:43.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2084 0.15 MB/sec execute 356 sec latency 3018.631 ms 2023-12-16T01:47:44.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2088 0.15 MB/sec execute 357 sec latency 3127.201 ms 2023-12-16T01:47:45.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2091 0.15 MB/sec execute 358 sec latency 3537.188 ms 2023-12-16T01:47:46.225 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2098 0.15 MB/sec execute 359 sec latency 3167.804 ms 2023-12-16T01:47:47.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2104 0.15 MB/sec execute 360 sec latency 1981.223 ms 2023-12-16T01:47:48.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2106 0.15 MB/sec execute 361 sec latency 2228.583 ms 2023-12-16T01:47:49.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2107 0.15 MB/sec execute 362 sec latency 2414.034 ms 2023-12-16T01:47:50.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2108 0.15 MB/sec execute 363 sec latency 2727.568 ms 2023-12-16T01:47:51.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2111 0.15 MB/sec execute 364 sec latency 2781.216 ms 2023-12-16T01:47:52.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2112 0.15 MB/sec execute 365 sec latency 3394.446 ms 2023-12-16T01:47:53.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2115 0.15 MB/sec execute 366 sec latency 3603.612 ms 2023-12-16T01:47:54.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2122 0.15 MB/sec execute 367 sec latency 3168.635 ms 2023-12-16T01:47:55.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2131 0.15 MB/sec execute 368 sec latency 2462.649 ms 2023-12-16T01:47:56.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2137 0.15 MB/sec execute 369 sec latency 2268.226 ms 2023-12-16T01:47:57.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2138 0.15 MB/sec execute 370 sec latency 2819.598 ms 2023-12-16T01:47:58.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2144 0.15 MB/sec execute 371 sec latency 2705.022 ms 2023-12-16T01:47:59.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2149 0.15 MB/sec execute 372 sec latency 2426.690 ms 2023-12-16T01:48:00.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2155 0.15 MB/sec execute 373 sec latency 2326.131 ms 2023-12-16T01:48:01.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2156 0.15 MB/sec execute 374 sec latency 2548.509 ms 2023-12-16T01:48:02.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2159 0.15 MB/sec execute 375 sec latency 3548.610 ms 2023-12-16T01:48:03.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2160 0.15 MB/sec execute 376 sec latency 4507.724 ms 2023-12-16T01:48:04.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2162 0.15 MB/sec execute 377 sec latency 5138.625 ms 2023-12-16T01:48:04.748 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:48:04.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:48:05.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2164 0.15 MB/sec execute 378 sec latency 5525.434 ms 2023-12-16T01:48:06.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2166 0.14 MB/sec execute 379 sec latency 5775.561 ms 2023-12-16T01:48:07.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2169 0.14 MB/sec execute 380 sec latency 6255.654 ms 2023-12-16T01:48:08.226 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2175 0.14 MB/sec execute 381 sec latency 5626.142 ms 2023-12-16T01:48:09.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2179 0.15 MB/sec execute 382 sec latency 4191.196 ms 2023-12-16T01:48:10.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2185 0.15 MB/sec execute 383 sec latency 2969.974 ms 2023-12-16T01:48:11.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2189 0.15 MB/sec execute 384 sec latency 2519.185 ms 2023-12-16T01:48:12.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2191 0.15 MB/sec execute 385 sec latency 2600.033 ms 2023-12-16T01:48:13.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2199 0.15 MB/sec execute 386 sec latency 2707.365 ms 2023-12-16T01:48:14.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2202 0.15 MB/sec execute 387 sec latency 2685.264 ms 2023-12-16T01:48:15.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2206 0.15 MB/sec execute 388 sec latency 2287.147 ms 2023-12-16T01:48:16.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2209 0.15 MB/sec execute 389 sec latency 2525.180 ms 2023-12-16T01:48:17.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2213 0.15 MB/sec execute 390 sec latency 2567.881 ms 2023-12-16T01:48:18.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2218 0.15 MB/sec execute 391 sec latency 2846.691 ms 2023-12-16T01:48:19.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2221 0.15 MB/sec execute 392 sec latency 3094.861 ms 2023-12-16T01:48:20.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2228 0.15 MB/sec execute 393 sec latency 2355.844 ms 2023-12-16T01:48:21.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2230 0.15 MB/sec execute 394 sec latency 2318.533 ms 2023-12-16T01:48:22.227 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2235 0.15 MB/sec execute 395 sec latency 2525.251 ms 2023-12-16T01:48:23.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2244 0.15 MB/sec execute 396 sec latency 2763.232 ms 2023-12-16T01:48:24.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2250 0.15 MB/sec execute 397 sec latency 3232.459 ms 2023-12-16T01:48:25.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2257 0.15 MB/sec execute 398 sec latency 3188.574 ms 2023-12-16T01:48:26.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2264 0.15 MB/sec execute 399 sec latency 3102.328 ms 2023-12-16T01:48:27.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2271 0.15 MB/sec execute 400 sec latency 2194.902 ms 2023-12-16T01:48:28.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2281 0.15 MB/sec execute 401 sec latency 2731.657 ms 2023-12-16T01:48:29.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2285 0.16 MB/sec execute 402 sec latency 3627.273 ms 2023-12-16T01:48:30.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2288 0.16 MB/sec execute 403 sec latency 3803.587 ms 2023-12-16T01:48:31.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2290 0.16 MB/sec execute 404 sec latency 3849.335 ms 2023-12-16T01:48:32.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2296 0.16 MB/sec execute 405 sec latency 3275.996 ms 2023-12-16T01:48:33.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2297 0.16 MB/sec execute 406 sec latency 3842.279 ms 2023-12-16T01:48:34.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2304 0.16 MB/sec execute 407 sec latency 4361.985 ms 2023-12-16T01:48:34.262 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:23:31.553 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.269 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:23:31.561 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.275 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:23:31.498 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.276 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:23:31.499 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.277 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:23:31.501 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.278 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:23:31.501 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.408 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:23:31.631 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.408 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:23:31.632 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.414 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:23:31.706 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:48:34.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:48:34.811 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:48:35.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2308 0.16 MB/sec execute 408 sec latency 4118.624 ms 2023-12-16T01:48:36.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2309 0.16 MB/sec execute 409 sec latency 4225.463 ms 2023-12-16T01:48:37.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2310 0.16 MB/sec execute 410 sec latency 2538.276 ms 2023-12-16T01:48:38.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2311 0.16 MB/sec execute 411 sec latency 3050.531 ms 2023-12-16T01:48:39.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2314 0.16 MB/sec execute 412 sec latency 3194.291 ms 2023-12-16T01:48:40.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2319 0.16 MB/sec execute 413 sec latency 3237.550 ms 2023-12-16T01:48:41.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2320 0.16 MB/sec execute 414 sec latency 2478.397 ms 2023-12-16T01:48:42.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2320 0.16 MB/sec execute 415 sec latency 2816.704 ms 2023-12-16T01:48:43.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2323 0.16 MB/sec execute 416 sec latency 2988.810 ms 2023-12-16T01:48:44.228 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2327 0.16 MB/sec execute 417 sec latency 2684.279 ms 2023-12-16T01:48:45.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2328 0.16 MB/sec execute 418 sec latency 2460.138 ms 2023-12-16T01:48:46.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2331 0.16 MB/sec execute 419 sec latency 2373.197 ms 2023-12-16T01:48:47.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2332 0.16 MB/sec execute 420 sec latency 2801.086 ms 2023-12-16T01:48:48.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2337 0.16 MB/sec execute 421 sec latency 2842.847 ms 2023-12-16T01:48:49.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2338 0.16 MB/sec execute 422 sec latency 2363.651 ms 2023-12-16T01:48:50.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2339 0.16 MB/sec execute 423 sec latency 2715.652 ms 2023-12-16T01:48:51.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2342 0.16 MB/sec execute 424 sec latency 2861.707 ms 2023-12-16T01:48:52.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2343 0.16 MB/sec execute 425 sec latency 2939.561 ms 2023-12-16T01:48:53.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2344 0.16 MB/sec execute 426 sec latency 2908.390 ms 2023-12-16T01:48:54.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2349 0.16 MB/sec execute 427 sec latency 3026.596 ms 2023-12-16T01:48:55.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2352 0.16 MB/sec execute 428 sec latency 1727.602 ms 2023-12-16T01:48:56.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2353 0.15 MB/sec execute 429 sec latency 2727.630 ms 2023-12-16T01:48:57.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2355 0.15 MB/sec execute 430 sec latency 2846.352 ms 2023-12-16T01:48:58.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2358 0.15 MB/sec execute 431 sec latency 2912.675 ms 2023-12-16T01:48:59.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2361 0.15 MB/sec execute 432 sec latency 2740.217 ms 2023-12-16T01:49:00.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2363 0.15 MB/sec execute 433 sec latency 2564.693 ms 2023-12-16T01:49:01.229 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2365 0.15 MB/sec execute 434 sec latency 2870.767 ms 2023-12-16T01:49:02.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2367 0.15 MB/sec execute 435 sec latency 2918.355 ms 2023-12-16T01:49:03.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2370 0.15 MB/sec execute 436 sec latency 3133.989 ms 2023-12-16T01:49:04.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2373 0.15 MB/sec execute 437 sec latency 2993.443 ms 2023-12-16T01:49:04.926 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:49:04.929 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:49:05.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2373 0.15 MB/sec execute 438 sec latency 3014.342 ms 2023-12-16T01:49:06.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2376 0.15 MB/sec execute 439 sec latency 2578.227 ms 2023-12-16T01:49:07.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2377 0.15 MB/sec execute 440 sec latency 2532.024 ms 2023-12-16T01:49:08.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2379 0.15 MB/sec execute 441 sec latency 2877.495 ms 2023-12-16T01:49:09.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2380 0.15 MB/sec execute 442 sec latency 2951.936 ms 2023-12-16T01:49:10.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2382 0.15 MB/sec execute 443 sec latency 2946.625 ms 2023-12-16T01:49:11.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2386 0.15 MB/sec execute 444 sec latency 2586.629 ms 2023-12-16T01:49:12.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2389 0.15 MB/sec execute 445 sec latency 2590.281 ms 2023-12-16T01:49:13.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2391 0.15 MB/sec execute 446 sec latency 2924.457 ms 2023-12-16T01:49:14.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2393 0.15 MB/sec execute 447 sec latency 3374.199 ms 2023-12-16T01:49:15.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2397 0.15 MB/sec execute 448 sec latency 3171.087 ms 2023-12-16T01:49:16.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2400 0.15 MB/sec execute 449 sec latency 2912.675 ms 2023-12-16T01:49:17.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2402 0.15 MB/sec execute 450 sec latency 2594.039 ms 2023-12-16T01:49:18.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2403 0.15 MB/sec execute 451 sec latency 3213.303 ms 2023-12-16T01:49:19.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2408 0.15 MB/sec execute 452 sec latency 3022.895 ms 2023-12-16T01:49:20.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2411 0.15 MB/sec execute 453 sec latency 3352.106 ms 2023-12-16T01:49:21.230 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2414 0.15 MB/sec execute 454 sec latency 1927.679 ms 2023-12-16T01:49:22.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2416 0.15 MB/sec execute 455 sec latency 2927.768 ms 2023-12-16T01:49:23.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2419 0.15 MB/sec execute 456 sec latency 3309.961 ms 2023-12-16T01:49:24.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2424 0.15 MB/sec execute 457 sec latency 3137.542 ms 2023-12-16T01:49:25.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2427 0.15 MB/sec execute 458 sec latency 3418.273 ms 2023-12-16T01:49:26.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2431 0.15 MB/sec execute 459 sec latency 1878.891 ms 2023-12-16T01:49:27.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2433 0.15 MB/sec execute 460 sec latency 2878.944 ms 2023-12-16T01:49:28.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2434 0.15 MB/sec execute 461 sec latency 3146.034 ms 2023-12-16T01:49:29.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2439 0.15 MB/sec execute 462 sec latency 3061.537 ms 2023-12-16T01:49:30.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2441 0.15 MB/sec execute 463 sec latency 3231.927 ms 2023-12-16T01:49:31.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2444 0.15 MB/sec execute 464 sec latency 2744.180 ms 2023-12-16T01:49:31.297 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:24:28.588 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.351 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:24:28.642 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.389 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:24:28.680 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.406 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:24:28.630 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.406 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:24:28.630 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.410 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:24:28.634 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.412 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:24:28.636 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.443 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:24:28.667 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:31.445 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:24:28.668 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:49:32.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2447 0.15 MB/sec execute 465 sec latency 3128.721 ms 2023-12-16T01:49:33.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2449 0.15 MB/sec execute 466 sec latency 3187.964 ms 2023-12-16T01:49:34.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2453 0.15 MB/sec execute 467 sec latency 3392.206 ms 2023-12-16T01:49:35.044 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:49:35.047 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:49:35.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2455 0.15 MB/sec execute 468 sec latency 3473.073 ms 2023-12-16T01:49:36.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2457 0.15 MB/sec execute 469 sec latency 3061.354 ms 2023-12-16T01:49:37.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2463 0.15 MB/sec execute 470 sec latency 2922.333 ms 2023-12-16T01:49:38.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2466 0.15 MB/sec execute 471 sec latency 2746.890 ms 2023-12-16T01:49:39.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2469 0.15 MB/sec execute 472 sec latency 2936.299 ms 2023-12-16T01:49:40.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2472 0.15 MB/sec execute 473 sec latency 3198.353 ms 2023-12-16T01:49:41.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2476 0.15 MB/sec execute 474 sec latency 2611.315 ms 2023-12-16T01:49:42.231 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2478 0.15 MB/sec execute 475 sec latency 2849.084 ms 2023-12-16T01:49:43.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2483 0.15 MB/sec execute 476 sec latency 3124.329 ms 2023-12-16T01:49:44.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2487 0.15 MB/sec execute 477 sec latency 3453.731 ms 2023-12-16T01:49:45.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2494 0.16 MB/sec execute 478 sec latency 3558.109 ms 2023-12-16T01:49:46.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2496 0.16 MB/sec execute 479 sec latency 3523.941 ms 2023-12-16T01:49:47.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2504 0.16 MB/sec execute 480 sec latency 3067.320 ms 2023-12-16T01:49:48.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2505 0.16 MB/sec execute 481 sec latency 2900.011 ms 2023-12-16T01:49:49.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2507 0.16 MB/sec execute 482 sec latency 3128.290 ms 2023-12-16T01:49:50.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2511 0.16 MB/sec execute 483 sec latency 2975.686 ms 2023-12-16T01:49:51.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2515 0.16 MB/sec execute 484 sec latency 2477.017 ms 2023-12-16T01:49:52.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2517 0.16 MB/sec execute 485 sec latency 2702.459 ms 2023-12-16T01:49:53.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2518 0.16 MB/sec execute 486 sec latency 2854.433 ms 2023-12-16T01:49:54.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2524 0.16 MB/sec execute 487 sec latency 2742.679 ms 2023-12-16T01:49:55.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2530 0.16 MB/sec execute 488 sec latency 2442.788 ms 2023-12-16T01:49:56.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2537 0.16 MB/sec execute 489 sec latency 2402.561 ms 2023-12-16T01:49:57.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2539 0.16 MB/sec execute 490 sec latency 2325.113 ms 2023-12-16T01:49:58.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2541 0.16 MB/sec execute 491 sec latency 2346.213 ms 2023-12-16T01:49:59.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2552 0.16 MB/sec execute 492 sec latency 2621.578 ms 2023-12-16T01:50:00.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2557 0.16 MB/sec execute 493 sec latency 2746.881 ms 2023-12-16T01:50:01.232 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2559 0.16 MB/sec execute 494 sec latency 2574.472 ms 2023-12-16T01:50:02.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2564 0.16 MB/sec execute 495 sec latency 2583.286 ms 2023-12-16T01:50:03.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2566 0.16 MB/sec execute 496 sec latency 2860.270 ms 2023-12-16T01:50:04.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2569 0.16 MB/sec execute 497 sec latency 2822.482 ms 2023-12-16T01:50:05.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:50:05.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:50:05.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2571 0.15 MB/sec execute 498 sec latency 2909.567 ms 2023-12-16T01:50:06.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2575 0.15 MB/sec execute 499 sec latency 2878.413 ms 2023-12-16T01:50:07.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2577 0.15 MB/sec execute 500 sec latency 2938.401 ms 2023-12-16T01:50:08.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2579 0.15 MB/sec execute 501 sec latency 3345.913 ms 2023-12-16T01:50:09.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2580 0.15 MB/sec execute 502 sec latency 3101.912 ms 2023-12-16T01:50:10.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2583 0.15 MB/sec execute 503 sec latency 2946.019 ms 2023-12-16T01:50:11.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2586 0.15 MB/sec execute 504 sec latency 2829.980 ms 2023-12-16T01:50:12.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2588 0.15 MB/sec execute 505 sec latency 3055.695 ms 2023-12-16T01:50:13.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2591 0.15 MB/sec execute 506 sec latency 3208.154 ms 2023-12-16T01:50:14.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2593 0.15 MB/sec execute 507 sec latency 3264.392 ms 2023-12-16T01:50:15.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2595 0.15 MB/sec execute 508 sec latency 3101.745 ms 2023-12-16T01:50:16.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2600 0.15 MB/sec execute 509 sec latency 3308.965 ms 2023-12-16T01:50:17.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2608 0.16 MB/sec execute 510 sec latency 3144.609 ms 2023-12-16T01:50:18.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2609 0.16 MB/sec execute 511 sec latency 3013.996 ms 2023-12-16T01:50:19.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2612 0.16 MB/sec execute 512 sec latency 2897.344 ms 2023-12-16T01:50:20.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2617 0.16 MB/sec execute 513 sec latency 2991.412 ms 2023-12-16T01:50:21.233 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2619 0.16 MB/sec execute 514 sec latency 2539.851 ms 2023-12-16T01:50:22.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2622 0.16 MB/sec execute 515 sec latency 2664.754 ms 2023-12-16T01:50:23.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2627 0.16 MB/sec execute 516 sec latency 2917.621 ms 2023-12-16T01:50:24.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2635 0.16 MB/sec execute 517 sec latency 3127.399 ms 2023-12-16T01:50:25.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2646 0.17 MB/sec execute 518 sec latency 3205.714 ms 2023-12-16T01:50:26.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2648 0.17 MB/sec execute 519 sec latency 3050.356 ms 2023-12-16T01:50:27.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2652 0.17 MB/sec execute 520 sec latency 2537.300 ms 2023-12-16T01:50:28.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2656 0.17 MB/sec execute 521 sec latency 2620.184 ms 2023-12-16T01:50:29.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2658 0.17 MB/sec execute 522 sec latency 2467.306 ms 2023-12-16T01:50:30.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2660 0.17 MB/sec execute 523 sec latency 2370.001 ms 2023-12-16T01:50:31.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2671 0.17 MB/sec execute 524 sec latency 2491.404 ms 2023-12-16T01:50:32.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2676 0.17 MB/sec execute 525 sec latency 2545.179 ms 2023-12-16T01:50:33.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2683 0.18 MB/sec execute 526 sec latency 2745.135 ms 2023-12-16T01:50:34.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2695 0.18 MB/sec execute 527 sec latency 2812.425 ms 2023-12-16T01:50:35.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2709 0.18 MB/sec execute 528 sec latency 2684.922 ms 2023-12-16T01:50:35.288 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:50:35.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:50:36.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2729 0.19 MB/sec execute 529 sec latency 2692.803 ms 2023-12-16T01:50:37.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2734 0.19 MB/sec execute 530 sec latency 2432.349 ms 2023-12-16T01:50:38.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2739 0.19 MB/sec execute 531 sec latency 2410.622 ms 2023-12-16T01:50:39.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2752 0.20 MB/sec execute 532 sec latency 2747.957 ms 2023-12-16T01:50:40.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2765 0.20 MB/sec execute 533 sec latency 2608.747 ms 2023-12-16T01:50:41.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2776 0.20 MB/sec execute 534 sec latency 2469.388 ms 2023-12-16T01:50:42.234 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2790 0.20 MB/sec execute 535 sec latency 2629.189 ms 2023-12-16T01:50:43.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2795 0.20 MB/sec execute 536 sec latency 2585.260 ms 2023-12-16T01:50:44.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2798 0.20 MB/sec execute 537 sec latency 3003.962 ms 2023-12-16T01:50:45.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2801 0.20 MB/sec execute 538 sec latency 3132.103 ms 2023-12-16T01:50:46.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2804 0.20 MB/sec execute 539 sec latency 3145.107 ms 2023-12-16T01:50:46.603 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:25:43.894 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.655 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:25:43.946 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.664 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:25:43.887 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.688 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:25:43.911 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.714 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:25:43.937 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.721 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:25:43.944 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.725 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:25:44.017 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.729 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:25:43.953 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:46.769 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:25:43.993 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:50:47.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2807 0.20 MB/sec execute 540 sec latency 3185.689 ms 2023-12-16T01:50:48.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2810 0.20 MB/sec execute 541 sec latency 2708.176 ms 2023-12-16T01:50:49.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2814 0.20 MB/sec execute 542 sec latency 3378.527 ms 2023-12-16T01:50:50.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2829 0.21 MB/sec execute 543 sec latency 3018.612 ms 2023-12-16T01:50:51.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2833 0.21 MB/sec execute 544 sec latency 3269.845 ms 2023-12-16T01:50:52.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2844 0.21 MB/sec execute 545 sec latency 2882.422 ms 2023-12-16T01:50:53.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2848 0.21 MB/sec execute 546 sec latency 2806.235 ms 2023-12-16T01:50:54.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2858 0.21 MB/sec execute 547 sec latency 3088.879 ms 2023-12-16T01:50:55.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2870 0.21 MB/sec execute 548 sec latency 3360.756 ms 2023-12-16T01:50:56.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2880 0.21 MB/sec execute 549 sec latency 2894.498 ms 2023-12-16T01:50:57.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2882 0.21 MB/sec execute 550 sec latency 2637.372 ms 2023-12-16T01:50:58.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2900 0.21 MB/sec execute 551 sec latency 2540.390 ms 2023-12-16T01:50:59.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2913 0.21 MB/sec execute 552 sec latency 1902.394 ms 2023-12-16T01:51:00.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2915 0.21 MB/sec execute 553 sec latency 2902.444 ms 2023-12-16T01:51:01.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2922 0.21 MB/sec execute 554 sec latency 2926.137 ms 2023-12-16T01:51:02.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2925 0.21 MB/sec execute 555 sec latency 2858.160 ms 2023-12-16T01:51:03.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2928 0.21 MB/sec execute 556 sec latency 2499.811 ms 2023-12-16T01:51:04.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2931 0.21 MB/sec execute 557 sec latency 3499.842 ms 2023-12-16T01:51:05.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2937 0.22 MB/sec execute 558 sec latency 3916.240 ms 2023-12-16T01:51:05.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:51:05.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:51:06.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2942 0.22 MB/sec execute 559 sec latency 3625.524 ms 2023-12-16T01:51:07.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2945 0.22 MB/sec execute 560 sec latency 3651.124 ms 2023-12-16T01:51:08.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2951 0.22 MB/sec execute 561 sec latency 2961.902 ms 2023-12-16T01:51:09.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2956 0.22 MB/sec execute 562 sec latency 3659.094 ms 2023-12-16T01:51:10.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2961 0.22 MB/sec execute 563 sec latency 3135.644 ms 2023-12-16T01:51:11.235 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2966 0.22 MB/sec execute 564 sec latency 2967.459 ms 2023-12-16T01:51:12.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2968 0.22 MB/sec execute 565 sec latency 3011.831 ms 2023-12-16T01:51:13.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2973 0.22 MB/sec execute 566 sec latency 2595.126 ms 2023-12-16T01:51:14.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2989 0.22 MB/sec execute 567 sec latency 2809.633 ms 2023-12-16T01:51:15.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 2995 0.22 MB/sec execute 568 sec latency 2825.601 ms 2023-12-16T01:51:16.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3000 0.22 MB/sec execute 569 sec latency 2966.240 ms 2023-12-16T01:51:17.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3002 0.22 MB/sec execute 570 sec latency 2347.010 ms 2023-12-16T01:51:18.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3004 0.22 MB/sec execute 571 sec latency 2715.621 ms 2023-12-16T01:51:19.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3007 0.22 MB/sec execute 572 sec latency 2750.506 ms 2023-12-16T01:51:20.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3011 0.22 MB/sec execute 573 sec latency 2835.973 ms 2023-12-16T01:51:21.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3013 0.22 MB/sec execute 574 sec latency 2469.440 ms 2023-12-16T01:51:22.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3029 0.22 MB/sec execute 575 sec latency 2720.040 ms 2023-12-16T01:51:23.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3046 0.22 MB/sec execute 576 sec latency 2576.776 ms 2023-12-16T01:51:24.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3049 0.22 MB/sec execute 577 sec latency 2770.045 ms 2023-12-16T01:51:25.236 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3053 0.22 MB/sec execute 578 sec latency 2890.136 ms 2023-12-16T01:51:26.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3056 0.22 MB/sec execute 579 sec latency 2507.942 ms 2023-12-16T01:51:27.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3061 0.22 MB/sec execute 580 sec latency 1036.111 ms 2023-12-16T01:51:28.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3067 0.22 MB/sec execute 581 sec latency 1588.326 ms 2023-12-16T01:51:29.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3071 0.22 MB/sec execute 582 sec latency 2588.353 ms 2023-12-16T01:51:30.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3074 0.22 MB/sec execute 583 sec latency 3273.268 ms 2023-12-16T01:51:31.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3091 0.22 MB/sec execute 584 sec latency 2388.040 ms 2023-12-16T01:51:32.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3096 0.22 MB/sec execute 585 sec latency 2556.024 ms 2023-12-16T01:51:33.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3098 0.22 MB/sec execute 586 sec latency 2960.632 ms 2023-12-16T01:51:34.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3101 0.22 MB/sec execute 587 sec latency 3511.781 ms 2023-12-16T01:51:35.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3132 0.22 MB/sec execute 588 sec latency 3515.594 ms 2023-12-16T01:51:35.594 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:51:35.596 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:51:36.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3153 0.22 MB/sec execute 589 sec latency 3057.259 ms 2023-12-16T01:51:37.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3173 0.22 MB/sec execute 590 sec latency 2935.819 ms 2023-12-16T01:51:38.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3173 0.22 MB/sec execute 591 sec latency 2523.741 ms 2023-12-16T01:51:39.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3189 0.22 MB/sec execute 592 sec latency 2622.750 ms 2023-12-16T01:51:40.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3205 0.22 MB/sec execute 593 sec latency 2760.361 ms 2023-12-16T01:51:41.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3208 0.22 MB/sec execute 594 sec latency 2840.251 ms 2023-12-16T01:51:42.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3212 0.22 MB/sec execute 595 sec latency 3072.454 ms 2023-12-16T01:51:43.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3214 0.22 MB/sec execute 596 sec latency 3132.287 ms 2023-12-16T01:51:44.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3219 0.22 MB/sec execute 597 sec latency 3231.309 ms 2023-12-16T01:51:45.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3225 0.22 MB/sec execute 598 sec latency 3295.201 ms 2023-12-16T01:51:46.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 3229 0.22 MB/sec execute 599 sec latency 2734.876 ms 2023-12-16T01:51:47.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 600 sec 2023-12-16T01:51:48.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 601 sec 2023-12-16T01:51:49.237 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 602 sec 2023-12-16T01:51:50.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 603 sec 2023-12-16T01:51:51.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 604 sec 2023-12-16T01:51:52.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 605 sec 2023-12-16T01:51:53.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 606 sec 2023-12-16T01:51:54.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 607 sec 2023-12-16T01:51:55.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 608 sec 2023-12-16T01:51:56.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 609 sec 2023-12-16T01:51:57.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 610 sec 2023-12-16T01:51:58.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 611 sec 2023-12-16T01:51:59.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 612 sec 2023-12-16T01:52:00.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 613 sec 2023-12-16T01:52:00.314 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:26:57.605 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.318 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:26:57.610 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.323 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:26:57.546 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.325 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:26:57.548 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.325 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:26:57.548 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.328 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:26:57.552 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.358 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:26:57.650 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.387 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:26:57.610 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:00.390 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:26:57.613 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:52:01.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 614 sec 2023-12-16T01:52:02.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 615 sec 2023-12-16T01:52:03.238 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 616 sec 2023-12-16T01:52:04.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 617 sec 2023-12-16T01:52:05.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 618 sec 2023-12-16T01:52:05.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:52:05.716 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:52:06.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 619 sec 2023-12-16T01:52:07.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 620 sec 2023-12-16T01:52:08.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 621 sec 2023-12-16T01:52:09.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 622 sec 2023-12-16T01:52:10.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 623 sec 2023-12-16T01:52:11.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 624 sec 2023-12-16T01:52:12.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 625 sec 2023-12-16T01:52:13.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 626 sec 2023-12-16T01:52:14.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 627 sec 2023-12-16T01:52:15.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 628 sec 2023-12-16T01:52:16.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 629 sec 2023-12-16T01:52:17.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 630 sec 2023-12-16T01:52:18.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 631 sec 2023-12-16T01:52:19.239 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 632 sec 2023-12-16T01:52:20.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 633 sec 2023-12-16T01:52:21.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 634 sec 2023-12-16T01:52:22.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 635 sec 2023-12-16T01:52:23.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 636 sec 2023-12-16T01:52:24.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 637 sec 2023-12-16T01:52:25.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 638 sec 2023-12-16T01:52:26.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 639 sec 2023-12-16T01:52:27.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 640 sec 2023-12-16T01:52:28.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 641 sec 2023-12-16T01:52:29.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 642 sec 2023-12-16T01:52:30.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 643 sec 2023-12-16T01:52:31.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 644 sec 2023-12-16T01:52:32.240 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 645 sec 2023-12-16T01:52:33.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 646 sec 2023-12-16T01:52:34.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 647 sec 2023-12-16T01:52:35.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 648 sec 2023-12-16T01:52:35.842 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:52:35.845 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:52:36.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 649 sec 2023-12-16T01:52:37.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 650 sec 2023-12-16T01:52:38.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 651 sec 2023-12-16T01:52:39.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 652 sec 2023-12-16T01:52:40.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 653 sec 2023-12-16T01:52:41.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 654 sec 2023-12-16T01:52:42.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 655 sec 2023-12-16T01:52:43.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 656 sec 2023-12-16T01:52:44.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 657 sec 2023-12-16T01:52:45.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 658 sec 2023-12-16T01:52:46.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 659 sec 2023-12-16T01:52:47.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 660 sec 2023-12-16T01:52:48.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 661 sec 2023-12-16T01:52:49.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 662 sec 2023-12-16T01:52:50.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 663 sec 2023-12-16T01:52:51.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 664 sec 2023-12-16T01:52:52.242 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 665 sec 2023-12-16T01:52:53.242 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 666 sec 2023-12-16T01:52:54.241 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 667 sec 2023-12-16T01:52:55.242 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 668 sec 2023-12-16T01:52:56.242 INFO:tasks.workunit.client.0.smithi107.stdout: 10 cleanup 669 sec 2023-12-16T01:52:57.242 INFO:tasks.workunit.client.0.smithi107.stdout: 8 cleanup 670 sec 2023-12-16T01:52:58.242 INFO:tasks.workunit.client.0.smithi107.stdout: 8 cleanup 671 sec 2023-12-16T01:52:59.242 INFO:tasks.workunit.client.0.smithi107.stdout: 8 cleanup 672 sec 2023-12-16T01:53:00.242 INFO:tasks.workunit.client.0.smithi107.stdout: 6 cleanup 673 sec 2023-12-16T01:53:01.242 INFO:tasks.workunit.client.0.smithi107.stdout: 4 cleanup 674 sec 2023-12-16T01:53:02.242 INFO:tasks.workunit.client.0.smithi107.stdout: 2 cleanup 675 sec 2023-12-16T01:53:03.132 INFO:tasks.workunit.client.0.smithi107.stdout: 0 cleanup 676 sec 2023-12-16T01:53:03.132 INFO:tasks.workunit.client.0.smithi107.stdout: 2023-12-16T01:53:03.132 INFO:tasks.workunit.client.0.smithi107.stdout: Operation Count AvgLat MaxLat 2023-12-16T01:53:03.132 INFO:tasks.workunit.client.0.smithi107.stdout: ---------------------------------------- 2023-12-16T01:53:03.132 INFO:tasks.workunit.client.0.smithi107.stdout: NTCreateX 3930 298.871 2218.549 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Close 3254 2.950 52.570 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Rename 212 830.880 1575.915 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Unlink 470 278.554 1019.587 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Qpathinfo 3994 188.016 1856.814 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Qfileinfo 856 5.658 38.835 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Qfsinfo 524 18.999 260.935 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Sfileinfo 460 37.518 120.168 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Find 1286 2817.459 6255.650 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: WriteX 2347 12.088 354.422 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: ReadX 7600 0.067 27.956 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: LockX 20 152.758 333.615 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: UnlockX 20 150.942 283.300 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: Flush 316 271.387 716.305 2023-12-16T01:53:03.133 INFO:tasks.workunit.client.0.smithi107.stdout: 2023-12-16T01:53:03.134 INFO:tasks.workunit.client.0.smithi107.stdout:Throughput 0.224875 MB/sec 10 clients 10 procs max_latency=6255.654 ms 2023-12-16T01:53:03.134 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T01:53:03.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T01:53:05.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:53:05.924 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:53:24.844 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-12-16T01:53:24.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T01:53:25.103 DEBUG:teuthology.parallel:result is None 2023-12-16T01:53:25.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T01:53:25.291 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T01:53:25.291 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-16T01:53:25.301 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-16T01:53:25.301 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:53:25.301 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T01:53:25.316 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:53:25.316 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T01:53:25.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:53:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.509+0000 7fd7c947c640 1 Processor -- start 2023-12-16T01:53:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.510+0000 7fd7c947c640 1 -- start start 2023-12-16T01:53:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.510+0000 7fd7c947c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7c4153c70 0x7fd7c415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.510+0000 7fd7c947c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c40ceef0 0x7fd7c40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.510+0000 7fd7c947c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c415a700 con 0x7fd7c4153890 2023-12-16T01:53:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.510+0000 7fd7c947c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40ca870 con 0x7fd7c4153c70 2023-12-16T01:53:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.510+0000 7fd7c947c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4159af0 con 0x7fd7c40ceef0 2023-12-16T01:53:25.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.511+0000 7fd7c37fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c40ceef0 0x7fd7c40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:25.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.511+0000 7fd7c27fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7c4153c70 0x7fd7c415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:25.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.511+0000 7fd7c2ffd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd7c4153890 0x7fd7c40c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:38102/0 (socket says 172.21.15.107:38102) 2023-12-16T01:53:25.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.511+0000 7fd7c2ffd640 1 -- 172.21.15.107:0/2269031658 learned_addr learned my addr 172.21.15.107:0/2269031658 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:25.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.513+0000 7fd7c1ffb640 1 -- 172.21.15.107:0/2269031658 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796286027 0 0) 0x7fd7c415a700 con 0x7fd7c4153890 2023-12-16T01:53:25.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.514+0000 7fd7c1ffb640 1 -- 172.21.15.107:0/2269031658 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac003520 con 0x7fd7c4153890 2023-12-16T01:53:25.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.514+0000 7fd7c37fe640 1 -- 172.21.15.107:0/2269031658 >> v2:172.21.15.107:3300/0 conn(0x7fd7c4153c70 msgr2=0x7fd7c415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:25.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.514+0000 7fd7c37fe640 1 --2- 172.21.15.107:0/2269031658 >> v2:172.21.15.107:3300/0 conn(0x7fd7c4153c70 0x7fd7c415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:25.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.514+0000 7fd7c37fe640 1 -- 172.21.15.107:0/2269031658 >> v1:172.21.15.157:6789/0 conn(0x7fd7c4153890 legacy=0x7fd7c40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:25.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.514+0000 7fd7c37fe640 1 -- 172.21.15.107:0/2269031658 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4159dd0 con 0x7fd7c40ceef0 2023-12-16T01:53:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.516+0000 7fd7c37fe640 1 --2- 172.21.15.107:0/2269031658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c40ceef0 0x7fd7c40cf320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097a0 tx=0x7fd7bc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4a4777040c572f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c1ffb640 1 -- 172.21.15.107:0/2269031658 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc030610 con 0x7fd7c40ceef0 2023-12-16T01:53:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c1ffb640 1 -- 172.21.15.107:0/2269031658 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc030770 con 0x7fd7c40ceef0 2023-12-16T01:53:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c1ffb640 1 -- 172.21.15.107:0/2269031658 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc030b00 con 0x7fd7c40ceef0 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 -- 172.21.15.107:0/2269031658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c40ceef0 msgr2=0x7fd7c40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 --2- 172.21.15.107:0/2269031658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c40ceef0 0x7fd7c40cf320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097a0 tx=0x7fd7bc02b960 comp rx=0 tx=0).stop 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 -- 172.21.15.107:0/2269031658 shutdown_connections 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 --2- 172.21.15.107:0/2269031658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c40ceef0 0x7fd7c40cf320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 --2- 172.21.15.107:0/2269031658 >> v2:172.21.15.107:3300/0 conn(0x7fd7c4153c70 0x7fd7c415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 -- 172.21.15.107:0/2269031658 >> 172.21.15.107:0/2269031658 conn(0x7fd7c406ba00 msgr2=0x7fd7c406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.520+0000 7fd7c947c640 1 -- 172.21.15.107:0/2269031658 shutdown_connections 2023-12-16T01:53:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.521+0000 7fd7c947c640 1 -- 172.21.15.107:0/2269031658 wait complete. 2023-12-16T01:53:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.522+0000 7fd7c947c640 1 Processor -- start 2023-12-16T01:53:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.522+0000 7fd7c947c640 1 -- start start 2023-12-16T01:53:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c947c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7c40ceef0 0x7fd7c414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c947c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c4153890 0x7fd7c40b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c947c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 0x7fd7c40b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c947c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4151c30 con 0x7fd7c4153c70 2023-12-16T01:53:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c947c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4151ef0 con 0x7fd7c40ceef0 2023-12-16T01:53:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c947c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41f3500 con 0x7fd7c4153890 2023-12-16T01:53:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 0x7fd7c40b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:25.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c27fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c4153890 0x7fd7c40b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:25.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 0x7fd7c40b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46846/0 (socket says 172.21.15.107:46846) 2023-12-16T01:53:25.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.523+0000 7fd7c37fe640 1 -- 172.21.15.107:0/89991159 learned_addr learned my addr 172.21.15.107:0/89991159 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:25.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.524+0000 7fd7c2ffd640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7c40ceef0 0x7fd7c414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:25.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.527+0000 7fd7c37fe640 1 -- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c4153890 msgr2=0x7fd7c40b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:25.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.527+0000 7fd7c37fe640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c4153890 0x7fd7c40b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:25.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.527+0000 7fd7c37fe640 1 -- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7c40ceef0 msgr2=0x7fd7c414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:25.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.527+0000 7fd7c37fe640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7c40ceef0 0x7fd7c414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:25.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.527+0000 7fd7c37fe640 1 -- 172.21.15.107:0/89991159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc009400 con 0x7fd7c4153c70 2023-12-16T01:53:25.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.529+0000 7fd7c37fe640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 0x7fd7c40b3d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0098c0 tx=0x7fd7bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:25.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.532+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc03e040 con 0x7fd7c4153c70 2023-12-16T01:53:25.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.532+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c41f37a0 con 0x7fd7c4153c70 2023-12-16T01:53:25.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.532+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c4152440 con 0x7fd7c4153c70 2023-12-16T01:53:25.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.533+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4067500 con 0x7fd7c4153c70 2023-12-16T01:53:25.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.740+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc039a20 con 0x7fd7c4153c70 2023-12-16T01:53:25.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.776+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc039d90 con 0x7fd7c4153c70 2023-12-16T01:53:25.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.777+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd7bc0443f0 con 0x7fd7c4153c70 2023-12-16T01:53:25.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.777+0000 7fd7ab7fe640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006ae40 0x7fd7b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:25.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.777+0000 7fd7c2ffd640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006ae40 0x7fd7b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:25.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.778+0000 7fd7c2ffd640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006ae40 0x7fd7b006d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4005c00 tx=0x7fd7b4009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:25.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.790+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7bc07ac10 con 0x7fd7c4153c70 2023-12-16T01:53:25.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.791+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd7bc076f50 con 0x7fd7c4153c70 2023-12-16T01:53:25.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:25.966+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c41578b0 con 0x7fd7c4153c70 2023-12-16T01:53:26.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.004+0000 7fd7ab7fe640 1 -- 172.21.15.107:0/89991159 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18553 (secure 0 0 0) 0x7fd7bc049090 con 0x7fd7c4153c70 2023-12-16T01:53:26.006 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:26.007 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:26:31.279218+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:53:26.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006ae40 msgr2=0x7fd7b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006ae40 0x7fd7b006d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4005c00 tx=0x7fd7b4009040 comp rx=0 tx=0).stop 2023-12-16T01:53:26.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 msgr2=0x7fd7c40b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 0x7fd7c40b3d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0098c0 tx=0x7fd7bc004730 comp rx=0 tx=0).stop 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 shutdown_connections 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c4153c70 0x7fd7c40b3d70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7c4153890 0x7fd7c40b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd7b006ae40 0x7fd7b006d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 --2- 172.21.15.107:0/89991159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7c40ceef0 0x7fd7c414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 >> 172.21.15.107:0/89991159 conn(0x7fd7c406ba00 msgr2=0x7fd7c4157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 shutdown_connections 2023-12-16T01:53:26.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.006+0000 7fd7c947c640 1 -- 172.21.15.107:0/89991159 wait complete. 2023-12-16T01:53:26.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T01:25:45.757668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T01:25:47.362497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T01:25:52.786986+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T01:53:26.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:53:26.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.121+0000 7f8dc0f8a640 1 Processor -- start 2023-12-16T01:53:26.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.121+0000 7f8dc0f8a640 1 -- start start 2023-12-16T01:53:26.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.122+0000 7f8dc0f8a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8dbc151510 0x7f8dbc0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.122+0000 7f8dc0f8a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 0x7f8dbc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.122+0000 7f8dc0f8a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc15b6e0 con 0x7f8dbc0728b0 2023-12-16T01:53:26.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.122+0000 7f8dc0f8a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc15a880 con 0x7f8dbc151510 2023-12-16T01:53:26.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.122+0000 7f8dc0f8a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc06f7e0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.123+0000 7f8dbad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 0x7f8dbc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.123+0000 7f8dba59c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8dbc151510 0x7f8dbc0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.123+0000 7f8dbad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 0x7f8dbc0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:40998/0 (socket says 172.21.15.107:40998) 2023-12-16T01:53:26.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.123+0000 7f8dbad9d640 1 -- 172.21.15.107:0/1270994127 learned_addr learned my addr 172.21.15.107:0/1270994127 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:26.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.126+0000 7f8dbad9d640 1 -- 172.21.15.107:0/1270994127 >> v2:172.21.15.157:3300/0 conn(0x7f8dbc151510 msgr2=0x7f8dbc0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:26.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.126+0000 7f8dbad9d640 1 --2- 172.21.15.107:0/1270994127 >> v2:172.21.15.157:3300/0 conn(0x7f8dbc151510 0x7f8dbc0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.126+0000 7f8dbad9d640 1 -- 172.21.15.107:0/1270994127 >> v1:172.21.15.107:6789/0 conn(0x7f8dbc0728b0 legacy=0x7f8dbc0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.126+0000 7f8dbad9d640 1 -- 172.21.15.107:0/1270994127 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc15aad0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.129+0000 7f8dbad9d640 1 --2- 172.21.15.107:0/1270994127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 0x7f8dbc0cb370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009870 tx=0x7f8dac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e0fe41812513b8b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.135+0000 7f8db959a640 1 -- 172.21.15.107:0/1270994127 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac030840 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.135+0000 7f8db959a640 1 -- 172.21.15.107:0/1270994127 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac0309a0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.135+0000 7f8db959a640 1 -- 172.21.15.107:0/1270994127 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac030d30 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/1270994127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 msgr2=0x7f8dbc0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/1270994127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 0x7f8dbc0cb370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009870 tx=0x7f8dac02b980 comp rx=0 tx=0).stop 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/1270994127 shutdown_connections 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/1270994127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0c61a0 0x7f8dbc0cb370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/1270994127 >> v2:172.21.15.157:3300/0 conn(0x7f8dbc151510 0x7f8dbc0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/1270994127 >> 172.21.15.107:0/1270994127 conn(0x7f8dbc06cd60 msgr2=0x7f8dbc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/1270994127 shutdown_connections 2023-12-16T01:53:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.136+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/1270994127 wait complete. 2023-12-16T01:53:26.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.137+0000 7f8dc0f8a640 1 Processor -- start 2023-12-16T01:53:26.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.137+0000 7f8dc0f8a640 1 -- start start 2023-12-16T01:53:26.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.138+0000 7f8dc0f8a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0728b0 0x7f8dbc1f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.138+0000 7f8dc0f8a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 0x7f8dbc159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.138+0000 7f8dc0f8a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dbc151510 0x7f8dbc143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.138+0000 7f8dc0f8a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc157690 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.138+0000 7f8dc0f8a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc1578c0 con 0x7f8dbc151510 2023-12-16T01:53:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.138+0000 7f8dc0f8a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0c4aa0 con 0x7f8dbc0728b0 2023-12-16T01:53:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.139+0000 7f8db9d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 0x7f8dbc159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.139+0000 7f8dbad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dbc151510 0x7f8dbc143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.139+0000 7f8db9d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 0x7f8dbc159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46852/0 (socket says 172.21.15.107:46852) 2023-12-16T01:53:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.139+0000 7f8db9d9b640 1 -- 172.21.15.107:0/2280205375 learned_addr learned my addr 172.21.15.107:0/2280205375 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:26.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.139+0000 7f8dba59c640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0728b0 0x7f8dbc1f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.143+0000 7f8db9d9b640 1 -- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0728b0 msgr2=0x7f8dbc1f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.143+0000 7f8db9d9b640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0728b0 0x7f8dbc1f0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.143+0000 7f8db9d9b640 1 -- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dbc151510 msgr2=0x7f8dbc143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.143+0000 7f8db9d9b640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dbc151510 0x7f8dbc143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.143+0000 7f8db9d9b640 1 -- 172.21.15.107:0/2280205375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac0094d0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.145+0000 7f8db9d9b640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 0x7f8dbc159e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c730 tx=0x7f8da400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:26.151 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.149+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4006d50 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.151 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.149+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da400ce40 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.151 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.149+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4003bb0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.149+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc0c2920 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.149+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc0c2ee0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.150+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc0c30d0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.169+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8da4003d10 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.169+0000 7f8db2ffd640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8d9c06ae90 0x7f8d9c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.169+0000 7f8dba59c640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8d9c06ae90 0x7f8d9c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.170+0000 7f8dba59c640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8d9c06ae90 0x7f8d9c06d350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009b40 tx=0x7f8db4009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:26.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.173+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8da4058cb0 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.416+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8da4058a80 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.592+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8dbc067500 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.597+0000 7f8db2ffd640 1 -- 172.21.15.107:0/2280205375 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8da4058610 con 0x7f8dbc0c61a0 2023-12-16T01:53:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:53:26.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8d9c06ae90 msgr2=0x7f8d9c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8d9c06ae90 0x7f8d9c06d350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009b40 tx=0x7f8db4009190 comp rx=0 tx=0).stop 2023-12-16T01:53:26.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 msgr2=0x7f8dbc159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 0x7f8dbc159e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c730 tx=0x7f8da400cbf0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 shutdown_connections 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f8d9c06ae90 0x7f8d9c06d350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dbc151510 0x7f8dbc143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dbc0c61a0 0x7f8dbc159e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 --2- 172.21.15.107:0/2280205375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dbc0728b0 0x7f8dbc1f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 >> 172.21.15.107:0/2280205375 conn(0x7f8dbc06cd60 msgr2=0x7f8dbc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 shutdown_connections 2023-12-16T01:53:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.599+0000 7f8dc0f8a640 1 -- 172.21.15.107:0/2280205375 wait complete. 2023-12-16T01:53:26.612 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T01:53:26.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 Processor -- start 2023-12-16T01:53:26.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 -- start start 2023-12-16T01:53:26.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1b7c0bff00 0x7f1b7c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 0x7f1b7c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c072b60 con 0x7f1b7c1501c0 2023-12-16T01:53:26.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c1572d0 con 0x7f1b7c0bff00 2023-12-16T01:53:26.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.713+0000 7f1b81e51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0c1a90 con 0x7f1b7c156e60 2023-12-16T01:53:26.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.714+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 0x7f1b7c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.714+0000 7f1b7affd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1b7c0bff00 0x7f1b7c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.714+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 0x7f1b7c071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:41018/0 (socket says 172.21.15.107:41018) 2023-12-16T01:53:26.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.714+0000 7f1b7bfff640 1 -- 172.21.15.107:0/1164694272 learned_addr learned my addr 172.21.15.107:0/1164694272 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:26.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.717+0000 7f1b7bfff640 1 -- 172.21.15.107:0/1164694272 >> v2:172.21.15.157:3300/0 conn(0x7f1b7c0bff00 msgr2=0x7f1b7c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:26.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.717+0000 7f1b7bfff640 1 --2- 172.21.15.107:0/1164694272 >> v2:172.21.15.157:3300/0 conn(0x7f1b7c0bff00 0x7f1b7c159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.717+0000 7f1b7bfff640 1 -- 172.21.15.107:0/1164694272 >> v1:172.21.15.157:6789/0 conn(0x7f1b7c1501c0 legacy=0x7f1b7c072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.717+0000 7f1b7bfff640 1 -- 172.21.15.107:0/1164694272 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0c1d30 con 0x7f1b7c156e60 2023-12-16T01:53:26.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.719+0000 7f1b7bfff640 1 --2- 172.21.15.107:0/1164694272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 0x7f1b7c071710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009e50 tx=0x7f1b7402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c660a8f0ce6742fe server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:26.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.723+0000 7f1b7a7fc640 1 -- 172.21.15.107:0/1164694272 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7402cb90 con 0x7f1b7c156e60 2023-12-16T01:53:26.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.723+0000 7f1b7a7fc640 1 -- 172.21.15.107:0/1164694272 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7402ccf0 con 0x7f1b7c156e60 2023-12-16T01:53:26.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.723+0000 7f1b7a7fc640 1 -- 172.21.15.107:0/1164694272 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74034610 con 0x7f1b7c156e60 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 -- 172.21.15.107:0/1164694272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 msgr2=0x7f1b7c071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1164694272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 0x7f1b7c071710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009e50 tx=0x7f1b7402bff0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 -- 172.21.15.107:0/1164694272 shutdown_connections 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1164694272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c156e60 0x7f1b7c071710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1164694272 >> v2:172.21.15.157:3300/0 conn(0x7f1b7c0bff00 0x7f1b7c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 -- 172.21.15.107:0/1164694272 >> 172.21.15.107:0/1164694272 conn(0x7f1b7c06cd60 msgr2=0x7f1b7c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 -- 172.21.15.107:0/1164694272 shutdown_connections 2023-12-16T01:53:26.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.724+0000 7f1b81e51640 1 -- 172.21.15.107:0/1164694272 wait complete. 2023-12-16T01:53:26.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.725+0000 7f1b81e51640 1 Processor -- start 2023-12-16T01:53:26.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.725+0000 7f1b81e51640 1 -- start start 2023-12-16T01:53:26.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b81e51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c0bff00 0x7f1b7c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b81e51640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 0x7f1b7c159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b81e51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b7c156e60 0x7f1b7c14a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b81e51640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c157430 con 0x7f1b7c156e60 2023-12-16T01:53:26.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b81e51640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c157c40 con 0x7f1b7c1501c0 2023-12-16T01:53:26.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b81e51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c159aa0 con 0x7f1b7c0bff00 2023-12-16T01:53:26.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b7affd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 0x7f1b7c159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b7b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c0bff00 0x7f1b7c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b7c156e60 0x7f1b7c14a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b7affd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 0x7f1b7c159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:43126/0 (socket says 172.21.15.107:43126) 2023-12-16T01:53:26.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.726+0000 7f1b7affd640 1 -- 172.21.15.107:0/1831420800 learned_addr learned my addr 172.21.15.107:0/1831420800 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.730+0000 7f1b7affd640 1 -- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c0bff00 msgr2=0x7f1b7c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.730+0000 7f1b7affd640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c0bff00 0x7f1b7c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.730+0000 7f1b7affd640 1 -- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b7c156e60 msgr2=0x7f1b7c14a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.730+0000 7f1b7affd640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b7c156e60 0x7f1b7c14a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.730+0000 7f1b7affd640 1 -- 172.21.15.107:0/1831420800 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74009b30 con 0x7f1b7c1501c0 2023-12-16T01:53:26.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.732+0000 7f1b7affd640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 0x7f1b7c159560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e9b0 tx=0x7f1b7000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.736+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70009670 con 0x7f1b7c1501c0 2023-12-16T01:53:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.736+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7000c9a0 con 0x7f1b7c1501c0 2023-12-16T01:53:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.736+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c157680 con 0x7f1b7c1501c0 2023-12-16T01:53:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.736+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000cd50 con 0x7f1b7c1501c0 2023-12-16T01:53:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.736+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c152b00 con 0x7f1b7c1501c0 2023-12-16T01:53:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.737+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c0c77e0 con 0x7f1b7c1501c0 2023-12-16T01:53:26.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.756+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1b70013470 con 0x7f1b7c1501c0 2023-12-16T01:53:26.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.756+0000 7f1b63fff640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1b6806ae40 0x7f1b6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:26.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.756+0000 7f1b7b7fe640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1b6806ae40 0x7f1b6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:26.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.757+0000 7f1b7b7fe640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1b6806ae40 0x7f1b6806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c001780 tx=0x7f1b6c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:26.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:26.759+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b70058e10 con 0x7f1b7c1501c0 2023-12-16T01:53:27.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.007+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1b70055150 con 0x7f1b7c1501c0 2023-12-16T01:53:27.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.238+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b7c067500 con 0x7f1b7c1501c0 2023-12-16T01:53:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.279+0000 7f1b63fff640 1 -- 172.21.15.107:0/1831420800 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b700210a0 con 0x7f1b7c1501c0 2023-12-16T01:53:27.281 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1b6806ae40 msgr2=0x7f1b6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1b6806ae40 0x7f1b6806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c001780 tx=0x7f1b6c009040 comp rx=0 tx=0).stop 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 msgr2=0x7f1b7c159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 0x7f1b7c159560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e9b0 tx=0x7f1b7000ee70 comp rx=0 tx=0).stop 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 shutdown_connections 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b7c156e60 0x7f1b7c14a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f1b6806ae40 0x7f1b6806d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b7c1501c0 0x7f1b7c159560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 --2- 172.21.15.107:0/1831420800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b7c0bff00 0x7f1b7c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 >> 172.21.15.107:0/1831420800 conn(0x7f1b7c06cd60 msgr2=0x7f1b7c072450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 shutdown_connections 2023-12-16T01:53:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.281+0000 7f1b81e51640 1 -- 172.21.15.107:0/1831420800 wait complete. 2023-12-16T01:53:27.294 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T01:53:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.395+0000 7f579952d640 1 Processor -- start 2023-12-16T01:53:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.395+0000 7f579952d640 1 -- start start 2023-12-16T01:53:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.396+0000 7f579952d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f579406f160 0x7f5794159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.396+0000 7f579952d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57940c2e40 0x7f579415a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.396+0000 7f579952d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579406e0f0 con 0x7f57941537d0 2023-12-16T01:53:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.396+0000 7f579952d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5794159710 con 0x7f57940c2e40 2023-12-16T01:53:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.396+0000 7f579952d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940c72d0 con 0x7f579406f160 2023-12-16T01:53:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.397+0000 7f57937fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57940c2e40 0x7f579415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.397+0000 7f57927fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f579406f160 0x7f5794159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.397+0000 7f57937fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57940c2e40 0x7f579415a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:43128/0 (socket says 172.21.15.107:43128) 2023-12-16T01:53:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.397+0000 7f57937fe640 1 -- 172.21.15.107:0/2136134233 learned_addr learned my addr 172.21.15.107:0/2136134233 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:27.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.399+0000 7f57927fc640 1 -- 172.21.15.107:0/2136134233 >> v2:172.21.15.157:3300/0 conn(0x7f57940c2e40 msgr2=0x7f579415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:27.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.399+0000 7f57927fc640 1 --2- 172.21.15.107:0/2136134233 >> v2:172.21.15.157:3300/0 conn(0x7f57940c2e40 0x7f579415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.399+0000 7f57927fc640 1 -- 172.21.15.107:0/2136134233 >> v1:172.21.15.157:6789/0 conn(0x7f57941537d0 legacy=0x7f579406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.399+0000 7f57927fc640 1 -- 172.21.15.107:0/2136134233 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940c7590 con 0x7f579406f160 2023-12-16T01:53:27.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.401+0000 7f57927fc640 1 --2- 172.21.15.107:0/2136134233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f579406f160 0x7f5794159bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57880097a0 tx=0x7f578802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73eb6700f7c30870 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:27.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f5791ffb640 1 -- 172.21.15.107:0/2136134233 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788030610 con 0x7f579406f160 2023-12-16T01:53:27.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f5791ffb640 1 -- 172.21.15.107:0/2136134233 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788030770 con 0x7f579406f160 2023-12-16T01:53:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f5791ffb640 1 -- 172.21.15.107:0/2136134233 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788030b00 con 0x7f579406f160 2023-12-16T01:53:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 -- 172.21.15.107:0/2136134233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f579406f160 msgr2=0x7f5794159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 --2- 172.21.15.107:0/2136134233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f579406f160 0x7f5794159bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57880097a0 tx=0x7f578802b960 comp rx=0 tx=0).stop 2023-12-16T01:53:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 -- 172.21.15.107:0/2136134233 shutdown_connections 2023-12-16T01:53:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 --2- 172.21.15.107:0/2136134233 >> v2:172.21.15.157:3300/0 conn(0x7f57940c2e40 0x7f579415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 --2- 172.21.15.107:0/2136134233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f579406f160 0x7f5794159bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 -- 172.21.15.107:0/2136134233 >> 172.21.15.107:0/2136134233 conn(0x7f57940cbf60 msgr2=0x7f57940cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 -- 172.21.15.107:0/2136134233 shutdown_connections 2023-12-16T01:53:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.406+0000 7f579952d640 1 -- 172.21.15.107:0/2136134233 wait complete. 2023-12-16T01:53:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.407+0000 7f579952d640 1 Processor -- start 2023-12-16T01:53:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 -- start start 2023-12-16T01:53:27.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579406f160 0x7f579415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:27.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 0x7f57941501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:27.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57941537d0 0x7f579414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:27.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579414aa80 con 0x7f579406f160 2023-12-16T01:53:27.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579414bde0 con 0x7f57941537d0 2023-12-16T01:53:27.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.408+0000 7f579952d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579414a730 con 0x7f57940c2e40 2023-12-16T01:53:27.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.409+0000 7f57937fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57941537d0 0x7f579414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:27.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.409+0000 7f57927fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 0x7f57941501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:27.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.409+0000 7f5792ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579406f160 0x7f579415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:27.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.409+0000 7f57927fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 0x7f57941501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:41052/0 (socket says 172.21.15.107:41052) 2023-12-16T01:53:27.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.409+0000 7f57927fc640 1 -- 172.21.15.107:0/4008481243 learned_addr learned my addr 172.21.15.107:0/4008481243 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:27.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.412+0000 7f57927fc640 1 -- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57941537d0 msgr2=0x7f579414b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.413+0000 7f57927fc640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57941537d0 0x7f579414b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.413+0000 7f57927fc640 1 -- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579406f160 msgr2=0x7f579415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.413+0000 7f57927fc640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579406f160 0x7f579415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.413+0000 7f57927fc640 1 -- 172.21.15.107:0/4008481243 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009400 con 0x7f57940c2e40 2023-12-16T01:53:27.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.415+0000 7f57927fc640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 0x7f57941501c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f578802bf70 tx=0x7f5788004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:27.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.419+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578803e040 con 0x7f57940c2e40 2023-12-16T01:53:27.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.419+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788039a40 con 0x7f57940c2e40 2023-12-16T01:53:27.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.419+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788039df0 con 0x7f57940c2e40 2023-12-16T01:53:27.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.419+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57941f0560 con 0x7f57940c2e40 2023-12-16T01:53:27.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.419+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57941efcf0 con 0x7f57940c2e40 2023-12-16T01:53:27.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.420+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579414abc0 con 0x7f57940c2e40 2023-12-16T01:53:27.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.439+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5788043390 con 0x7f57940c2e40 2023-12-16T01:53:27.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.439+0000 7f577b7fe640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f578006ae40 0x7f578006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:27.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.439+0000 7f5792ffd640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f578006ae40 0x7f578006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:27.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.440+0000 7f5792ffd640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f578006ae40 0x7f578006d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5784001e70 tx=0x7f5784009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:27.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.442+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f578807a910 con 0x7f57940c2e40 2023-12-16T01:53:27.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.700+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5788076c50 con 0x7f57940c2e40 2023-12-16T01:53:27.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.911+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57940c1c30 con 0x7f57940c2e40 2023-12-16T01:53:27.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.916+0000 7f577b7fe640 1 -- 172.21.15.107:0/4008481243 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57880340a0 con 0x7f57940c2e40 2023-12-16T01:53:27.918 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-12-16T01:53:27.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f578006ae40 msgr2=0x7f578006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f578006ae40 0x7f578006d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5784001e70 tx=0x7f5784009040 comp rx=0 tx=0).stop 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 msgr2=0x7f57941501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 0x7f57941501c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f578802bf70 tx=0x7f5788004730 comp rx=0 tx=0).stop 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 shutdown_connections 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f578006ae40 0x7f578006d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57941537d0 0x7f579414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57940c2e40 0x7f57941501c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 --2- 172.21.15.107:0/4008481243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579406f160 0x7f579415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 >> 172.21.15.107:0/4008481243 conn(0x7f57940cbf60 msgr2=0x7f57940c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 shutdown_connections 2023-12-16T01:53:27.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:27.918+0000 7f579952d640 1 -- 172.21.15.107:0/4008481243 wait complete. 2023-12-16T01:53:27.932 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T01:53:28.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.032+0000 7fb29b378640 1 Processor -- start 2023-12-16T01:53:28.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.032+0000 7fb29b378640 1 -- start start 2023-12-16T01:53:28.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.033+0000 7fb29b378640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2941515f0 0x7fb29406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.033+0000 7fb29b378640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb2941519d0 0x7fb2940c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.033+0000 7fb29b378640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29406ff90 con 0x7fb29406dde0 2023-12-16T01:53:28.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.033+0000 7fb29b378640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940c40b0 con 0x7fb2941519d0 2023-12-16T01:53:28.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.033+0000 7fb29b378640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29406f980 con 0x7fb2941515f0 2023-12-16T01:53:28.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.034+0000 7fb298913640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb2941519d0 0x7fb2940c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.034+0000 7fb299114640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2941515f0 0x7fb29406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.034+0000 7fb299915640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb29406dde0 0x7fb29406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:38136/0 (socket says 172.21.15.107:38136) 2023-12-16T01:53:28.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.034+0000 7fb299915640 1 -- 172.21.15.107:0/1578722391 learned_addr learned my addr 172.21.15.107:0/1578722391 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:28.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.036+0000 7fb298913640 1 -- 172.21.15.107:0/1578722391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2941515f0 msgr2=0x7fb29406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:28.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.036+0000 7fb298913640 1 --2- 172.21.15.107:0/1578722391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2941515f0 0x7fb29406b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.036+0000 7fb298913640 1 -- 172.21.15.107:0/1578722391 >> v1:172.21.15.157:6789/0 conn(0x7fb29406dde0 legacy=0x7fb29406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.036+0000 7fb28bfff640 1 -- 172.21.15.107:0/1578722391 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397772602 0 0) 0x7fb29406ff90 con 0x7fb29406dde0 2023-12-16T01:53:28.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.037+0000 7fb298913640 1 -- 172.21.15.107:0/1578722391 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29406e810 con 0x7fb2941519d0 2023-12-16T01:53:28.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.037+0000 7fb299114640 1 --2- 172.21.15.107:0/1578722391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2941515f0 0x7fb29406b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:28.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.038+0000 7fb298913640 1 --2- 172.21.15.107:0/1578722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941519d0 0x7fb2940c7150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2840097a0 tx=0x7fb28402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2971470a72199658 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:28.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.042+0000 7fb28bfff640 1 -- 172.21.15.107:0/1578722391 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284031830 con 0x7fb2941519d0 2023-12-16T01:53:28.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.042+0000 7fb28bfff640 1 -- 172.21.15.107:0/1578722391 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284031990 con 0x7fb2941519d0 2023-12-16T01:53:28.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.042+0000 7fb28bfff640 1 -- 172.21.15.107:0/1578722391 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284031d20 con 0x7fb2941519d0 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 -- 172.21.15.107:0/1578722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941519d0 msgr2=0x7fb2940c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 --2- 172.21.15.107:0/1578722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941519d0 0x7fb2940c7150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2840097a0 tx=0x7fb28402b8d0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 -- 172.21.15.107:0/1578722391 shutdown_connections 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 --2- 172.21.15.107:0/1578722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941519d0 0x7fb2940c7150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 --2- 172.21.15.107:0/1578722391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2941515f0 0x7fb29406b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 -- 172.21.15.107:0/1578722391 >> 172.21.15.107:0/1578722391 conn(0x7fb2940cbf60 msgr2=0x7fb2940cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 -- 172.21.15.107:0/1578722391 shutdown_connections 2023-12-16T01:53:28.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.043+0000 7fb29b378640 1 -- 172.21.15.107:0/1578722391 wait complete. 2023-12-16T01:53:28.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.044+0000 7fb29b378640 1 Processor -- start 2023-12-16T01:53:28.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.044+0000 7fb29b378640 1 -- start start 2023-12-16T01:53:28.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb29b378640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb29406dde0 0x7fb294154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb29b378640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 0x7fb294148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb29b378640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2941519d0 0x7fb2940c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb29b378640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c1aa0 con 0x7fb2941515f0 2023-12-16T01:53:28.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb29b378640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941e44f0 con 0x7fb2941519d0 2023-12-16T01:53:28.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb29b378640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941eea60 con 0x7fb29406dde0 2023-12-16T01:53:28.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb298913640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 0x7fb294148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb299114640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb29406dde0 0x7fb294154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb299915640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2941519d0 0x7fb2940c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb298913640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 0x7fb294148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46884/0 (socket says 172.21.15.107:46884) 2023-12-16T01:53:28.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.045+0000 7fb298913640 1 -- 172.21.15.107:0/3524562392 learned_addr learned my addr 172.21.15.107:0/3524562392 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:28.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.049+0000 7fb298913640 1 -- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb29406dde0 msgr2=0x7fb294154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.049+0000 7fb298913640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb29406dde0 0x7fb294154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.049+0000 7fb298913640 1 -- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2941519d0 msgr2=0x7fb2940c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.049+0000 7fb298913640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2941519d0 0x7fb2940c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.049+0000 7fb298913640 1 -- 172.21.15.107:0/3524562392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290009a70 con 0x7fb2941515f0 2023-12-16T01:53:28.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.049+0000 7fb299114640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb29406dde0 0x7fb294154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:28.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.051+0000 7fb298913640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 0x7fb294148180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb2840098c0 tx=0x7fb2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.054+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28403a960 con 0x7fb2941515f0 2023-12-16T01:53:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.055+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28403aae0 con 0x7fb2941515f0 2023-12-16T01:53:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.055+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb284009400 con 0x7fb2941515f0 2023-12-16T01:53:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.055+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28403ae90 con 0x7fb2941515f0 2023-12-16T01:53:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.055+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2941efed0 con 0x7fb2941515f0 2023-12-16T01:53:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.056+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2940c1be0 con 0x7fb2941515f0 2023-12-16T01:53:28.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.301+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb28404b3b0 con 0x7fb2941515f0 2023-12-16T01:53:28.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.302+0000 7fb289ffb640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb27806aec0 0x7fb27806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.302+0000 7fb299114640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb27806aec0 0x7fb27806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.302+0000 7fb299114640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb27806aec0 0x7fb27806d380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb290009fd0 tx=0x7fb29000b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:28.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.315+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb28407a4f0 con 0x7fb2941515f0 2023-12-16T01:53:28.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.315+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb284076830 con 0x7fb2941515f0 2023-12-16T01:53:28.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.482+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb2940c1be0 con 0x7fb2941515f0 2023-12-16T01:53:28.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.488+0000 7fb289ffb640 1 -- 172.21.15.107:0/3524562392 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb2940c1be0 con 0x7fb2941515f0 2023-12-16T01:53:28.490 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:53:28.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb27806aec0 msgr2=0x7fb27806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb27806aec0 0x7fb27806d380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb290009fd0 tx=0x7fb29000b040 comp rx=0 tx=0).stop 2023-12-16T01:53:28.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 msgr2=0x7fb294148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 0x7fb294148180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb2840098c0 tx=0x7fb2840046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 shutdown_connections 2023-12-16T01:53:28.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb27806aec0 0x7fb27806d380 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2941519d0 0x7fb2940c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2941515f0 0x7fb294148180 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 --2- 172.21.15.107:0/3524562392 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb29406dde0 0x7fb294154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 >> 172.21.15.107:0/3524562392 conn(0x7fb2940cbf60 msgr2=0x7fb2940c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:28.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 shutdown_connections 2023-12-16T01:53:28.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.490+0000 7fb29b378640 1 -- 172.21.15.107:0/3524562392 wait complete. 2023-12-16T01:53:28.503 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T01:53:28.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.602+0000 7fe7c30cf640 1 Processor -- start 2023-12-16T01:53:28.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.602+0000 7fe7c30cf640 1 -- start start 2023-12-16T01:53:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.603+0000 7fe7c30cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc151510 0x7fe7bc0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.603+0000 7fe7c30cf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe7bc0728b0 0x7fe7bc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.603+0000 7fe7c30cf640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc15b6e0 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.603+0000 7fe7c30cf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc15a880 con 0x7fe7bc0728b0 2023-12-16T01:53:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.603+0000 7fe7c30cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc06f7e0 con 0x7fe7bc151510 2023-12-16T01:53:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.604+0000 7fe7bbfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe7bc0728b0 0x7fe7bc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.604+0000 7fe7c0e6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc151510 0x7fe7bc0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.604+0000 7fe7c166c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe7bc0c5a90 0x7fe7bc1572f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50346/0 (socket says 172.21.15.107:50346) 2023-12-16T01:53:28.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.604+0000 7fe7c166c640 1 -- 172.21.15.107:0/1523870372 learned_addr learned my addr 172.21.15.107:0/1523870372 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:28.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7bb7fe640 1 -- 172.21.15.107:0/1523870372 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005969092 0 0) 0x7fe7bc15b6e0 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7bb7fe640 1 -- 172.21.15.107:0/1523870372 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a4003520 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7c0e6b640 1 -- 172.21.15.107:0/1523870372 >> v2:172.21.15.157:3300/0 conn(0x7fe7bc0728b0 msgr2=0x7fe7bc0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:28.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7c0e6b640 1 --2- 172.21.15.107:0/1523870372 >> v2:172.21.15.157:3300/0 conn(0x7fe7bc0728b0 0x7fe7bc0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7c0e6b640 1 -- 172.21.15.107:0/1523870372 >> v1:172.21.15.107:6789/0 conn(0x7fe7bc0c5a90 legacy=0x7fe7bc1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7c0e6b640 1 -- 172.21.15.107:0/1523870372 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc15aad0 con 0x7fe7bc151510 2023-12-16T01:53:28.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.606+0000 7fe7bbfff640 1 --2- 172.21.15.107:0/1523870372 >> v2:172.21.15.157:3300/0 conn(0x7fe7bc0728b0 0x7fe7bc0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:28.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.608+0000 7fe7c0e6b640 1 --2- 172.21.15.107:0/1523870372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc151510 0x7fe7bc0cae30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0097a0 tx=0x7fe7ac02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5243f4648ddd2d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:28.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.612+0000 7fe7bb7fe640 1 -- 172.21.15.107:0/1523870372 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac031830 con 0x7fe7bc151510 2023-12-16T01:53:28.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.612+0000 7fe7bb7fe640 1 -- 172.21.15.107:0/1523870372 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac031990 con 0x7fe7bc151510 2023-12-16T01:53:28.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.612+0000 7fe7bb7fe640 1 -- 172.21.15.107:0/1523870372 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac031d20 con 0x7fe7bc151510 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 -- 172.21.15.107:0/1523870372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc151510 msgr2=0x7fe7bc0cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/1523870372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc151510 0x7fe7bc0cae30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0097a0 tx=0x7fe7ac02b8d0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 -- 172.21.15.107:0/1523870372 shutdown_connections 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/1523870372 >> v2:172.21.15.157:3300/0 conn(0x7fe7bc0728b0 0x7fe7bc0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/1523870372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc151510 0x7fe7bc0cae30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 -- 172.21.15.107:0/1523870372 >> 172.21.15.107:0/1523870372 conn(0x7fe7bc06cd60 msgr2=0x7fe7bc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 -- 172.21.15.107:0/1523870372 shutdown_connections 2023-12-16T01:53:28.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.613+0000 7fe7c30cf640 1 -- 172.21.15.107:0/1523870372 wait complete. 2023-12-16T01:53:28.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.614+0000 7fe7c30cf640 1 Processor -- start 2023-12-16T01:53:28.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.614+0000 7fe7c30cf640 1 -- start start 2023-12-16T01:53:28.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7c30cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc0728b0 0x7fe7bc0c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7c30cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 0x7fe7bc1f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7c30cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7bc151510 0x7fe7bc154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7c30cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc14b900 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7c30cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc155dd0 con 0x7fe7bc151510 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7c30cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc1ecef0 con 0x7fe7bc0728b0 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.615+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 0x7fe7bc1f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.616+0000 7fe7c0e6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc0728b0 0x7fe7bc0c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.616+0000 7fe7c166c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7bc151510 0x7fe7bc154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.616+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 0x7fe7bc1f0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46898/0 (socket says 172.21.15.107:46898) 2023-12-16T01:53:28.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.616+0000 7fe7bbfff640 1 -- 172.21.15.107:0/325792975 learned_addr learned my addr 172.21.15.107:0/325792975 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:28.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.619+0000 7fe7bbfff640 1 -- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc0728b0 msgr2=0x7fe7bc0c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.619+0000 7fe7bbfff640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc0728b0 0x7fe7bc0c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.619+0000 7fe7bbfff640 1 -- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7bc151510 msgr2=0x7fe7bc154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:28.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.619+0000 7fe7bbfff640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7bc151510 0x7fe7bc154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:28.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.619+0000 7fe7bbfff640 1 -- 172.21.15.107:0/325792975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0009400 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.619+0000 7fe7c0e6b640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc0728b0 0x7fe7bc0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:28.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.621+0000 7fe7bbfff640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 0x7fe7bc1f0710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000e960 tx=0x7fe7b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:28.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.625+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000ca00 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.625+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000cb60 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.625+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac009400 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.625+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0013470 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.625+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc1ed790 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.626+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc0c6dc0 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.870+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe7b00135d0 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.870+0000 7fe7b97fa640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe7a806ae90 0x7fe7a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:28.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.870+0000 7fe7c0e6b640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe7a806ae90 0x7fe7a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:28.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.870+0000 7fe7c0e6b640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe7a806ae90 0x7fe7a806d350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac036000 tx=0x7fe7ac03c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:28.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.884+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe7b0058dc0 con 0x7fe7bc0c5a90 2023-12-16T01:53:28.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:28.884+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe7b0055100 con 0x7fe7bc0c5a90 2023-12-16T01:53:29.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.090+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7bc067500 con 0x7fe7bc0c5a90 2023-12-16T01:53:29.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.094+0000 7fe7b97fa640 1 -- 172.21.15.107:0/325792975 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe7b0021020 con 0x7fe7bc0c5a90 2023-12-16T01:53:29.095 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2023-12-16T01:53:29.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe7a806ae90 msgr2=0x7fe7a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe7a806ae90 0x7fe7a806d350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac036000 tx=0x7fe7ac03c040 comp rx=0 tx=0).stop 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 msgr2=0x7fe7bc1f0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 0x7fe7bc1f0710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000e960 tx=0x7fe7b000ee20 comp rx=0 tx=0).stop 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 shutdown_connections 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe7a806ae90 0x7fe7a806d350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7bc151510 0x7fe7bc154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0c5a90 0x7fe7bc1f0710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 --2- 172.21.15.107:0/325792975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7bc0728b0 0x7fe7bc0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 >> 172.21.15.107:0/325792975 conn(0x7fe7bc06cd60 msgr2=0x7fe7bc150000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 shutdown_connections 2023-12-16T01:53:29.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.096+0000 7fe7c30cf640 1 -- 172.21.15.107:0/325792975 wait complete. 2023-12-16T01:53:29.109 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-12-16T01:53:29.109 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T01:53:29.125 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:53:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.262+0000 7f4b46d41640 1 Processor -- start 2023-12-16T01:53:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.262+0000 7f4b46d41640 1 -- start start 2023-12-16T01:53:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.263+0000 7f4b46d41640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b40153c70 0x7f4b4015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.263+0000 7f4b46d41640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b400ceef0 0x7f4b400cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.263+0000 7f4b46d41640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4015a700 con 0x7f4b40153890 2023-12-16T01:53:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.263+0000 7f4b46d41640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400cf840 con 0x7f4b400ceef0 2023-12-16T01:53:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.263+0000 7f4b46d41640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400ca870 con 0x7f4b40153c70 2023-12-16T01:53:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.264+0000 7f4b452de640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b400ceef0 0x7f4b400cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.264+0000 7f4b3ffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b40153c70 0x7f4b4015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.264+0000 7f4b3ffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b40153c70 0x7f4b4015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:43168/0 (socket says 172.21.15.107:43168) 2023-12-16T01:53:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.264+0000 7f4b3ffff640 1 -- 172.21.15.107:0/404394016 learned_addr learned my addr 172.21.15.107:0/404394016 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:29.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.267+0000 7f4b3ffff640 1 -- 172.21.15.107:0/404394016 >> v2:172.21.15.107:3300/0 conn(0x7f4b400ceef0 msgr2=0x7f4b400cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.267+0000 7f4b3ffff640 1 --2- 172.21.15.107:0/404394016 >> v2:172.21.15.107:3300/0 conn(0x7f4b400ceef0 0x7f4b400cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.267+0000 7f4b3ffff640 1 -- 172.21.15.107:0/404394016 >> v1:172.21.15.107:6789/0 conn(0x7f4b40153890 legacy=0x7f4b400c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.267+0000 7f4b3ffff640 1 -- 172.21.15.107:0/404394016 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40159af0 con 0x7f4b40153c70 2023-12-16T01:53:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.268+0000 7f4b3ffff640 1 --2- 172.21.15.107:0/404394016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153c70 0x7f4b4015d950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b400c6290 tx=0x7f4b3402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9698842913b994de server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:29.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.272+0000 7f4b3f7fe640 1 -- 172.21.15.107:0/404394016 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3402f850 con 0x7f4b40153c70 2023-12-16T01:53:29.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.272+0000 7f4b3f7fe640 1 -- 172.21.15.107:0/404394016 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3402f9b0 con 0x7f4b40153c70 2023-12-16T01:53:29.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.272+0000 7f4b3f7fe640 1 -- 172.21.15.107:0/404394016 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3402fd40 con 0x7f4b40153c70 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 -- 172.21.15.107:0/404394016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153c70 msgr2=0x7f4b4015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 --2- 172.21.15.107:0/404394016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153c70 0x7f4b4015d950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b400c6290 tx=0x7f4b3402ba30 comp rx=0 tx=0).stop 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 -- 172.21.15.107:0/404394016 shutdown_connections 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 --2- 172.21.15.107:0/404394016 >> v2:172.21.15.107:3300/0 conn(0x7f4b400ceef0 0x7f4b400cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 --2- 172.21.15.107:0/404394016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153c70 0x7f4b4015d950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 -- 172.21.15.107:0/404394016 >> 172.21.15.107:0/404394016 conn(0x7f4b4006ba00 msgr2=0x7f4b4006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 -- 172.21.15.107:0/404394016 shutdown_connections 2023-12-16T01:53:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.273+0000 7f4b46d41640 1 -- 172.21.15.107:0/404394016 wait complete. 2023-12-16T01:53:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.274+0000 7f4b46d41640 1 Processor -- start 2023-12-16T01:53:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.274+0000 7f4b46d41640 1 -- start start 2023-12-16T01:53:29.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b46d41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b400ceef0 0x7f4b400c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b46d41640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153890 0x7f4b401ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b46d41640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b40153c70 0x7f4b400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b46d41640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b401f2fb0 con 0x7f4b400ceef0 2023-12-16T01:53:29.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b46d41640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b401ef500 con 0x7f4b40153890 2023-12-16T01:53:29.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b46d41640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b401f34a0 con 0x7f4b40153c70 2023-12-16T01:53:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.275+0000 7f4b44add640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b400ceef0 0x7f4b400c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.276+0000 7f4b452de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b40153c70 0x7f4b400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.276+0000 7f4b3ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153890 0x7f4b401ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.276+0000 7f4b44add640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b400ceef0 0x7f4b400c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46912/0 (socket says 172.21.15.107:46912) 2023-12-16T01:53:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.276+0000 7f4b44add640 1 -- 172.21.15.107:0/423849278 learned_addr learned my addr 172.21.15.107:0/423849278 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:29.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.279+0000 7f4b3ffff640 1 -- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b40153c70 msgr2=0x7f4b400cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.279+0000 7f4b3ffff640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b40153c70 0x7f4b400cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.279+0000 7f4b3ffff640 1 -- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b400ceef0 msgr2=0x7f4b400c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.279+0000 7f4b3ffff640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b400ceef0 0x7f4b400c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.279+0000 7f4b3ffff640 1 -- 172.21.15.107:0/423849278 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340094d0 con 0x7f4b40153890 2023-12-16T01:53:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.282+0000 7f4b3ffff640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153890 0x7f4b401ef990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b34033000 tx=0x7f4b340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.285+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3403b040 con 0x7f4b40153890 2023-12-16T01:53:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.285+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b34037c60 con 0x7f4b40153890 2023-12-16T01:53:29.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.285+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b34042480 con 0x7f4b40153890 2023-12-16T01:53:29.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.286+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b401ef1d0 con 0x7f4b40153890 2023-12-16T01:53:29.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.286+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b400b33e0 con 0x7f4b40153890 2023-12-16T01:53:29.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.286+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b401ef030 con 0x7f4b40153890 2023-12-16T01:53:29.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.306+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4b34042600 con 0x7f4b40153890 2023-12-16T01:53:29.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.306+0000 7f4b3d7fa640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4b2c06ae40 0x7f4b2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.306+0000 7f4b44add640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4b2c06ae40 0x7f4b2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.307+0000 7f4b44add640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4b2c06ae40 0x7f4b2c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b30001840 tx=0x7f4b30009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:29.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.538+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4b3407bcc0 con 0x7f4b40153890 2023-12-16T01:53:29.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.550+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4b34078000 con 0x7f4b40153890 2023-12-16T01:53:29.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.717+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b401ef030 con 0x7f4b40153890 2023-12-16T01:53:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.759+0000 7f4b3d7fa640 1 -- 172.21.15.107:0/423849278 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18553 (secure 0 0 0) 0x7f4b401ef030 con 0x7f4b40153890 2023-12-16T01:53:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:29.761 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:26:31.279218+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:53:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4b2c06ae40 msgr2=0x7f4b2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4b2c06ae40 0x7f4b2c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b30001840 tx=0x7f4b30009040 comp rx=0 tx=0).stop 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153890 msgr2=0x7f4b401ef990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153890 0x7f4b401ef990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b34033000 tx=0x7f4b340046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 shutdown_connections 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b40153c70 0x7f4b400cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4b2c06ae40 0x7f4b2c06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b40153890 0x7f4b401ef990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 --2- 172.21.15.107:0/423849278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b400ceef0 0x7f4b400c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 >> 172.21.15.107:0/423849278 conn(0x7f4b4006ba00 msgr2=0x7f4b401580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 shutdown_connections 2023-12-16T01:53:29.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.761+0000 7f4b46d41640 1 -- 172.21.15.107:0/423849278 wait complete. 2023-12-16T01:53:29.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T01:25:34.058977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T01:25:45.757668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T01:25:47.362497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T01:25:52.786986+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T01:53:29.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T01:53:29.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.875+0000 7ff30407c640 1 Processor -- start 2023-12-16T01:53:29.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.875+0000 7ff30407c640 1 -- start start 2023-12-16T01:53:29.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.876+0000 7ff30407c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 0x7ff2fc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.876+0000 7ff30407c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2fc0ceef0 0x7ff2fc0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.876+0000 7ff30407c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc15a700 con 0x7ff2fc153890 2023-12-16T01:53:29.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.876+0000 7ff30407c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0ca870 con 0x7ff2fc0ceef0 2023-12-16T01:53:29.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.876+0000 7ff30407c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc159af0 con 0x7ff2fc153c70 2023-12-16T01:53:29.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.877+0000 7ff301617640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 0x7ff2fc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.877+0000 7ff302619640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2fc0ceef0 0x7ff2fc0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.877+0000 7ff301617640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 0x7ff2fc15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:48160/0 (socket says 172.21.15.107:48160) 2023-12-16T01:53:29.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.877+0000 7ff301617640 1 -- 172.21.15.107:0/2153405496 learned_addr learned my addr 172.21.15.107:0/2153405496 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:29.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.880+0000 7ff301617640 1 -- 172.21.15.107:0/2153405496 >> v2:172.21.15.157:3300/0 conn(0x7ff2fc0ceef0 msgr2=0x7ff2fc0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:29.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.880+0000 7ff301617640 1 --2- 172.21.15.107:0/2153405496 >> v2:172.21.15.157:3300/0 conn(0x7ff2fc0ceef0 0x7ff2fc0cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.880+0000 7ff301617640 1 -- 172.21.15.107:0/2153405496 >> v1:172.21.15.157:6789/0 conn(0x7ff2fc153890 legacy=0x7ff2fc0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.880+0000 7ff301617640 1 -- 172.21.15.107:0/2153405496 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc159dd0 con 0x7ff2fc153c70 2023-12-16T01:53:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.882+0000 7ff301617640 1 --2- 172.21.15.107:0/2153405496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 0x7ff2fc15d950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009870 tx=0x7ff2ec02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cef1ce5b8e86bd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.886+0000 7ff300e16640 1 -- 172.21.15.107:0/2153405496 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec02f840 con 0x7ff2fc153c70 2023-12-16T01:53:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.886+0000 7ff300e16640 1 -- 172.21.15.107:0/2153405496 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec02f9a0 con 0x7ff2fc153c70 2023-12-16T01:53:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.886+0000 7ff300e16640 1 -- 172.21.15.107:0/2153405496 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec02fd30 con 0x7ff2fc153c70 2023-12-16T01:53:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 -- 172.21.15.107:0/2153405496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 msgr2=0x7ff2fc15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 --2- 172.21.15.107:0/2153405496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 0x7ff2fc15d950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009870 tx=0x7ff2ec02ba20 comp rx=0 tx=0).stop 2023-12-16T01:53:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 -- 172.21.15.107:0/2153405496 shutdown_connections 2023-12-16T01:53:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 --2- 172.21.15.107:0/2153405496 >> v2:172.21.15.157:3300/0 conn(0x7ff2fc0ceef0 0x7ff2fc0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 --2- 172.21.15.107:0/2153405496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc153c70 0x7ff2fc15d950 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 -- 172.21.15.107:0/2153405496 >> 172.21.15.107:0/2153405496 conn(0x7ff2fc06ba00 msgr2=0x7ff2fc06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:29.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 -- 172.21.15.107:0/2153405496 shutdown_connections 2023-12-16T01:53:29.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.887+0000 7ff30407c640 1 -- 172.21.15.107:0/2153405496 wait complete. 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 Processor -- start 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 -- start start 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc0ceef0 0x7ff2fc0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 0x7ff2fc0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2fc153c70 0x7ff2fc0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0ceb80 con 0x7ff2fc153c70 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0c6940 con 0x7ff2fc153890 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.888+0000 7ff30407c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc1556a0 con 0x7ff2fc0ceef0 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.889+0000 7ff301617640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 0x7ff2fc0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.889+0000 7ff302619640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2fc153c70 0x7ff2fc0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.889+0000 7ff301e18640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc0ceef0 0x7ff2fc0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.889+0000 7ff301617640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 0x7ff2fc0ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50440/0 (socket says 172.21.15.107:50440) 2023-12-16T01:53:29.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.889+0000 7ff301617640 1 -- 172.21.15.107:0/2813153740 learned_addr learned my addr 172.21.15.107:0/2813153740 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff301617640 1 -- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc0ceef0 msgr2=0x7ff2fc0c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff301617640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc0ceef0 0x7ff2fc0c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff301617640 1 -- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2fc153c70 msgr2=0x7ff2fc0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff301617640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2fc153c70 0x7ff2fc0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff301617640 1 -- 172.21.15.107:0/2813153740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0094d0 con 0x7ff2fc153890 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff301e18640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc0ceef0 0x7ff2fc0c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:29.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.893+0000 7ff302619640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2fc153c70 0x7ff2fc0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:29.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.895+0000 7ff301617640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 0x7ff2fc0ce020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec000c00 tx=0x7ff2ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:29.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.899+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec03b040 con 0x7ff2fc153890 2023-12-16T01:53:29.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.899+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec037c60 con 0x7ff2fc153890 2023-12-16T01:53:29.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.899+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc0b31f0 con 0x7ff2fc153890 2023-12-16T01:53:29.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.899+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec042480 con 0x7ff2fc153890 2023-12-16T01:53:29.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.899+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc0b37b0 con 0x7ff2fc153890 2023-12-16T01:53:29.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.900+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc0b2110 con 0x7ff2fc153890 2023-12-16T01:53:29.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.923+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff2ec0425e0 con 0x7ff2fc153890 2023-12-16T01:53:29.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.923+0000 7ff2f27fc640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff2e006ae90 0x7ff2e006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:29.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.923+0000 7ff301e18640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff2e006ae90 0x7ff2e006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:29.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.924+0000 7ff301e18640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff2e006ae90 0x7ff2e006d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800f290 tx=0x7ff2f8009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:29.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:29.927+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff2ec07bda0 con 0x7ff2fc153890 2023-12-16T01:53:30.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.169+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff2ec078120 con 0x7ff2fc153890 2023-12-16T01:53:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.348+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2fc067500 con 0x7ff2fc153890 2023-12-16T01:53:30.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.362+0000 7ff2f27fc640 1 -- 172.21.15.107:0/2813153740 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2ec07b700 con 0x7ff2fc153890 2023-12-16T01:53:30.364 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-12-16T01:53:30.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff2e006ae90 msgr2=0x7ff2e006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff2e006ae90 0x7ff2e006d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800f290 tx=0x7ff2f8009040 comp rx=0 tx=0).stop 2023-12-16T01:53:30.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 msgr2=0x7ff2fc0ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 0x7ff2fc0ce020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec000c00 tx=0x7ff2ec0046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 shutdown_connections 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2fc153c70 0x7ff2fc0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff2e006ae90 0x7ff2e006d350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2fc153890 0x7ff2fc0ce020 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 --2- 172.21.15.107:0/2813153740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2fc0ceef0 0x7ff2fc0c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 >> 172.21.15.107:0/2813153740 conn(0x7ff2fc06ba00 msgr2=0x7ff2fc158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 shutdown_connections 2023-12-16T01:53:30.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.364+0000 7ff30407c640 1 -- 172.21.15.107:0/2813153740 wait complete. 2023-12-16T01:53:30.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T01:53:30.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.478+0000 7f9bff87c640 1 Processor -- start 2023-12-16T01:53:30.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.478+0000 7f9bff87c640 1 -- start start 2023-12-16T01:53:30.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bff87c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf806fa00 0x7f9bf80c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:30.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bff87c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9bf80c5e60 0x7f9bf80c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:30.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bff87c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf8159fa0 con 0x7f9bf8153be0 2023-12-16T01:53:30.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bff87c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf80c3340 con 0x7f9bf80c5e60 2023-12-16T01:53:30.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bff87c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf8153fc0 con 0x7f9bf806fa00 2023-12-16T01:53:30.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bfde19640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9bf80c5e60 0x7f9bf80c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:30.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.479+0000 7f9bfce17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf806fa00 0x7f9bf80c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:30.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.480+0000 7f9bfde19640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9bf80c5e60 0x7f9bf80c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37444/0 (socket says 172.21.15.107:37444) 2023-12-16T01:53:30.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.480+0000 7f9bfde19640 1 -- 172.21.15.107:0/326900141 learned_addr learned my addr 172.21.15.107:0/326900141 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:30.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.482+0000 7f9bfce17640 1 -- 172.21.15.107:0/326900141 >> v2:172.21.15.107:3300/0 conn(0x7f9bf80c5e60 msgr2=0x7f9bf80c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:30.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.482+0000 7f9bfce17640 1 --2- 172.21.15.107:0/326900141 >> v2:172.21.15.107:3300/0 conn(0x7f9bf80c5e60 0x7f9bf80c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.482+0000 7f9bfce17640 1 -- 172.21.15.107:0/326900141 >> v1:172.21.15.107:6789/0 conn(0x7f9bf8153be0 legacy=0x7f9bf8159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.482+0000 7f9bfce17640 1 -- 172.21.15.107:0/326900141 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf806b7b0 con 0x7f9bf806fa00 2023-12-16T01:53:30.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.484+0000 7f9bfce17640 1 --2- 172.21.15.107:0/326900141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf806fa00 0x7f9bf80c41b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9be80097a0 tx=0x7f9be802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b41629e365eaf76 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:30.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.488+0000 7f9beffff640 1 -- 172.21.15.107:0/326900141 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8031830 con 0x7f9bf806fa00 2023-12-16T01:53:30.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.488+0000 7f9beffff640 1 -- 172.21.15.107:0/326900141 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be8031990 con 0x7f9bf806fa00 2023-12-16T01:53:30.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.488+0000 7f9beffff640 1 -- 172.21.15.107:0/326900141 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8031d20 con 0x7f9bf806fa00 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 -- 172.21.15.107:0/326900141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf806fa00 msgr2=0x7f9bf80c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 --2- 172.21.15.107:0/326900141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf806fa00 0x7f9bf80c41b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9be80097a0 tx=0x7f9be802b8d0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 -- 172.21.15.107:0/326900141 shutdown_connections 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 --2- 172.21.15.107:0/326900141 >> v2:172.21.15.107:3300/0 conn(0x7f9bf80c5e60 0x7f9bf80c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 --2- 172.21.15.107:0/326900141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf806fa00 0x7f9bf80c41b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 -- 172.21.15.107:0/326900141 >> 172.21.15.107:0/326900141 conn(0x7f9bf80c7f60 msgr2=0x7f9bf80c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 -- 172.21.15.107:0/326900141 shutdown_connections 2023-12-16T01:53:30.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.489+0000 7f9bff87c640 1 -- 172.21.15.107:0/326900141 wait complete. 2023-12-16T01:53:30.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.490+0000 7f9bff87c640 1 Processor -- start 2023-12-16T01:53:30.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.490+0000 7f9bff87c640 1 -- start start 2023-12-16T01:53:30.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bff87c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9bf806fa00 0x7f9bf80ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:30.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bff87c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf80c5e60 0x7f9bf8159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:30.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bff87c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 0x7f9bf81f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:30.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bff87c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80cb250 con 0x7f9bf8153be0 2023-12-16T01:53:30.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bff87c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf8157c70 con 0x7f9bf806fa00 2023-12-16T01:53:30.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bff87c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80cac90 con 0x7f9bf80c5e60 2023-12-16T01:53:30.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bfde19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 0x7f9bf81f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:30.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bfce17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf80c5e60 0x7f9bf8159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:30.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bfd618640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9bf806fa00 0x7f9bf80ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:30.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.491+0000 7f9bfde19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 0x7f9bf81f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37460/0 (socket says 172.21.15.107:37460) 2023-12-16T01:53:30.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.492+0000 7f9bfde19640 1 -- 172.21.15.107:0/1739147307 learned_addr learned my addr 172.21.15.107:0/1739147307 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:30.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.495+0000 7f9bfde19640 1 -- 172.21.15.107:0/1739147307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf80c5e60 msgr2=0x7f9bf8159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.495+0000 7f9bfde19640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf80c5e60 0x7f9bf8159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.495+0000 7f9bfde19640 1 -- 172.21.15.107:0/1739147307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9bf806fa00 msgr2=0x7f9bf80ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.495+0000 7f9bfde19640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9bf806fa00 0x7f9bf80ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.495+0000 7f9bfde19640 1 -- 172.21.15.107:0/1739147307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8009400 con 0x7f9bf8153be0 2023-12-16T01:53:30.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.497+0000 7f9bfde19640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 0x7f9bf81f28c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000e870 tx=0x7f9bf000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:30.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.501+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000c940 con 0x7f9bf8153be0 2023-12-16T01:53:30.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.501+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf000caa0 con 0x7f9bf8153be0 2023-12-16T01:53:30.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.501+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000ce30 con 0x7f9bf8153be0 2023-12-16T01:53:30.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.501+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf80caf70 con 0x7f9bf8153be0 2023-12-16T01:53:30.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.501+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf8157900 con 0x7f9bf8153be0 2023-12-16T01:53:30.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.502+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf8067500 con 0x7f9bf8153be0 2023-12-16T01:53:30.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.746+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f9bf0013470 con 0x7f9bf8153be0 2023-12-16T01:53:30.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.746+0000 7f9bedffb640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bdc06aec0 0x7f9bdc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:30.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.747+0000 7f9bfd618640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bdc06aec0 0x7f9bdc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:30.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.747+0000 7f9bfd618640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bdc06aec0 0x7f9bdc06d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4001e70 tx=0x7f9bf4009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:30.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.761+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9bf0058c60 con 0x7f9bf8153be0 2023-12-16T01:53:30.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.761+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f9bf0054fa0 con 0x7f9bf8153be0 2023-12-16T01:53:30.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.926+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9bf80c39d0 con 0x7f9bf8153be0 2023-12-16T01:53:30.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.931+0000 7f9bedffb640 1 -- 172.21.15.107:0/1739147307 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9bf00170a0 con 0x7f9bf8153be0 2023-12-16T01:53:30.934 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:53:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bdc06aec0 msgr2=0x7f9bdc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bdc06aec0 0x7f9bdc06d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4001e70 tx=0x7f9bf4009040 comp rx=0 tx=0).stop 2023-12-16T01:53:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 msgr2=0x7f9bf81f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 0x7f9bf81f28c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000e870 tx=0x7f9bf000ed30 comp rx=0 tx=0).stop 2023-12-16T01:53:30.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 shutdown_connections 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9bf8153be0 0x7f9bf81f28c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9bf80c5e60 0x7f9bf8159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bdc06aec0 0x7f9bdc06d380 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 --2- 172.21.15.107:0/1739147307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9bf806fa00 0x7f9bf80ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 >> 172.21.15.107:0/1739147307 conn(0x7f9bf80c7f60 msgr2=0x7f9bf8152080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 shutdown_connections 2023-12-16T01:53:30.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:30.934+0000 7f9bff87c640 1 -- 172.21.15.107:0/1739147307 wait complete. 2023-12-16T01:53:30.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T01:53:31.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.049+0000 7f5b7f5b0640 1 Processor -- start 2023-12-16T01:53:31.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.050+0000 7f5b7f5b0640 1 -- start start 2023-12-16T01:53:31.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.050+0000 7f5b7f5b0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b78153890 0x7f5b7815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.050+0000 7f5b7f5b0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7815a700 con 0x7f5b78153c70 2023-12-16T01:53:31.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.050+0000 7f5b7f5b0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780ca870 con 0x7f5b780ceef0 2023-12-16T01:53:31.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.050+0000 7f5b7f5b0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b78159af0 con 0x7f5b78153890 2023-12-16T01:53:31.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.051+0000 7f5b7cb4b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5b78153c70 0x7f5b780c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:44620/0 (socket says 172.21.15.107:44620) 2023-12-16T01:53:31.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.051+0000 7f5b7cb4b640 1 -- 172.21.15.107:0/187017111 learned_addr learned my addr 172.21.15.107:0/187017111 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:31.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.051+0000 7f5b7d34c640 1 --2- 172.21.15.107:0/187017111 >> v2:172.21.15.157:3300/0 conn(0x7f5b78153890 0x7f5b7815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.054+0000 7f5b6ffff640 1 -- 172.21.15.107:0/187017111 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657403252 0 0) 0x7f5b7815a700 con 0x7f5b78153c70 2023-12-16T01:53:31.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.054+0000 7f5b6ffff640 1 -- 172.21.15.107:0/187017111 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b64003520 con 0x7f5b78153c70 2023-12-16T01:53:31.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.056+0000 7f5b7d34c640 1 -- 172.21.15.107:0/187017111 >> v1:172.21.15.157:6789/0 conn(0x7f5b780ceef0 legacy=0x7f5b7815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.056+0000 7f5b7d34c640 1 -- 172.21.15.107:0/187017111 >> v1:172.21.15.107:6789/0 conn(0x7f5b78153c70 legacy=0x7f5b780c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.056+0000 7f5b7d34c640 1 -- 172.21.15.107:0/187017111 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78159dd0 con 0x7f5b78153890 2023-12-16T01:53:31.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.060+0000 7f5b7d34c640 1 --2- 172.21.15.107:0/187017111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7815d950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b740097a0 tx=0x7f5b7402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9fcb8a5158da141 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:31.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b6ffff640 1 -- 172.21.15.107:0/187017111 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402f810 con 0x7f5b78153890 2023-12-16T01:53:31.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b6ffff640 1 -- 172.21.15.107:0/187017111 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7402f970 con 0x7f5b78153890 2023-12-16T01:53:31.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b6ffff640 1 -- 172.21.15.107:0/187017111 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402fd00 con 0x7f5b78153890 2023-12-16T01:53:31.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/187017111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 msgr2=0x7f5b7815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/187017111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7815d950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b740097a0 tx=0x7f5b7402b9f0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/187017111 shutdown_connections 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/187017111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7815d950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/187017111 >> 172.21.15.107:0/187017111 conn(0x7f5b7806ba00 msgr2=0x7f5b7806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/187017111 shutdown_connections 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.064+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/187017111 wait complete. 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 Processor -- start 2023-12-16T01:53:31.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 -- start start 2023-12-16T01:53:31.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b780ceef0 0x7f5b781f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b78153c70 0x7f5b7814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7814e7d0 con 0x7f5b78153c70 2023-12-16T01:53:31.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b781f01d0 con 0x7f5b78153890 2023-12-16T01:53:31.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.066+0000 7f5b7f5b0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b781f39e0 con 0x7f5b780ceef0 2023-12-16T01:53:31.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.067+0000 7f5b7cb4b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.067+0000 7f5b7d34c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b780ceef0 0x7f5b781f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.067+0000 7f5b7db4d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b78153c70 0x7f5b7814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.067+0000 7f5b7cb4b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50452/0 (socket says 172.21.15.107:50452) 2023-12-16T01:53:31.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.067+0000 7f5b7cb4b640 1 -- 172.21.15.107:0/1840578322 learned_addr learned my addr 172.21.15.107:0/1840578322 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:31.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.070+0000 7f5b7cb4b640 1 -- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b780ceef0 msgr2=0x7f5b781f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.070+0000 7f5b7cb4b640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b780ceef0 0x7f5b781f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.070+0000 7f5b7cb4b640 1 -- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b78153c70 msgr2=0x7f5b7814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.070+0000 7f5b7cb4b640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b78153c70 0x7f5b7814e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.070+0000 7f5b7cb4b640 1 -- 172.21.15.107:0/1840578322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009400 con 0x7f5b78153890 2023-12-16T01:53:31.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.072+0000 7f5b7cb4b640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7814dd50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c440 tx=0x7f5b6800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:31.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.076+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68005ce0 con 0x7f5b78153890 2023-12-16T01:53:31.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.076+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68005e40 con 0x7f5b78153890 2023-12-16T01:53:31.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.076+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780cebb0 con 0x7f5b78153890 2023-12-16T01:53:31.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.076+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b680072b0 con 0x7f5b78153890 2023-12-16T01:53:31.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.077+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b781efb80 con 0x7f5b78153890 2023-12-16T01:53:31.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.077+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b781f0380 con 0x7f5b78153890 2023-12-16T01:53:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.096+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5b68007410 con 0x7f5b78153890 2023-12-16T01:53:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.096+0000 7f5b6dffb640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5b5c06ae90 0x7f5b5c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.097+0000 7f5b7d34c640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5b5c06ae90 0x7f5b5c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.097+0000 7f5b7d34c640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5b5c06ae90 0x7f5b5c06d350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b74036000 tx=0x7f5b74008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:31.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.099+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5b68057ca0 con 0x7f5b78153890 2023-12-16T01:53:31.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.339+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5b68053fe0 con 0x7f5b78153890 2023-12-16T01:53:31.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.508+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b781f0380 con 0x7f5b78153890 2023-12-16T01:53:31.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.514+0000 7f5b6dffb640 1 -- 172.21.15.107:0/1840578322 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b781f0380 con 0x7f5b78153890 2023-12-16T01:53:31.516 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-12-16T01:53:31.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5b5c06ae90 msgr2=0x7f5b5c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5b5c06ae90 0x7f5b5c06d350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b74036000 tx=0x7f5b74008030 comp rx=0 tx=0).stop 2023-12-16T01:53:31.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 msgr2=0x7f5b7814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7814dd50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c440 tx=0x7f5b6800c900 comp rx=0 tx=0).stop 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 shutdown_connections 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b78153c70 0x7f5b7814e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f5b5c06ae90 0x7f5b5c06d350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b78153890 0x7f5b7814dd50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 --2- 172.21.15.107:0/1840578322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b780ceef0 0x7f5b781f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 >> 172.21.15.107:0/1840578322 conn(0x7f5b7806ba00 msgr2=0x7f5b780cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 shutdown_connections 2023-12-16T01:53:31.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.516+0000 7f5b7f5b0640 1 -- 172.21.15.107:0/1840578322 wait complete. 2023-12-16T01:53:31.529 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T01:53:31.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.629+0000 7f3355a6b640 1 Processor -- start 2023-12-16T01:53:31.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.629+0000 7f3355a6b640 1 -- start start 2023-12-16T01:53:31.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.630+0000 7f3355a6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33501538f0 0x7f33500c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.630+0000 7f3355a6b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3350159b70 0x7f335015a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.630+0000 7f3355a6b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33501596e0 con 0x7f33500c7b90 2023-12-16T01:53:31.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.630+0000 7f3355a6b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335015a540 con 0x7f3350159b70 2023-12-16T01:53:31.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.630+0000 7f3355a6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500ca630 con 0x7f33501538f0 2023-12-16T01:53:31.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.631+0000 7f334ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3350159b70 0x7f335015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.631+0000 7f334f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33501538f0 0x7f33500c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.631+0000 7f334effd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f33500c7b90 0x7f335006b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:40542/0 (socket says 172.21.15.107:40542) 2023-12-16T01:53:31.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.631+0000 7f334effd640 1 -- 172.21.15.107:0/3496377585 learned_addr learned my addr 172.21.15.107:0/3496377585 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:31.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.633+0000 7f334e7fc640 1 -- 172.21.15.107:0/3496377585 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135694256 0 0) 0x7f33501596e0 con 0x7f33500c7b90 2023-12-16T01:53:31.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.633+0000 7f334e7fc640 1 -- 172.21.15.107:0/3496377585 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3338003520 con 0x7f33500c7b90 2023-12-16T01:53:31.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.633+0000 7f334ffff640 1 -- 172.21.15.107:0/3496377585 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33501538f0 msgr2=0x7f33500c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:31.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.633+0000 7f334ffff640 1 --2- 172.21.15.107:0/3496377585 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33501538f0 0x7f33500c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.633+0000 7f334ffff640 1 -- 172.21.15.107:0/3496377585 >> v1:172.21.15.157:6789/0 conn(0x7f33500c7b90 legacy=0x7f335006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.633+0000 7f334ffff640 1 -- 172.21.15.107:0/3496377585 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500c2f40 con 0x7f3350159b70 2023-12-16T01:53:31.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.635+0000 7f334ffff640 1 --2- 172.21.15.107:0/3496377585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3350159b70 0x7f335015a000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3348009d90 tx=0x7f334802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4457d79ab9855 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.639+0000 7f334e7fc640 1 -- 172.21.15.107:0/3496377585 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334802cbc0 con 0x7f3350159b70 2023-12-16T01:53:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.639+0000 7f334e7fc640 1 -- 172.21.15.107:0/3496377585 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334802cd20 con 0x7f3350159b70 2023-12-16T01:53:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.639+0000 7f334e7fc640 1 -- 172.21.15.107:0/3496377585 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348034660 con 0x7f3350159b70 2023-12-16T01:53:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 -- 172.21.15.107:0/3496377585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3350159b70 msgr2=0x7f335015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 --2- 172.21.15.107:0/3496377585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3350159b70 0x7f335015a000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3348009d90 tx=0x7f334802be10 comp rx=0 tx=0).stop 2023-12-16T01:53:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 -- 172.21.15.107:0/3496377585 shutdown_connections 2023-12-16T01:53:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 --2- 172.21.15.107:0/3496377585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3350159b70 0x7f335015a000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 --2- 172.21.15.107:0/3496377585 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33501538f0 0x7f33500c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 -- 172.21.15.107:0/3496377585 >> 172.21.15.107:0/3496377585 conn(0x7f3350060f20 msgr2=0x7f3350061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 -- 172.21.15.107:0/3496377585 shutdown_connections 2023-12-16T01:53:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.640+0000 7f3355a6b640 1 -- 172.21.15.107:0/3496377585 wait complete. 2023-12-16T01:53:31.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.641+0000 7f3355a6b640 1 Processor -- start 2023-12-16T01:53:31.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.641+0000 7f3355a6b640 1 -- start start 2023-12-16T01:53:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.642+0000 7f3355a6b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 0x7f3350148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.642+0000 7f3355a6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33501538f0 0x7f3350145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.642+0000 7f3355a6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3350159b70 0x7f3350146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.642+0000 7f3355a6b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335015d650 con 0x7f33500c7b90 2023-12-16T01:53:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.642+0000 7f3355a6b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335014fe80 con 0x7f33501538f0 2023-12-16T01:53:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.642+0000 7f3355a6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335015d880 con 0x7f3350159b70 2023-12-16T01:53:31.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.643+0000 7f334f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 0x7f3350148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.643+0000 7f334effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33501538f0 0x7f3350145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.643+0000 7f334ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3350159b70 0x7f3350146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.643+0000 7f334f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 0x7f3350148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37496/0 (socket says 172.21.15.107:37496) 2023-12-16T01:53:31.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.643+0000 7f334f7fe640 1 -- 172.21.15.107:0/205697247 learned_addr learned my addr 172.21.15.107:0/205697247 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:31.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.646+0000 7f334f7fe640 1 -- 172.21.15.107:0/205697247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3350159b70 msgr2=0x7f3350146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.646+0000 7f334f7fe640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3350159b70 0x7f3350146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.646+0000 7f334f7fe640 1 -- 172.21.15.107:0/205697247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33501538f0 msgr2=0x7f3350145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:31.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.646+0000 7f334f7fe640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33501538f0 0x7f3350145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:31.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.646+0000 7f334f7fe640 1 -- 172.21.15.107:0/205697247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348009a70 con 0x7f33500c7b90 2023-12-16T01:53:31.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.649+0000 7f334f7fe640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 0x7f3350148b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f334000e9b0 tx=0x7f334000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:31.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.652+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340009670 con 0x7f33500c7b90 2023-12-16T01:53:31.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.652+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000c9a0 con 0x7f33500c7b90 2023-12-16T01:53:31.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.652+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000cd50 con 0x7f33500c7b90 2023-12-16T01:53:31.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.652+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33501441f0 con 0x7f33500c7b90 2023-12-16T01:53:31.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.652+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335014f830 con 0x7f33500c7b90 2023-12-16T01:53:31.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.653+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3350067500 con 0x7f33500c7b90 2023-12-16T01:53:31.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.893+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3340013470 con 0x7f33500c7b90 2023-12-16T01:53:31.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.893+0000 7f3337fff640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f333c06ae90 0x7f333c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:31.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.893+0000 7f334effd640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f333c06ae90 0x7f333c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:31.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.894+0000 7f334effd640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f333c06ae90 0x7f333c06d350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3350149cb0 tx=0x7f3344009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:31.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.906+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3340058dc0 con 0x7f33500c7b90 2023-12-16T01:53:31.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:31.906+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3340055100 con 0x7f33500c7b90 2023-12-16T01:53:32.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.093+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f33500c86b0 con 0x7f33500c7b90 2023-12-16T01:53:32.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.108+0000 7f3337fff640 1 -- 172.21.15.107:0/205697247 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f33400170a0 con 0x7f33500c7b90 2023-12-16T01:53:32.110 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f333c06ae90 msgr2=0x7f333c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f333c06ae90 0x7f333c06d350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3350149cb0 tx=0x7f3344009040 comp rx=0 tx=0).stop 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 msgr2=0x7f3350148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 0x7f3350148b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f334000e9b0 tx=0x7f334000ee70 comp rx=0 tx=0).stop 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 shutdown_connections 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3350159b70 0x7f3350146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f333c06ae90 0x7f333c06d350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33501538f0 0x7f3350145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.112+0000 7f3355a6b640 1 --2- 172.21.15.107:0/205697247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33500c7b90 0x7f3350148b60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.113+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 >> 172.21.15.107:0/205697247 conn(0x7f3350060f20 msgr2=0x7f33500cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:32.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.113+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 shutdown_connections 2023-12-16T01:53:32.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.113+0000 7f3355a6b640 1 -- 172.21.15.107:0/205697247 wait complete. 2023-12-16T01:53:32.125 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T01:53:32.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.225+0000 7ff397bc9640 1 Processor -- start 2023-12-16T01:53:32.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.225+0000 7ff397bc9640 1 -- start start 2023-12-16T01:53:32.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.226+0000 7ff397bc9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff3900c7190 0x7ff3900c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:32.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.226+0000 7ff397bc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff3900c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:32.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.226+0000 7ff397bc9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3900c5f60 con 0x7ff3901504e0 2023-12-16T01:53:32.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.226+0000 7ff397bc9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3900c2c60 con 0x7ff3900c7190 2023-12-16T01:53:32.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.226+0000 7ff397bc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900c2f20 con 0x7ff3900c7700 2023-12-16T01:53:32.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.227+0000 7ff396166640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff3900c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:32.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.227+0000 7ff395164640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff3900c7190 0x7ff3900c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:32.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.227+0000 7ff396166640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff3900c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:48224/0 (socket says 172.21.15.107:48224) 2023-12-16T01:53:32.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.227+0000 7ff395965640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff3901504e0 0x7ff39006e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:40552/0 (socket says 172.21.15.107:40552) 2023-12-16T01:53:32.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.227+0000 7ff396166640 1 -- 172.21.15.107:0/148342942 learned_addr learned my addr 172.21.15.107:0/148342942 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:32.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.230+0000 7ff396166640 1 -- 172.21.15.107:0/148342942 >> v2:172.21.15.157:3300/0 conn(0x7ff3900c7190 msgr2=0x7ff3900c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:32.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.230+0000 7ff396166640 1 --2- 172.21.15.107:0/148342942 >> v2:172.21.15.157:3300/0 conn(0x7ff3900c7190 0x7ff3900c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.230+0000 7ff396166640 1 -- 172.21.15.107:0/148342942 >> v1:172.21.15.157:6789/0 conn(0x7ff3901504e0 legacy=0x7ff39006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.230+0000 7ff396166640 1 -- 172.21.15.107:0/148342942 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900c61b0 con 0x7ff3900c7700 2023-12-16T01:53:32.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.233+0000 7ff396166640 1 --2- 172.21.15.107:0/148342942 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff3900c8220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff388009870 tx=0x7ff38802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a292005db466a779 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:32.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff394963640 1 -- 172.21.15.107:0/148342942 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388031640 con 0x7ff3900c7700 2023-12-16T01:53:32.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff394963640 1 -- 172.21.15.107:0/148342942 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3880317a0 con 0x7ff3900c7700 2023-12-16T01:53:32.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff394963640 1 -- 172.21.15.107:0/148342942 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388031b30 con 0x7ff3900c7700 2023-12-16T01:53:32.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 -- 172.21.15.107:0/148342942 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 msgr2=0x7ff3900c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 --2- 172.21.15.107:0/148342942 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff3900c8220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff388009870 tx=0x7ff38802b8f0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 -- 172.21.15.107:0/148342942 shutdown_connections 2023-12-16T01:53:32.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 --2- 172.21.15.107:0/148342942 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff3900c8220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 --2- 172.21.15.107:0/148342942 >> v2:172.21.15.157:3300/0 conn(0x7ff3900c7190 0x7ff3900c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 -- 172.21.15.107:0/148342942 >> 172.21.15.107:0/148342942 conn(0x7ff3900cbef0 msgr2=0x7ff3900cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:32.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 -- 172.21.15.107:0/148342942 shutdown_connections 2023-12-16T01:53:32.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.237+0000 7ff397bc9640 1 -- 172.21.15.107:0/148342942 wait complete. 2023-12-16T01:53:32.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.238+0000 7ff397bc9640 1 Processor -- start 2023-12-16T01:53:32.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.238+0000 7ff397bc9640 1 -- start start 2023-12-16T01:53:32.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.239+0000 7ff397bc9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c7190 0x7ff3901eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:32.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.239+0000 7ff397bc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff39014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:32.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.239+0000 7ff397bc9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 0x7ff39014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:32.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.239+0000 7ff397bc9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390159840 con 0x7ff3901504e0 2023-12-16T01:53:32.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.239+0000 7ff397bc9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390159510 con 0x7ff3900c7190 2023-12-16T01:53:32.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.239+0000 7ff397bc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3901ef600 con 0x7ff3900c7700 2023-12-16T01:53:32.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.240+0000 7ff395965640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c7190 0x7ff3901eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:32.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.240+0000 7ff395164640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff39014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:32.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.240+0000 7ff396166640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 0x7ff39014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:32.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.240+0000 7ff396166640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 0x7ff39014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37512/0 (socket says 172.21.15.107:37512) 2023-12-16T01:53:32.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.240+0000 7ff396166640 1 -- 172.21.15.107:0/4191108970 learned_addr learned my addr 172.21.15.107:0/4191108970 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:32.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.244+0000 7ff396166640 1 -- 172.21.15.107:0/4191108970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 msgr2=0x7ff39014cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.244+0000 7ff396166640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff39014cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.244+0000 7ff396166640 1 -- 172.21.15.107:0/4191108970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c7190 msgr2=0x7ff3901eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.244+0000 7ff396166640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c7190 0x7ff3901eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.244+0000 7ff396166640 1 -- 172.21.15.107:0/4191108970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880094d0 con 0x7ff3901504e0 2023-12-16T01:53:32.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.246+0000 7ff396166640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 0x7ff39014bb20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff388009870 tx=0x7ff3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:32.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.250+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38803a970 con 0x7ff3901504e0 2023-12-16T01:53:32.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.250+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38803aad0 con 0x7ff3901504e0 2023-12-16T01:53:32.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.250+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3901ef8e0 con 0x7ff3901504e0 2023-12-16T01:53:32.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.250+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38803ae80 con 0x7ff3901504e0 2023-12-16T01:53:32.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.250+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff390146030 con 0x7ff3901504e0 2023-12-16T01:53:32.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.251+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff390159680 con 0x7ff3901504e0 2023-12-16T01:53:32.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.269+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff38802f050 con 0x7ff3901504e0 2023-12-16T01:53:32.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.269+0000 7ff3867fc640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff37406ae90 0x7ff37406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:32.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.270+0000 7ff395965640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff37406ae90 0x7ff37406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:32.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.270+0000 7ff395965640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff37406ae90 0x7ff37406d350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff38c007fd0 tx=0x7ff38c001630 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:32.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.272+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff38807a210 con 0x7ff3901504e0 2023-12-16T01:53:32.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.509+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff388076550 con 0x7ff3901504e0 2023-12-16T01:53:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.699+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff390159680 con 0x7ff3901504e0 2023-12-16T01:53:32.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.703+0000 7ff3867fc640 1 -- 172.21.15.107:0/4191108970 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff390159680 con 0x7ff3901504e0 2023-12-16T01:53:32.705 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2023-12-16T01:53:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff37406ae90 msgr2=0x7ff37406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff37406ae90 0x7ff37406d350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff38c007fd0 tx=0x7ff38c001630 comp rx=0 tx=0).stop 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 msgr2=0x7ff39014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 0x7ff39014bb20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff388009870 tx=0x7ff3880046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 shutdown_connections 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3901504e0 0x7ff39014bb20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c7700 0x7ff39014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff37406ae90 0x7ff37406d350 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 --2- 172.21.15.107:0/4191108970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c7190 0x7ff3901eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 >> 172.21.15.107:0/4191108970 conn(0x7ff3900cbef0 msgr2=0x7ff39014d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 shutdown_connections 2023-12-16T01:53:32.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:32.705+0000 7ff397bc9640 1 -- 172.21.15.107:0/4191108970 wait complete. 2023-12-16T01:53:32.718 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2023-12-16T01:53:32.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:53:32.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-16T01:53:32.745 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:53:32.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[98038]: fuse finished with error 0 and tester_r 0 2023-12-16T01:53:33.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:==00:00:26:53.219 98038== 2023-12-16T01:53:33.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:==00:00:26:53.219 98038== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T01:53:33.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:daemon-helper: command failed with exit status 42 2023-12-16T01:53:36.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:53:36.044 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:53:38.847 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T01:53:38.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T01:53:38.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:53:38.847 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T01:53:38.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:53:38.864 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-12-16T01:53:38.918 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T01:53:38.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:53:38.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T01:53:38.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T01:53:38.986 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2023-12-16T01:53:39.085 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-16T01:53:39.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T01:53:39.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:53:39.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.193+0000 7ffafc29b640 1 Processor -- start 2023-12-16T01:53:39.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.193+0000 7ffafc29b640 1 -- start start 2023-12-16T01:53:39.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.194+0000 7ffafc29b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffaf414fda0 0x7ffaf40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.194+0000 7ffafc29b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffaf40c1960 0x7ffaf4155a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.194+0000 7ffafc29b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf4150180 con 0x7ffaf40bfe90 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.194+0000 7ffafc29b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40c03f0 con 0x7ffaf414fda0 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.194+0000 7ffafc29b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40c66d0 con 0x7ffaf40c1960 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.194+0000 7ffafa037640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffaf414fda0 0x7ffaf40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.195+0000 7ffafa037640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffaf414fda0 0x7ffaf40c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37522/0 (socket says 172.21.15.107:37522) 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.195+0000 7ffafa037640 1 -- 172.21.15.107:0/1630930294 learned_addr learned my addr 172.21.15.107:0/1630930294 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:39.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.195+0000 7ffafa838640 1 --2- 172.21.15.107:0/1630930294 >> v2:172.21.15.157:3300/0 conn(0x7ffaf40c1960 0x7ffaf4155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.197+0000 7ffafa037640 1 -- 172.21.15.107:0/1630930294 >> v2:172.21.15.157:3300/0 conn(0x7ffaf40c1960 msgr2=0x7ffaf4155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:39.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.197+0000 7ffafa037640 1 --2- 172.21.15.107:0/1630930294 >> v2:172.21.15.157:3300/0 conn(0x7ffaf40c1960 0x7ffaf4155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.197+0000 7ffafa037640 1 -- 172.21.15.107:0/1630930294 >> v1:172.21.15.157:6789/0 conn(0x7ffaf40bfe90 legacy=0x7ffaf4072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.197+0000 7ffafa037640 1 -- 172.21.15.107:0/1630930294 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40c68c0 con 0x7ffaf414fda0 2023-12-16T01:53:39.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.199+0000 7ffafa037640 1 --2- 172.21.15.107:0/1630930294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf414fda0 0x7ffaf40c7060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40c8a50 tx=0x7ffaf002df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881d417650f6a545 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:39.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.201+0000 7ffaf9035640 1 -- 172.21.15.107:0/1630930294 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf002ed00 con 0x7ffaf414fda0 2023-12-16T01:53:39.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffaf9035640 1 -- 172.21.15.107:0/1630930294 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0032070 con 0x7ffaf414fda0 2023-12-16T01:53:39.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffaf9035640 1 -- 172.21.15.107:0/1630930294 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0038620 con 0x7ffaf414fda0 2023-12-16T01:53:39.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 -- 172.21.15.107:0/1630930294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf414fda0 msgr2=0x7ffaf40c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 --2- 172.21.15.107:0/1630930294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf414fda0 0x7ffaf40c7060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40c8a50 tx=0x7ffaf002df50 comp rx=0 tx=0).stop 2023-12-16T01:53:39.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 -- 172.21.15.107:0/1630930294 shutdown_connections 2023-12-16T01:53:39.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 --2- 172.21.15.107:0/1630930294 >> v2:172.21.15.157:3300/0 conn(0x7ffaf40c1960 0x7ffaf4155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 --2- 172.21.15.107:0/1630930294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf414fda0 0x7ffaf40c7060 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 -- 172.21.15.107:0/1630930294 >> 172.21.15.107:0/1630930294 conn(0x7ffaf40caba0 msgr2=0x7ffaf40cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:39.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 -- 172.21.15.107:0/1630930294 shutdown_connections 2023-12-16T01:53:39.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.203+0000 7ffafc29b640 1 -- 172.21.15.107:0/1630930294 wait complete. 2023-12-16T01:53:39.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.204+0000 7ffafc29b640 1 Processor -- start 2023-12-16T01:53:39.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 -- start start 2023-12-16T01:53:39.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaf40bfe90 0x7ffaf41dfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 0x7ffaf41492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaf414fda0 0x7ffaf41f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf40c3f70 con 0x7ffaf40c1960 2023-12-16T01:53:39.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4149ff0 con 0x7ffaf414fda0 2023-12-16T01:53:39.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.205+0000 7ffafc29b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf41f3090 con 0x7ffaf40bfe90 2023-12-16T01:53:39.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.206+0000 7ffaf9836640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 0x7ffaf41492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.206+0000 7ffaf9836640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 0x7ffaf41492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37528/0 (socket says 172.21.15.107:37528) 2023-12-16T01:53:39.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.206+0000 7ffaf9836640 1 -- 172.21.15.107:0/3740655243 learned_addr learned my addr 172.21.15.107:0/3740655243 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:39.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.206+0000 7ffafa037640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaf40bfe90 0x7ffaf41dfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.206+0000 7ffafa838640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaf414fda0 0x7ffaf41f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.209+0000 7ffaf9836640 1 -- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaf40bfe90 msgr2=0x7ffaf41dfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.209+0000 7ffaf9836640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaf40bfe90 0x7ffaf41dfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.209+0000 7ffaf9836640 1 -- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaf414fda0 msgr2=0x7ffaf41f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.209+0000 7ffaf9836640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaf414fda0 0x7ffaf41f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.209+0000 7ffaf9836640 1 -- 172.21.15.107:0/3740655243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf000b760 con 0x7ffaf40c1960 2023-12-16T01:53:39.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.211+0000 7ffaf9836640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 0x7ffaf41492e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c3c0 tx=0x7ffae400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:39.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.215+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40052d0 con 0x7ffaf40c1960 2023-12-16T01:53:39.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.215+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4005450 con 0x7ffaf40c1960 2023-12-16T01:53:39.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.215+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4003830 con 0x7ffaf40c1960 2023-12-16T01:53:39.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.215+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf40c3c90 con 0x7ffaf40c1960 2023-12-16T01:53:39.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.215+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf4154b30 con 0x7ffaf40c1960 2023-12-16T01:53:39.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.216+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf41f3250 con 0x7ffaf40c1960 2023-12-16T01:53:39.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.234+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ffae4003990 con 0x7ffaf40c1960 2023-12-16T01:53:39.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.235+0000 7ffaeaffd640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffad806ae70 0x7ffad806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.235+0000 7ffafa037640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffad806ae70 0x7ffad806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.235+0000 7ffafa037640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffad806ae70 0x7ffad806d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0039000 tx=0x7ffaf0034000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:39.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.470+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffae4057aa0 con 0x7ffaf40c1960 2023-12-16T01:53:39.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.470+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ffae4053de0 con 0x7ffaf40c1960 2023-12-16T01:53:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.644+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaf406e9d0 con 0x7ffad806ae70 2023-12-16T01:53:39.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.654+0000 7ffaeaffd640 1 -- 172.21.15.107:0/3740655243 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371039 (secure 0 0 0) 0x7ffaf002ecd0 con 0x7ffad806ae70 2023-12-16T01:53:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:39.663 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffad806ae70 msgr2=0x7ffad806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffad806ae70 0x7ffad806d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0039000 tx=0x7ffaf0034000 comp rx=0 tx=0).stop 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 msgr2=0x7ffaf41492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 0x7ffaf41492e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c3c0 tx=0x7ffae400c880 comp rx=0 tx=0).stop 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 shutdown_connections 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ffad806ae70 0x7ffad806d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaf414fda0 0x7ffaf41f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffaf40c1960 0x7ffaf41492e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 --2- 172.21.15.107:0/3740655243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffaf40bfe90 0x7ffaf41dfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 >> 172.21.15.107:0/3740655243 conn(0x7ffaf40caba0 msgr2=0x7ffaf41e06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:39.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 shutdown_connections 2023-12-16T01:53:39.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.657+0000 7ffafc29b640 1 -- 172.21.15.107:0/3740655243 wait complete. 2023-12-16T01:53:39.670 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":862,"stamp":"2023-12-16T01:53:38.088612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15784,"ondisk_log_size":15784,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518780,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":68410,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":32,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002637"},"pg_stats":[{"pgid":"2.1f","version":"28'621","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.736627+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:53:19.736627+0000","last_peered":"2023-12-16T01:53:19.736627+0000","last_clean":"2023-12-16T01:53:19.736627+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:19.736627+0000","last_undegraded":"2023-12-16T01:53:19.736627+0000","last_fullsized":"2023-12-16T01:53:19.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052203+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:53:33.052203+0000","last_peered":"2023-12-16T01:53:33.052203+0000","last_clean":"2023-12-16T01:53:33.052203+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:53:33.052203+0000","last_undegraded":"2023-12-16T01:53:33.052203+0000","last_fullsized":"2023-12-16T01:53:33.052203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546299+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:53:04.546299+0000","last_peered":"2023-12-16T01:53:04.546299+0000","last_clean":"2023-12-16T01:53:04.546299+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:53:04.546299+0000","last_undegraded":"2023-12-16T01:53:04.546299+0000","last_fullsized":"2023-12-16T01:53:04.546299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'727","reported_seq":758,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642747+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:53:13.642747+0000","last_peered":"2023-12-16T01:53:13.642747+0000","last_clean":"2023-12-16T01:53:13.642747+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:53:13.642747+0000","last_undegraded":"2023-12-16T01:53:13.642747+0000","last_fullsized":"2023-12-16T01:53:13.642747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052578+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:53:33.052578+0000","last_peered":"2023-12-16T01:53:33.052578+0000","last_clean":"2023-12-16T01:53:33.052578+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:33.052578+0000","last_undegraded":"2023-12-16T01:53:33.052578+0000","last_fullsized":"2023-12-16T01:53:33.052578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.950355+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:52:58.950355+0000","last_peered":"2023-12-16T01:52:58.950355+0000","last_clean":"2023-12-16T01:52:58.950355+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:52:58.950355+0000","last_undegraded":"2023-12-16T01:52:58.950355+0000","last_fullsized":"2023-12-16T01:52:58.950355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1394","reported_seq":1423,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.861096+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:53:25.861096+0000","last_peered":"2023-12-16T01:53:25.861096+0000","last_clean":"2023-12-16T01:53:25.861096+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:25.861096+0000","last_undegraded":"2023-12-16T01:53:25.861096+0000","last_fullsized":"2023-12-16T01:53:25.861096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1394,"log_dups_size":0,"ondisk_log_size":1394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089082+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:53:33.089082+0000","last_peered":"2023-12-16T01:53:33.089082+0000","last_clean":"2023-12-16T01:53:33.089082+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:33.089082+0000","last_undegraded":"2023-12-16T01:53:33.089082+0000","last_fullsized":"2023-12-16T01:53:33.089082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.523291+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:53:05.523291+0000","last_peered":"2023-12-16T01:53:05.523291+0000","last_clean":"2023-12-16T01:53:05.523291+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:53:05.523291+0000","last_undegraded":"2023-12-16T01:53:05.523291+0000","last_fullsized":"2023-12-16T01:53:05.523291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:18.987587+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:53:18.987587+0000","last_peered":"2023-12-16T01:53:18.987587+0000","last_clean":"2023-12-16T01:53:18.987587+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:53:18.987587+0000","last_undegraded":"2023-12-16T01:53:18.987587+0000","last_fullsized":"2023-12-16T01:53:18.987587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003080+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003080+0000","last_peered":"2023-12-16T01:53:33.003080+0000","last_clean":"2023-12-16T01:53:33.003080+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003080+0000","last_undegraded":"2023-12-16T01:53:33.003080+0000","last_fullsized":"2023-12-16T01:53:33.003080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:29:57.092568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.513556+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:53:05.513556+0000","last_peered":"2023-12-16T01:53:05.513556+0000","last_clean":"2023-12-16T01:53:05.513556+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:53:05.513556+0000","last_undegraded":"2023-12-16T01:53:05.513556+0000","last_fullsized":"2023-12-16T01:53:05.513556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.011587+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:53:33.011587+0000","last_peered":"2023-12-16T01:53:33.011587+0000","last_clean":"2023-12-16T01:53:33.011587+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:53:33.011587+0000","last_undegraded":"2023-12-16T01:53:33.011587+0000","last_fullsized":"2023-12-16T01:53:33.011587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'637","reported_seq":667,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:21.784478+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:53:21.784478+0000","last_peered":"2023-12-16T01:53:21.784478+0000","last_clean":"2023-12-16T01:53:21.784478+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:53:21.784478+0000","last_undegraded":"2023-12-16T01:53:21.784478+0000","last_fullsized":"2023-12-16T01:53:21.784478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503323+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503323+0000","last_peered":"2023-12-16T01:53:05.503323+0000","last_clean":"2023-12-16T01:53:05.503323+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503323+0000","last_undegraded":"2023-12-16T01:53:05.503323+0000","last_fullsized":"2023-12-16T01:53:05.503323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.970424+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:53:32.970424+0000","last_peered":"2023-12-16T01:53:32.970424+0000","last_clean":"2023-12-16T01:53:32.970424+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:53:32.970424+0000","last_undegraded":"2023-12-16T01:53:32.970424+0000","last_fullsized":"2023-12-16T01:53:32.970424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642954+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:53:13.642954+0000","last_peered":"2023-12-16T01:53:13.642954+0000","last_clean":"2023-12-16T01:53:13.642954+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:53:13.642954+0000","last_undegraded":"2023-12-16T01:53:13.642954+0000","last_fullsized":"2023-12-16T01:53:13.642954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546380+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:53:04.546380+0000","last_peered":"2023-12-16T01:53:04.546380+0000","last_clean":"2023-12-16T01:53:04.546380+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:53:04.546380+0000","last_undegraded":"2023-12-16T01:53:04.546380+0000","last_fullsized":"2023-12-16T01:53:04.546380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089208+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:53:33.089208+0000","last_peered":"2023-12-16T01:53:33.089208+0000","last_clean":"2023-12-16T01:53:33.089208+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:53:33.089208+0000","last_undegraded":"2023-12-16T01:53:33.089208+0000","last_fullsized":"2023-12-16T01:53:33.089208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:39.770859+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:49:39.770859+0000","last_peered":"2023-12-16T01:49:39.770859+0000","last_clean":"2023-12-16T01:49:39.770859+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:49:39.770859+0000","last_undegraded":"2023-12-16T01:49:39.770859+0000","last_fullsized":"2023-12-16T01:49:39.770859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.402834+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:53:03.402834+0000","last_peered":"2023-12-16T01:53:03.402834+0000","last_clean":"2023-12-16T01:53:03.402834+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:53:03.402834+0000","last_undegraded":"2023-12-16T01:53:03.402834+0000","last_fullsized":"2023-12-16T01:53:03.402834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.576104+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:53:02.576104+0000","last_peered":"2023-12-16T01:53:02.576104+0000","last_clean":"2023-12-16T01:53:02.576104+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:02.576104+0000","last_undegraded":"2023-12-16T01:53:02.576104+0000","last_fullsized":"2023-12-16T01:53:02.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746058+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:53:20.746058+0000","last_peered":"2023-12-16T01:53:20.746058+0000","last_clean":"2023-12-16T01:53:20.746058+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:20.746058+0000","last_undegraded":"2023-12-16T01:53:20.746058+0000","last_fullsized":"2023-12-16T01:53:20.746058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":150,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.511655+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:53:05.511655+0000","last_peered":"2023-12-16T01:53:05.511655+0000","last_clean":"2023-12-16T01:53:05.511655+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:53:05.511655+0000","last_undegraded":"2023-12-16T01:53:05.511655+0000","last_fullsized":"2023-12-16T01:53:05.511655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089117+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:53:33.089117+0000","last_peered":"2023-12-16T01:53:33.089117+0000","last_clean":"2023-12-16T01:53:33.089117+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:53:33.089117+0000","last_undegraded":"2023-12-16T01:53:33.089117+0000","last_fullsized":"2023-12-16T01:53:33.089117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'11","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.858325+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:53:25.858325+0000","last_peered":"2023-12-16T01:53:25.858325+0000","last_clean":"2023-12-16T01:53:25.858325+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:53:25.858325+0000","last_undegraded":"2023-12-16T01:53:25.858325+0000","last_fullsized":"2023-12-16T01:53:25.858325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.894062+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:53:03.894062+0000","last_peered":"2023-12-16T01:53:03.894062+0000","last_clean":"2023-12-16T01:53:03.894062+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:53:03.894062+0000","last_undegraded":"2023-12-16T01:53:03.894062+0000","last_fullsized":"2023-12-16T01:53:03.894062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089363+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:53:33.089363+0000","last_peered":"2023-12-16T01:53:33.089363+0000","last_clean":"2023-12-16T01:53:33.089363+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:53:33.089363+0000","last_undegraded":"2023-12-16T01:53:33.089363+0000","last_fullsized":"2023-12-16T01:53:33.089363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'310","reported_seq":341,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:29.053543+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:53:29.053543+0000","last_peered":"2023-12-16T01:53:29.053543+0000","last_clean":"2023-12-16T01:53:29.053543+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:53:29.053543+0000","last_undegraded":"2023-12-16T01:53:29.053543+0000","last_fullsized":"2023-12-16T01:53:29.053543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.545783+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:53:04.545783+0000","last_peered":"2023-12-16T01:53:04.545783+0000","last_clean":"2023-12-16T01:53:04.545783+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:53:04.545783+0000","last_undegraded":"2023-12-16T01:53:04.545783+0000","last_fullsized":"2023-12-16T01:53:04.545783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.984623+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:53:32.984623+0000","last_peered":"2023-12-16T01:53:32.984623+0000","last_clean":"2023-12-16T01:53:32.984623+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:53:32.984623+0000","last_undegraded":"2023-12-16T01:53:32.984623+0000","last_fullsized":"2023-12-16T01:53:32.984623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:16.660057+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:53:16.660057+0000","last_peered":"2023-12-16T01:53:16.660057+0000","last_clean":"2023-12-16T01:53:16.660057+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:53:16.660057+0000","last_undegraded":"2023-12-16T01:53:16.660057+0000","last_fullsized":"2023-12-16T01:53:16.660057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.562047+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:53:04.562047+0000","last_peered":"2023-12-16T01:53:04.562047+0000","last_clean":"2023-12-16T01:53:04.562047+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:53:04.562047+0000","last_undegraded":"2023-12-16T01:53:04.562047+0000","last_fullsized":"2023-12-16T01:53:04.562047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013234+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:53:33.013234+0000","last_peered":"2023-12-16T01:53:33.013234+0000","last_clean":"2023-12-16T01:53:33.013234+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:33.013234+0000","last_undegraded":"2023-12-16T01:53:33.013234+0000","last_fullsized":"2023-12-16T01:53:33.013234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:09.553576+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:53:09.553576+0000","last_peered":"2023-12-16T01:53:09.553576+0000","last_clean":"2023-12-16T01:53:09.553576+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:09.553576+0000","last_undegraded":"2023-12-16T01:53:09.553576+0000","last_fullsized":"2023-12-16T01:53:09.553576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:59.749941+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:52:59.749941+0000","last_peered":"2023-12-16T01:52:59.749941+0000","last_clean":"2023-12-16T01:52:59.749941+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:52:59.749941+0000","last_undegraded":"2023-12-16T01:52:59.749941+0000","last_fullsized":"2023-12-16T01:52:59.749941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.043561+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:53:33.043561+0000","last_peered":"2023-12-16T01:53:33.043561+0000","last_clean":"2023-12-16T01:53:33.043561+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:53:33.043561+0000","last_undegraded":"2023-12-16T01:53:33.043561+0000","last_fullsized":"2023-12-16T01:53:33.043561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.733213+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:53:19.733213+0000","last_peered":"2023-12-16T01:53:19.733213+0000","last_clean":"2023-12-16T01:53:19.733213+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:53:19.733213+0000","last_undegraded":"2023-12-16T01:53:19.733213+0000","last_fullsized":"2023-12-16T01:53:19.733213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.525881+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:53:05.525881+0000","last_peered":"2023-12-16T01:53:05.525881+0000","last_clean":"2023-12-16T01:53:05.525881+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:53:05.525881+0000","last_undegraded":"2023-12-16T01:53:05.525881+0000","last_fullsized":"2023-12-16T01:53:05.525881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048436+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:53:33.048436+0000","last_peered":"2023-12-16T01:53:33.048436+0000","last_clean":"2023-12-16T01:53:33.048436+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:53:33.048436+0000","last_undegraded":"2023-12-16T01:53:33.048436+0000","last_fullsized":"2023-12-16T01:53:33.048436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:30.852212+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:53:30.852212+0000","last_peered":"2023-12-16T01:53:30.852212+0000","last_clean":"2023-12-16T01:53:30.852212+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:30.852212+0000","last_undegraded":"2023-12-16T01:53:30.852212+0000","last_fullsized":"2023-12-16T01:53:30.852212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394771+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:53:03.394771+0000","last_peered":"2023-12-16T01:53:03.394771+0000","last_clean":"2023-12-16T01:53:03.394771+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:53:03.394771+0000","last_undegraded":"2023-12-16T01:53:03.394771+0000","last_fullsized":"2023-12-16T01:53:03.394771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985745+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:53:32.985745+0000","last_peered":"2023-12-16T01:53:32.985745+0000","last_clean":"2023-12-16T01:53:32.985745+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:53:32.985745+0000","last_undegraded":"2023-12-16T01:53:32.985745+0000","last_fullsized":"2023-12-16T01:53:32.985745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'555","reported_seq":586,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859131+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:53:25.859131+0000","last_peered":"2023-12-16T01:53:25.859131+0000","last_clean":"2023-12-16T01:53:25.859131+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:53:25.859131+0000","last_undegraded":"2023-12-16T01:53:25.859131+0000","last_fullsized":"2023-12-16T01:53:25.859131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.498426+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:53:05.498426+0000","last_peered":"2023-12-16T01:53:05.498426+0000","last_clean":"2023-12-16T01:53:05.498426+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:53:05.498426+0000","last_undegraded":"2023-12-16T01:53:05.498426+0000","last_fullsized":"2023-12-16T01:53:05.498426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092052+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:53:33.092052+0000","last_peered":"2023-12-16T01:53:33.092052+0000","last_clean":"2023-12-16T01:53:33.092052+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:53:33.092052+0000","last_undegraded":"2023-12-16T01:53:33.092052+0000","last_fullsized":"2023-12-16T01:53:33.092052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.958970+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:52:53.958970+0000","last_peered":"2023-12-16T01:52:53.958970+0000","last_clean":"2023-12-16T01:52:53.958970+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:52:53.958970+0000","last_undegraded":"2023-12-16T01:52:53.958970+0000","last_fullsized":"2023-12-16T01:52:53.958970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:43.837180+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:49:43.837180+0000","last_peered":"2023-12-16T01:49:43.837180+0000","last_clean":"2023-12-16T01:49:43.837180+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:49:43.837180+0000","last_undegraded":"2023-12-16T01:49:43.837180+0000","last_fullsized":"2023-12-16T01:49:43.837180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394625+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:53:03.394625+0000","last_peered":"2023-12-16T01:53:03.394625+0000","last_clean":"2023-12-16T01:53:03.394625+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:53:03.394625+0000","last_undegraded":"2023-12-16T01:53:03.394625+0000","last_fullsized":"2023-12-16T01:53:03.394625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003140+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:53:33.003140+0000","last_peered":"2023-12-16T01:53:33.003140+0000","last_clean":"2023-12-16T01:53:33.003140+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:33.003140+0000","last_undegraded":"2023-12-16T01:53:33.003140+0000","last_fullsized":"2023-12-16T01:53:33.003140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.701145+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:53:17.701145+0000","last_peered":"2023-12-16T01:53:17.701145+0000","last_clean":"2023-12-16T01:53:17.701145+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:17.701145+0000","last_undegraded":"2023-12-16T01:53:17.701145+0000","last_fullsized":"2023-12-16T01:53:17.701145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.614282+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:53:02.614282+0000","last_peered":"2023-12-16T01:53:02.614282+0000","last_clean":"2023-12-16T01:53:02.614282+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:53:02.614282+0000","last_undegraded":"2023-12-16T01:53:02.614282+0000","last_fullsized":"2023-12-16T01:53:02.614282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051127+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:53:33.051127+0000","last_peered":"2023-12-16T01:53:33.051127+0000","last_clean":"2023-12-16T01:53:33.051127+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:53:33.051127+0000","last_undegraded":"2023-12-16T01:53:33.051127+0000","last_fullsized":"2023-12-16T01:53:33.051127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.702497+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:53:17.702497+0000","last_peered":"2023-12-16T01:53:17.702497+0000","last_clean":"2023-12-16T01:53:17.702497+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:17.702497+0000","last_undegraded":"2023-12-16T01:53:17.702497+0000","last_fullsized":"2023-12-16T01:53:17.702497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399892+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:53:03.399892+0000","last_peered":"2023-12-16T01:53:03.399892+0000","last_clean":"2023-12-16T01:53:03.399892+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:53:03.399892+0000","last_undegraded":"2023-12-16T01:53:03.399892+0000","last_fullsized":"2023-12-16T01:53:03.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075246+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:53:33.075246+0000","last_peered":"2023-12-16T01:53:33.075246+0000","last_clean":"2023-12-16T01:53:33.075246+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:53:33.075246+0000","last_undegraded":"2023-12-16T01:53:33.075246+0000","last_fullsized":"2023-12-16T01:53:33.075246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735726+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:53:19.735726+0000","last_peered":"2023-12-16T01:53:19.735726+0000","last_clean":"2023-12-16T01:53:19.735726+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:53:19.735726+0000","last_undegraded":"2023-12-16T01:53:19.735726+0000","last_fullsized":"2023-12-16T01:53:19.735726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.758398+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:53:01.758398+0000","last_peered":"2023-12-16T01:53:01.758398+0000","last_clean":"2023-12-16T01:53:01.758398+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:53:01.758398+0000","last_undegraded":"2023-12-16T01:53:01.758398+0000","last_fullsized":"2023-12-16T01:53:01.758398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002598+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:53:33.002598+0000","last_peered":"2023-12-16T01:53:33.002598+0000","last_clean":"2023-12-16T01:53:33.002598+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:33.002598+0000","last_undegraded":"2023-12-16T01:53:33.002598+0000","last_fullsized":"2023-12-16T01:53:33.002598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.984895+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:52:53.984895+0000","last_peered":"2023-12-16T01:52:53.984895+0000","last_clean":"2023-12-16T01:52:53.984895+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:52:53.984895+0000","last_undegraded":"2023-12-16T01:52:53.984895+0000","last_fullsized":"2023-12-16T01:52:53.984895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.588615+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:53:02.588615+0000","last_peered":"2023-12-16T01:53:02.588615+0000","last_clean":"2023-12-16T01:53:02.588615+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:53:02.588615+0000","last_undegraded":"2023-12-16T01:53:02.588615+0000","last_fullsized":"2023-12-16T01:53:02.588615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.998352+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:53:32.998352+0000","last_peered":"2023-12-16T01:53:32.998352+0000","last_clean":"2023-12-16T01:53:32.998352+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:32.998352+0000","last_undegraded":"2023-12-16T01:53:32.998352+0000","last_fullsized":"2023-12-16T01:53:32.998352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:51:29.781913+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:51:29.781913+0000","last_peered":"2023-12-16T01:51:29.781913+0000","last_clean":"2023-12-16T01:51:29.781913+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:51:29.781913+0000","last_undegraded":"2023-12-16T01:51:29.781913+0000","last_fullsized":"2023-12-16T01:51:29.781913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394238+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:53:03.394238+0000","last_peered":"2023-12-16T01:53:03.394238+0000","last_clean":"2023-12-16T01:53:03.394238+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:53:03.394238+0000","last_undegraded":"2023-12-16T01:53:03.394238+0000","last_fullsized":"2023-12-16T01:53:03.394238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.082967+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:53:33.082967+0000","last_peered":"2023-12-16T01:53:33.082967+0000","last_clean":"2023-12-16T01:53:33.082967+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:33.082967+0000","last_undegraded":"2023-12-16T01:53:33.082967+0000","last_fullsized":"2023-12-16T01:53:33.082967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.781615+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:53:22.781615+0000","last_peered":"2023-12-16T01:53:22.781615+0000","last_clean":"2023-12-16T01:53:22.781615+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:53:22.781615+0000","last_undegraded":"2023-12-16T01:53:22.781615+0000","last_fullsized":"2023-12-16T01:53:22.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.024631+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:52:58.024631+0000","last_peered":"2023-12-16T01:52:58.024631+0000","last_clean":"2023-12-16T01:52:58.024631+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:52:58.024631+0000","last_undegraded":"2023-12-16T01:52:58.024631+0000","last_fullsized":"2023-12-16T01:52:58.024631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.005175+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:53:33.005175+0000","last_peered":"2023-12-16T01:53:33.005175+0000","last_clean":"2023-12-16T01:53:33.005175+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:53:33.005175+0000","last_undegraded":"2023-12-16T01:53:33.005175+0000","last_fullsized":"2023-12-16T01:53:33.005175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859130+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:53:25.859130+0000","last_peered":"2023-12-16T01:53:25.859130+0000","last_clean":"2023-12-16T01:53:25.859130+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:53:25.859130+0000","last_undegraded":"2023-12-16T01:53:25.859130+0000","last_fullsized":"2023-12-16T01:53:25.859130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":146,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.755626+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:53:01.755626+0000","last_peered":"2023-12-16T01:53:01.755626+0000","last_clean":"2023-12-16T01:53:01.755626+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:53:01.755626+0000","last_undegraded":"2023-12-16T01:53:01.755626+0000","last_fullsized":"2023-12-16T01:53:01.755626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.991774+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:53:32.991774+0000","last_peered":"2023-12-16T01:53:32.991774+0000","last_clean":"2023-12-16T01:53:32.991774+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:53:32.991774+0000","last_undegraded":"2023-12-16T01:53:32.991774+0000","last_fullsized":"2023-12-16T01:53:32.991774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'303","reported_seq":333,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.800001+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:53:32.800001+0000","last_peered":"2023-12-16T01:53:32.800001+0000","last_clean":"2023-12-16T01:53:32.800001+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:32.800001+0000","last_undegraded":"2023-12-16T01:53:32.800001+0000","last_fullsized":"2023-12-16T01:53:32.800001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:00.568175+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:00.568175+0000","last_peered":"2023-12-16T01:53:00.568175+0000","last_clean":"2023-12-16T01:53:00.568175+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:00.568175+0000","last_undegraded":"2023-12-16T01:53:00.568175+0000","last_fullsized":"2023-12-16T01:53:00.568175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051233+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:53:33.051233+0000","last_peered":"2023-12-16T01:53:33.051233+0000","last_clean":"2023-12-16T01:53:33.051233+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:33.051233+0000","last_undegraded":"2023-12-16T01:53:33.051233+0000","last_fullsized":"2023-12-16T01:53:33.051233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'859","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.771475+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:53:22.771475+0000","last_peered":"2023-12-16T01:53:22.771475+0000","last_clean":"2023-12-16T01:53:22.771475+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:22.771475+0000","last_undegraded":"2023-12-16T01:53:22.771475+0000","last_fullsized":"2023-12-16T01:53:22.771475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546516+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:53:04.546516+0000","last_peered":"2023-12-16T01:53:04.546516+0000","last_clean":"2023-12-16T01:53:04.546516+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:53:04.546516+0000","last_undegraded":"2023-12-16T01:53:04.546516+0000","last_fullsized":"2023-12-16T01:53:04.546516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013492+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:53:33.013492+0000","last_peered":"2023-12-16T01:53:33.013492+0000","last_clean":"2023-12-16T01:53:33.013492+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:33.013492+0000","last_undegraded":"2023-12-16T01:53:33.013492+0000","last_fullsized":"2023-12-16T01:53:33.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'732","reported_seq":762,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:26.858591+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:53:26.858591+0000","last_peered":"2023-12-16T01:53:26.858591+0000","last_clean":"2023-12-16T01:53:26.858591+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:26.858591+0000","last_undegraded":"2023-12-16T01:53:26.858591+0000","last_fullsized":"2023-12-16T01:53:26.858591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.620159+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:53:02.620159+0000","last_peered":"2023-12-16T01:53:02.620159+0000","last_clean":"2023-12-16T01:53:02.620159+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:53:02.620159+0000","last_undegraded":"2023-12-16T01:53:02.620159+0000","last_fullsized":"2023-12-16T01:53:02.620159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051987+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:53:33.051987+0000","last_peered":"2023-12-16T01:53:33.051987+0000","last_clean":"2023-12-16T01:53:33.051987+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:53:33.051987+0000","last_undegraded":"2023-12-16T01:53:33.051987+0000","last_fullsized":"2023-12-16T01:53:33.051987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735578+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:53:19.735578+0000","last_peered":"2023-12-16T01:53:19.735578+0000","last_clean":"2023-12-16T01:53:19.735578+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:19.735578+0000","last_undegraded":"2023-12-16T01:53:19.735578+0000","last_fullsized":"2023-12-16T01:53:19.735578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551096+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:53:04.551096+0000","last_peered":"2023-12-16T01:53:04.551096+0000","last_clean":"2023-12-16T01:53:04.551096+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:53:04.551096+0000","last_undegraded":"2023-12-16T01:53:04.551096+0000","last_fullsized":"2023-12-16T01:53:04.551096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.014454+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:53:33.014454+0000","last_peered":"2023-12-16T01:53:33.014454+0000","last_clean":"2023-12-16T01:53:33.014454+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:53:33.014454+0000","last_undegraded":"2023-12-16T01:53:33.014454+0000","last_fullsized":"2023-12-16T01:53:33.014454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.703191+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:53:17.703191+0000","last_peered":"2023-12-16T01:53:17.703191+0000","last_clean":"2023-12-16T01:53:17.703191+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:17.703191+0000","last_undegraded":"2023-12-16T01:53:17.703191+0000","last_fullsized":"2023-12-16T01:53:17.703191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":188,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546309+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:53:04.546309+0000","last_peered":"2023-12-16T01:53:04.546309+0000","last_clean":"2023-12-16T01:53:04.546309+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:53:04.546309+0000","last_undegraded":"2023-12-16T01:53:04.546309+0000","last_fullsized":"2023-12-16T01:53:04.546309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399829+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:53:03.399829+0000","last_peered":"2023-12-16T01:53:03.399829+0000","last_clean":"2023-12-16T01:53:03.399829+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:53:03.399829+0000","last_undegraded":"2023-12-16T01:53:03.399829+0000","last_fullsized":"2023-12-16T01:53:03.399829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.091709+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:53:33.091709+0000","last_peered":"2023-12-16T01:53:33.091709+0000","last_clean":"2023-12-16T01:53:33.091709+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:53:33.091709+0000","last_undegraded":"2023-12-16T01:53:33.091709+0000","last_fullsized":"2023-12-16T01:53:33.091709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.782204+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:53:22.782204+0000","last_peered":"2023-12-16T01:53:22.782204+0000","last_clean":"2023-12-16T01:53:22.782204+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:53:22.782204+0000","last_undegraded":"2023-12-16T01:53:22.782204+0000","last_fullsized":"2023-12-16T01:53:22.782204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546447+0000","last_change":"2023-12-16T01:26:31.583645+0000","last_active":"2023-12-16T01:53:04.546447+0000","last_peered":"2023-12-16T01:53:04.546447+0000","last_clean":"2023-12-16T01:53:04.546447+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:53:04.546447+0000","last_undegraded":"2023-12-16T01:53:04.546447+0000","last_fullsized":"2023-12-16T01:53:04.546447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:33:04.088136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.050878+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:53:33.050878+0000","last_peered":"2023-12-16T01:53:33.050878+0000","last_clean":"2023-12-16T01:53:33.050878+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:33.050878+0000","last_undegraded":"2023-12-16T01:53:33.050878+0000","last_fullsized":"2023-12-16T01:53:33.050878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.713624+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:53:15.713624+0000","last_peered":"2023-12-16T01:53:15.713624+0000","last_clean":"2023-12-16T01:53:15.713624+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:15.713624+0000","last_undegraded":"2023-12-16T01:53:15.713624+0000","last_fullsized":"2023-12-16T01:53:15.713624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'706","reported_seq":735,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.727664+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:53:15.727664+0000","last_peered":"2023-12-16T01:53:15.727664+0000","last_clean":"2023-12-16T01:53:15.727664+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:53:15.727664+0000","last_undegraded":"2023-12-16T01:53:15.727664+0000","last_fullsized":"2023-12-16T01:53:15.727664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092144+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:53:33.092144+0000","last_peered":"2023-12-16T01:53:33.092144+0000","last_clean":"2023-12-16T01:53:33.092144+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:53:33.092144+0000","last_undegraded":"2023-12-16T01:53:33.092144+0000","last_fullsized":"2023-12-16T01:53:33.092144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.397888+0000","last_change":"2023-12-16T01:26:31.583485+0000","last_active":"2023-12-16T01:53:03.397888+0000","last_peered":"2023-12-16T01:53:03.397888+0000","last_clean":"2023-12-16T01:53:03.397888+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:53:03.397888+0000","last_undegraded":"2023-12-16T01:53:03.397888+0000","last_fullsized":"2023-12-16T01:53:03.397888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:51.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'707","reported_seq":736,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746082+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:53:20.746082+0000","last_peered":"2023-12-16T01:53:20.746082+0000","last_clean":"2023-12-16T01:53:20.746082+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:53:20.746082+0000","last_undegraded":"2023-12-16T01:53:20.746082+0000","last_fullsized":"2023-12-16T01:53:20.746082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088690+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:53:33.088690+0000","last_peered":"2023-12-16T01:53:33.088690+0000","last_clean":"2023-12-16T01:53:33.088690+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:33.088690+0000","last_undegraded":"2023-12-16T01:53:33.088690+0000","last_fullsized":"2023-12-16T01:53:33.088690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.526023+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:53:05.526023+0000","last_peered":"2023-12-16T01:53:05.526023+0000","last_clean":"2023-12-16T01:53:05.526023+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:53:05.526023+0000","last_undegraded":"2023-12-16T01:53:05.526023+0000","last_fullsized":"2023-12-16T01:53:05.526023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013111+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:53:33.013111+0000","last_peered":"2023-12-16T01:53:33.013111+0000","last_clean":"2023-12-16T01:53:33.013111+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:33.013111+0000","last_undegraded":"2023-12-16T01:53:33.013111+0000","last_fullsized":"2023-12-16T01:53:33.013111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.974726+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:53:32.974726+0000","last_peered":"2023-12-16T01:53:32.974726+0000","last_clean":"2023-12-16T01:53:32.974726+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:32.974726+0000","last_undegraded":"2023-12-16T01:53:32.974726+0000","last_fullsized":"2023-12-16T01:53:32.974726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.996419+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:53:32.996419+0000","last_peered":"2023-12-16T01:53:32.996419+0000","last_clean":"2023-12-16T01:53:32.996419+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:53:32.996419+0000","last_undegraded":"2023-12-16T01:53:32.996419+0000","last_fullsized":"2023-12-16T01:53:32.996419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048222+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:53:33.048222+0000","last_peered":"2023-12-16T01:53:33.048222+0000","last_clean":"2023-12-16T01:53:33.048222+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:33.048222+0000","last_undegraded":"2023-12-16T01:53:33.048222+0000","last_fullsized":"2023-12-16T01:53:33.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988764+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:53:32.988764+0000","last_peered":"2023-12-16T01:53:32.988764+0000","last_clean":"2023-12-16T01:53:32.988764+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:53:32.988764+0000","last_undegraded":"2023-12-16T01:53:32.988764+0000","last_fullsized":"2023-12-16T01:53:32.988764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.983477+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:53:32.983477+0000","last_peered":"2023-12-16T01:53:32.983477+0000","last_clean":"2023-12-16T01:53:32.983477+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:53:32.983477+0000","last_undegraded":"2023-12-16T01:53:32.983477+0000","last_fullsized":"2023-12-16T01:53:32.983477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013189+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:53:33.013189+0000","last_peered":"2023-12-16T01:53:33.013189+0000","last_clean":"2023-12-16T01:53:33.013189+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:53:33.013189+0000","last_undegraded":"2023-12-16T01:53:33.013189+0000","last_fullsized":"2023-12-16T01:53:33.013189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052390+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:53:33.052390+0000","last_peered":"2023-12-16T01:53:33.052390+0000","last_clean":"2023-12-16T01:53:33.052390+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:53:33.052390+0000","last_undegraded":"2023-12-16T01:53:33.052390+0000","last_fullsized":"2023-12-16T01:53:33.052390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002679+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:53:33.002679+0000","last_peered":"2023-12-16T01:53:33.002679+0000","last_clean":"2023-12-16T01:53:33.002679+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:53:33.002679+0000","last_undegraded":"2023-12-16T01:53:33.002679+0000","last_fullsized":"2023-12-16T01:53:33.002679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052472+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:53:33.052472+0000","last_peered":"2023-12-16T01:53:33.052472+0000","last_clean":"2023-12-16T01:53:33.052472+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:53:33.052472+0000","last_undegraded":"2023-12-16T01:53:33.052472+0000","last_fullsized":"2023-12-16T01:53:33.052472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089039+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:53:33.089039+0000","last_peered":"2023-12-16T01:53:33.089039+0000","last_clean":"2023-12-16T01:53:33.089039+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:33.089039+0000","last_undegraded":"2023-12-16T01:53:33.089039+0000","last_fullsized":"2023-12-16T01:53:33.089039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.093269+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:53:33.093269+0000","last_peered":"2023-12-16T01:53:33.093269+0000","last_clean":"2023-12-16T01:53:33.093269+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:33.093269+0000","last_undegraded":"2023-12-16T01:53:33.093269+0000","last_fullsized":"2023-12-16T01:53:33.093269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.074698+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:53:33.074698+0000","last_peered":"2023-12-16T01:53:33.074698+0000","last_clean":"2023-12-16T01:53:33.074698+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:53:33.074698+0000","last_undegraded":"2023-12-16T01:53:33.074698+0000","last_fullsized":"2023-12-16T01:53:33.074698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.997000+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:53:32.997000+0000","last_peered":"2023-12-16T01:53:32.997000+0000","last_clean":"2023-12-16T01:53:32.997000+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:53:32.997000+0000","last_undegraded":"2023-12-16T01:53:32.997000+0000","last_fullsized":"2023-12-16T01:53:32.997000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.975471+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:53:32.975471+0000","last_peered":"2023-12-16T01:53:32.975471+0000","last_clean":"2023-12-16T01:53:32.975471+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:32.975471+0000","last_undegraded":"2023-12-16T01:53:32.975471+0000","last_fullsized":"2023-12-16T01:53:32.975471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002376+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:53:33.002376+0000","last_peered":"2023-12-16T01:53:33.002376+0000","last_clean":"2023-12-16T01:53:33.002376+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:33.002376+0000","last_undegraded":"2023-12-16T01:53:33.002376+0000","last_fullsized":"2023-12-16T01:53:33.002376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002747+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:53:33.002747+0000","last_peered":"2023-12-16T01:53:33.002747+0000","last_clean":"2023-12-16T01:53:33.002747+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:53:33.002747+0000","last_undegraded":"2023-12-16T01:53:33.002747+0000","last_fullsized":"2023-12-16T01:53:33.002747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052466+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:53:33.052466+0000","last_peered":"2023-12-16T01:53:33.052466+0000","last_clean":"2023-12-16T01:53:33.052466+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:53:33.052466+0000","last_undegraded":"2023-12-16T01:53:33.052466+0000","last_fullsized":"2023-12-16T01:53:33.052466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985017+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:53:32.985017+0000","last_peered":"2023-12-16T01:53:32.985017+0000","last_clean":"2023-12-16T01:53:32.985017+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:53:32.985017+0000","last_undegraded":"2023-12-16T01:53:32.985017+0000","last_fullsized":"2023-12-16T01:53:32.985017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988929+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:53:32.988929+0000","last_peered":"2023-12-16T01:53:32.988929+0000","last_clean":"2023-12-16T01:53:32.988929+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:53:32.988929+0000","last_undegraded":"2023-12-16T01:53:32.988929+0000","last_fullsized":"2023-12-16T01:53:32.988929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075656+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:53:33.075656+0000","last_peered":"2023-12-16T01:53:33.075656+0000","last_clean":"2023-12-16T01:53:33.075656+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:53:33.075656+0000","last_undegraded":"2023-12-16T01:53:33.075656+0000","last_fullsized":"2023-12-16T01:53:33.075656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.071227+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:53:33.071227+0000","last_peered":"2023-12-16T01:53:33.071227+0000","last_clean":"2023-12-16T01:53:33.071227+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:53:33.071227+0000","last_undegraded":"2023-12-16T01:53:33.071227+0000","last_fullsized":"2023-12-16T01:53:33.071227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075442+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:53:33.075442+0000","last_peered":"2023-12-16T01:53:33.075442+0000","last_clean":"2023-12-16T01:53:33.075442+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:53:33.075442+0000","last_undegraded":"2023-12-16T01:53:33.075442+0000","last_fullsized":"2023-12-16T01:53:33.075442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088834+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:53:33.088834+0000","last_peered":"2023-12-16T01:53:33.088834+0000","last_clean":"2023-12-16T01:53:33.088834+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:53:33.088834+0000","last_undegraded":"2023-12-16T01:53:33.088834+0000","last_fullsized":"2023-12-16T01:53:33.088834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.054078+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:53:33.054078+0000","last_peered":"2023-12-16T01:53:33.054078+0000","last_clean":"2023-12-16T01:53:33.054078+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:53:33.054078+0000","last_undegraded":"2023-12-16T01:53:33.054078+0000","last_fullsized":"2023-12-16T01:53:33.054078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.041450+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:53:33.041450+0000","last_peered":"2023-12-16T01:53:33.041450+0000","last_clean":"2023-12-16T01:53:33.041450+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:53:33.041450+0000","last_undegraded":"2023-12-16T01:53:33.041450+0000","last_fullsized":"2023-12-16T01:53:33.041450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.007767+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:53:33.007767+0000","last_peered":"2023-12-16T01:53:33.007767+0000","last_clean":"2023-12-16T01:53:33.007767+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:53:33.007767+0000","last_undegraded":"2023-12-16T01:53:33.007767+0000","last_fullsized":"2023-12-16T01:53:33.007767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051311+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:53:33.051311+0000","last_peered":"2023-12-16T01:53:33.051311+0000","last_clean":"2023-12-16T01:53:33.051311+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:33.051311+0000","last_undegraded":"2023-12-16T01:53:33.051311+0000","last_fullsized":"2023-12-16T01:53:33.051311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013429+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:53:33.013429+0000","last_peered":"2023-12-16T01:53:33.013429+0000","last_clean":"2023-12-16T01:53:33.013429+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:33.013429+0000","last_undegraded":"2023-12-16T01:53:33.013429+0000","last_fullsized":"2023-12-16T01:53:33.013429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.047865+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:53:33.047865+0000","last_peered":"2023-12-16T01:53:33.047865+0000","last_clean":"2023-12-16T01:53:33.047865+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:33.047865+0000","last_undegraded":"2023-12-16T01:53:33.047865+0000","last_fullsized":"2023-12-16T01:53:33.047865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.046823+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:53:33.046823+0000","last_peered":"2023-12-16T01:53:33.046823+0000","last_clean":"2023-12-16T01:53:33.046823+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:53:33.046823+0000","last_undegraded":"2023-12-16T01:53:33.046823+0000","last_fullsized":"2023-12-16T01:53:33.046823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051513+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:53:33.051513+0000","last_peered":"2023-12-16T01:53:33.051513+0000","last_clean":"2023-12-16T01:53:33.051513+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:33.051513+0000","last_undegraded":"2023-12-16T01:53:33.051513+0000","last_fullsized":"2023-12-16T01:53:33.051513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8651,"ondisk_log_size":8651,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542484,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249767,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.41099999999999998},"min":{"1min":0.34899999999999998,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42399999999999999,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.64800000000000002},"last":0.376},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.435,"15min":0.437},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.72799999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.65800000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.66300000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.28899999999999998},"max":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.66400000000000003},"last":0.437}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.224},"max":{"1min":0.501,"5min":0.61799999999999999,"15min":0.69699999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.34499999999999997}]},{"osd":5,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.60299999999999998,"5min":0.627,"15min":0.67900000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.503,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.503}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.315,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.66700000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":0.77700000000000002},"last":0.41299999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542482,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.214,"15min":0.214},"max":{"1min":0.59099999999999997,"5min":0.624,"15min":0.71599999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.26000000000000001,"15min":0.23899999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.69699999999999995},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.36599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58899999999999997,"5min":0.627,"15min":0.86599999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.442,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.81599999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.442,"15min":0.432},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.78200000000000003},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.33400000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.92300000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46700000000000003,"15min":0.46200000000000002},"min":{"1min":0.38,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.63600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.49299999999999999,"5min":0.65000000000000002,"15min":0.82299999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.378}]},{"osd":5,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41399999999999998,"15min":0.42699999999999999},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.67200000000000004,"15min":0.89700000000000002},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.443},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.502}]}]},{"osd":5,"up_from":14,"seq":60129542483,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.439},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.438,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.78700000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.26000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.505},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.71699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":0.54300000000000004,"5min":0.56499999999999995,"15min":0.67400000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.70799999999999996},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.69799999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.36099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.625,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66300000000000003},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.68100000000000005},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.434,"15min":0.42699999999999999},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.443,"15min":0.442},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.40000000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.42399999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":0.628,"15min":0.68300000000000005},"last":0.436},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.252},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.72099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60499999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.53900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542483,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.28699999999999998},"min":{"1min":0.22,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29999999999999999},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.23200000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.312,"15min":0.30499999999999999},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.45200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.52400000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.497,"5min":0.51300000000000001,"15min":0.63400000000000001},"last":0.27500000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.38},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.69799999999999995,"15min":0.79300000000000004},"last":0.438}]},{"osd":5,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.64700000000000002},"last":0.45100000000000001}]},{"osd":6,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.55900000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.37},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.314},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.70099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.40799999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542483,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.28499999999999998,"15min":0.29299999999999998},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.60499999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.54600000000000004},"last":0.29699999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.31,"15min":0.318},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.438,"5min":0.48199999999999998,"15min":0.56599999999999995},"last":0.34200000000000003}]},{"osd":3,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.314,"15min":0.317},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.437,"5min":0.503,"15min":0.55000000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.67800000000000005},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.438},"min":{"1min":0.38,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.59199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58699999999999997,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.60699999999999998,"15min":0.67900000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.82899999999999996},"last":0.46899999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.56799999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.74299999999999999},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.76000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71099999999999997},"last":0.42299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542483,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.314,"15min":0.29899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.31}]},{"osd":2,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30399999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.33400000000000002},"min":{"1min":0.23200000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.23799999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.20200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.38},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.51500000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.77700000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.498}]},{"osd":6,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.76200000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.627,"5min":0.747,"15min":0.96699999999999997},"last":0.46500000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.74099999999999999,"15min":0.80700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.748,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542483,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417287,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.216,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.23499999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54900000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28999999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.251},{"interface":"front","average":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.67700000000000005},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.70399999999999996,"15min":0.753},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.73099999999999998},"last":0.53000000000000003}]},{"osd":7,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:53:39.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:53:39.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.810+0000 7ff57420e640 1 Processor -- start 2023-12-16T01:53:39.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.810+0000 7ff57420e640 1 -- start start 2023-12-16T01:53:39.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.811+0000 7ff57420e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff56c153be0 0x7ff56c159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.811+0000 7ff57420e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c1641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.811+0000 7ff57420e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c153fc0 con 0x7ff56c06fa00 2023-12-16T01:53:39.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.811+0000 7ff57420e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0c3340 con 0x7ff56c153be0 2023-12-16T01:53:39.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.811+0000 7ff57420e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c06b7b0 con 0x7ff56c0c5e60 2023-12-16T01:53:39.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.812+0000 7ff5727ab640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c1641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.812+0000 7ff5717a9640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff56c06fa00 0x7ff56c0c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:51326/0 (socket says 172.21.15.107:51326) 2023-12-16T01:53:39.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.812+0000 7ff5717a9640 1 -- 172.21.15.107:0/463886814 learned_addr learned my addr 172.21.15.107:0/463886814 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:39.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.814+0000 7ff570fa8640 1 -- 172.21.15.107:0/463886814 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080753234 0 0) 0x7ff56c153fc0 con 0x7ff56c06fa00 2023-12-16T01:53:39.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.814+0000 7ff570fa8640 1 -- 172.21.15.107:0/463886814 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003520 con 0x7ff56c06fa00 2023-12-16T01:53:39.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.815+0000 7ff571faa640 1 --2- 172.21.15.107:0/463886814 >> v2:172.21.15.107:3300/0 conn(0x7ff56c153be0 0x7ff56c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.815+0000 7ff5727ab640 1 -- 172.21.15.107:0/463886814 >> v2:172.21.15.107:3300/0 conn(0x7ff56c153be0 msgr2=0x7ff56c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:39.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.815+0000 7ff5727ab640 1 --2- 172.21.15.107:0/463886814 >> v2:172.21.15.107:3300/0 conn(0x7ff56c153be0 0x7ff56c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.815+0000 7ff5727ab640 1 -- 172.21.15.107:0/463886814 >> v1:172.21.15.157:6789/0 conn(0x7ff56c06fa00 legacy=0x7ff56c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.815+0000 7ff5727ab640 1 -- 172.21.15.107:0/463886814 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c06ba90 con 0x7ff56c0c5e60 2023-12-16T01:53:39.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.815+0000 7ff571faa640 1 --2- 172.21.15.107:0/463886814 >> v2:172.21.15.107:3300/0 conn(0x7ff56c153be0 0x7ff56c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T01:53:39.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.818+0000 7ff5727ab640 1 --2- 172.21.15.107:0/463886814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c1641b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff5640097a0 tx=0x7ff56402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bf1a411baf32a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:39.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.822+0000 7ff570fa8640 1 -- 172.21.15.107:0/463886814 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564031830 con 0x7ff56c0c5e60 2023-12-16T01:53:39.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.822+0000 7ff570fa8640 1 -- 172.21.15.107:0/463886814 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564031990 con 0x7ff56c0c5e60 2023-12-16T01:53:39.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.822+0000 7ff570fa8640 1 -- 172.21.15.107:0/463886814 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564031d20 con 0x7ff56c0c5e60 2023-12-16T01:53:39.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 -- 172.21.15.107:0/463886814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 msgr2=0x7ff56c1641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 --2- 172.21.15.107:0/463886814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c1641b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff5640097a0 tx=0x7ff56402b8d0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 -- 172.21.15.107:0/463886814 shutdown_connections 2023-12-16T01:53:39.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 --2- 172.21.15.107:0/463886814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c1641b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 --2- 172.21.15.107:0/463886814 >> v2:172.21.15.107:3300/0 conn(0x7ff56c153be0 0x7ff56c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 -- 172.21.15.107:0/463886814 >> 172.21.15.107:0/463886814 conn(0x7ff56c0c7f60 msgr2=0x7ff56c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:39.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 -- 172.21.15.107:0/463886814 shutdown_connections 2023-12-16T01:53:39.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.823+0000 7ff57420e640 1 -- 172.21.15.107:0/463886814 wait complete. 2023-12-16T01:53:39.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.824+0000 7ff57420e640 1 Processor -- start 2023-12-16T01:53:39.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.824+0000 7ff57420e640 1 -- start start 2023-12-16T01:53:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff57420e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff56c06fa00 0x7ff56c1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff57420e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff57420e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 0x7ff56c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff57420e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c147810 con 0x7ff56c153be0 2023-12-16T01:53:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff57420e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c14f800 con 0x7ff56c06fa00 2023-12-16T01:53:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff57420e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1f2f50 con 0x7ff56c0c5e60 2023-12-16T01:53:39.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff5727ab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 0x7ff56c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff5727ab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 0x7ff56c157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51882/0 (socket says 172.21.15.107:51882) 2023-12-16T01:53:39.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff5727ab640 1 -- 172.21.15.107:0/1619309089 learned_addr learned my addr 172.21.15.107:0/1619309089 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:39.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff571faa640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff56c06fa00 0x7ff56c1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.825+0000 7ff5717a9640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:39.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.828+0000 7ff5727ab640 1 -- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 msgr2=0x7ff56c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.828+0000 7ff5727ab640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.828+0000 7ff5727ab640 1 -- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff56c06fa00 msgr2=0x7ff56c1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:39.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.828+0000 7ff5727ab640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff56c06fa00 0x7ff56c1472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:39.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.828+0000 7ff5727ab640 1 -- 172.21.15.107:0/1619309089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009400 con 0x7ff56c153be0 2023-12-16T01:53:39.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.831+0000 7ff5727ab640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 0x7ff56c157760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098c0 tx=0x7ff5640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:39.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.834+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56403a630 con 0x7ff56c153be0 2023-12-16T01:53:39.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.834+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56403a790 con 0x7ff56c153be0 2023-12-16T01:53:39.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.834+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56403ab40 con 0x7ff56c153be0 2023-12-16T01:53:39.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.834+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c1f3210 con 0x7ff56c153be0 2023-12-16T01:53:39.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.834+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c1f37d0 con 0x7ff56c153be0 2023-12-16T01:53:39.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:39.835+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c1ef9e0 con 0x7ff56c153be0 2023-12-16T01:53:40.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.078+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff56403aca0 con 0x7ff56c153be0 2023-12-16T01:53:40.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.078+0000 7ff5627fc640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff55006ae90 0x7ff55006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.079+0000 7ff571faa640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff55006ae90 0x7ff55006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.079+0000 7ff571faa640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff55006ae90 0x7ff55006d350 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff568003b80 tx=0x7ff568009890 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:40.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.091+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff56407a220 con 0x7ff56c153be0 2023-12-16T01:53:40.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.092+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff564076560 con 0x7ff56c153be0 2023-12-16T01:53:40.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.267+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff56c071c80 con 0x7ff55006ae90 2023-12-16T01:53:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.275+0000 7ff5627fc640 1 -- 172.21.15.107:0/1619309089 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370983 (secure 0 0 0) 0x7ff56c071c80 con 0x7ff55006ae90 2023-12-16T01:53:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:40.283 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff55006ae90 msgr2=0x7ff55006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff55006ae90 0x7ff55006d350 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff568003b80 tx=0x7ff568009890 comp rx=0 tx=0).stop 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 msgr2=0x7ff56c157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 0x7ff56c157760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098c0 tx=0x7ff5640046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 shutdown_connections 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff56c153be0 0x7ff56c157760 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff56c0c5e60 0x7ff56c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff55006ae90 0x7ff55006d350 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 --2- 172.21.15.107:0/1619309089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff56c06fa00 0x7ff56c1472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 >> 172.21.15.107:0/1619309089 conn(0x7ff56c0c7f60 msgr2=0x7ff56c071570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:40.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 shutdown_connections 2023-12-16T01:53:40.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.279+0000 7ff57420e640 1 -- 172.21.15.107:0/1619309089 wait complete. 2023-12-16T01:53:40.292 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-12-16T01:53:40.088954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15784,"ondisk_log_size":15784,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":68410,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":32,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002607"},"pg_stats":[{"pgid":"2.1f","version":"28'621","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.736627+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:53:19.736627+0000","last_peered":"2023-12-16T01:53:19.736627+0000","last_clean":"2023-12-16T01:53:19.736627+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:19.736627+0000","last_undegraded":"2023-12-16T01:53:19.736627+0000","last_fullsized":"2023-12-16T01:53:19.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052203+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:53:33.052203+0000","last_peered":"2023-12-16T01:53:33.052203+0000","last_clean":"2023-12-16T01:53:33.052203+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:53:33.052203+0000","last_undegraded":"2023-12-16T01:53:33.052203+0000","last_fullsized":"2023-12-16T01:53:33.052203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546299+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:53:04.546299+0000","last_peered":"2023-12-16T01:53:04.546299+0000","last_clean":"2023-12-16T01:53:04.546299+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:53:04.546299+0000","last_undegraded":"2023-12-16T01:53:04.546299+0000","last_fullsized":"2023-12-16T01:53:04.546299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'727","reported_seq":758,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642747+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:53:13.642747+0000","last_peered":"2023-12-16T01:53:13.642747+0000","last_clean":"2023-12-16T01:53:13.642747+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:53:13.642747+0000","last_undegraded":"2023-12-16T01:53:13.642747+0000","last_fullsized":"2023-12-16T01:53:13.642747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052578+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:53:33.052578+0000","last_peered":"2023-12-16T01:53:33.052578+0000","last_clean":"2023-12-16T01:53:33.052578+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:33.052578+0000","last_undegraded":"2023-12-16T01:53:33.052578+0000","last_fullsized":"2023-12-16T01:53:33.052578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.950355+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:52:58.950355+0000","last_peered":"2023-12-16T01:52:58.950355+0000","last_clean":"2023-12-16T01:52:58.950355+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:52:58.950355+0000","last_undegraded":"2023-12-16T01:52:58.950355+0000","last_fullsized":"2023-12-16T01:52:58.950355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1394","reported_seq":1423,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.861096+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:53:25.861096+0000","last_peered":"2023-12-16T01:53:25.861096+0000","last_clean":"2023-12-16T01:53:25.861096+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:25.861096+0000","last_undegraded":"2023-12-16T01:53:25.861096+0000","last_fullsized":"2023-12-16T01:53:25.861096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1394,"log_dups_size":0,"ondisk_log_size":1394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089082+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:53:33.089082+0000","last_peered":"2023-12-16T01:53:33.089082+0000","last_clean":"2023-12-16T01:53:33.089082+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:33.089082+0000","last_undegraded":"2023-12-16T01:53:33.089082+0000","last_fullsized":"2023-12-16T01:53:33.089082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.523291+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:53:05.523291+0000","last_peered":"2023-12-16T01:53:05.523291+0000","last_clean":"2023-12-16T01:53:05.523291+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:53:05.523291+0000","last_undegraded":"2023-12-16T01:53:05.523291+0000","last_fullsized":"2023-12-16T01:53:05.523291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:18.987587+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:53:18.987587+0000","last_peered":"2023-12-16T01:53:18.987587+0000","last_clean":"2023-12-16T01:53:18.987587+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:53:18.987587+0000","last_undegraded":"2023-12-16T01:53:18.987587+0000","last_fullsized":"2023-12-16T01:53:18.987587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003080+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003080+0000","last_peered":"2023-12-16T01:53:33.003080+0000","last_clean":"2023-12-16T01:53:33.003080+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003080+0000","last_undegraded":"2023-12-16T01:53:33.003080+0000","last_fullsized":"2023-12-16T01:53:33.003080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:29:57.092568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.513556+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:53:05.513556+0000","last_peered":"2023-12-16T01:53:05.513556+0000","last_clean":"2023-12-16T01:53:05.513556+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:53:05.513556+0000","last_undegraded":"2023-12-16T01:53:05.513556+0000","last_fullsized":"2023-12-16T01:53:05.513556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.011587+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:53:33.011587+0000","last_peered":"2023-12-16T01:53:33.011587+0000","last_clean":"2023-12-16T01:53:33.011587+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:53:33.011587+0000","last_undegraded":"2023-12-16T01:53:33.011587+0000","last_fullsized":"2023-12-16T01:53:33.011587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'637","reported_seq":667,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:21.784478+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:53:21.784478+0000","last_peered":"2023-12-16T01:53:21.784478+0000","last_clean":"2023-12-16T01:53:21.784478+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:53:21.784478+0000","last_undegraded":"2023-12-16T01:53:21.784478+0000","last_fullsized":"2023-12-16T01:53:21.784478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503323+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503323+0000","last_peered":"2023-12-16T01:53:05.503323+0000","last_clean":"2023-12-16T01:53:05.503323+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503323+0000","last_undegraded":"2023-12-16T01:53:05.503323+0000","last_fullsized":"2023-12-16T01:53:05.503323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.970424+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:53:32.970424+0000","last_peered":"2023-12-16T01:53:32.970424+0000","last_clean":"2023-12-16T01:53:32.970424+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:53:32.970424+0000","last_undegraded":"2023-12-16T01:53:32.970424+0000","last_fullsized":"2023-12-16T01:53:32.970424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642954+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:53:13.642954+0000","last_peered":"2023-12-16T01:53:13.642954+0000","last_clean":"2023-12-16T01:53:13.642954+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:53:13.642954+0000","last_undegraded":"2023-12-16T01:53:13.642954+0000","last_fullsized":"2023-12-16T01:53:13.642954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546380+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:53:04.546380+0000","last_peered":"2023-12-16T01:53:04.546380+0000","last_clean":"2023-12-16T01:53:04.546380+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:53:04.546380+0000","last_undegraded":"2023-12-16T01:53:04.546380+0000","last_fullsized":"2023-12-16T01:53:04.546380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089208+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:53:33.089208+0000","last_peered":"2023-12-16T01:53:33.089208+0000","last_clean":"2023-12-16T01:53:33.089208+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:53:33.089208+0000","last_undegraded":"2023-12-16T01:53:33.089208+0000","last_fullsized":"2023-12-16T01:53:33.089208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:39.770859+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:49:39.770859+0000","last_peered":"2023-12-16T01:49:39.770859+0000","last_clean":"2023-12-16T01:49:39.770859+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:49:39.770859+0000","last_undegraded":"2023-12-16T01:49:39.770859+0000","last_fullsized":"2023-12-16T01:49:39.770859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.402834+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:53:03.402834+0000","last_peered":"2023-12-16T01:53:03.402834+0000","last_clean":"2023-12-16T01:53:03.402834+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:53:03.402834+0000","last_undegraded":"2023-12-16T01:53:03.402834+0000","last_fullsized":"2023-12-16T01:53:03.402834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.576104+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:53:02.576104+0000","last_peered":"2023-12-16T01:53:02.576104+0000","last_clean":"2023-12-16T01:53:02.576104+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:02.576104+0000","last_undegraded":"2023-12-16T01:53:02.576104+0000","last_fullsized":"2023-12-16T01:53:02.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746058+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:53:20.746058+0000","last_peered":"2023-12-16T01:53:20.746058+0000","last_clean":"2023-12-16T01:53:20.746058+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:20.746058+0000","last_undegraded":"2023-12-16T01:53:20.746058+0000","last_fullsized":"2023-12-16T01:53:20.746058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":150,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.511655+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:53:05.511655+0000","last_peered":"2023-12-16T01:53:05.511655+0000","last_clean":"2023-12-16T01:53:05.511655+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:53:05.511655+0000","last_undegraded":"2023-12-16T01:53:05.511655+0000","last_fullsized":"2023-12-16T01:53:05.511655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089117+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:53:33.089117+0000","last_peered":"2023-12-16T01:53:33.089117+0000","last_clean":"2023-12-16T01:53:33.089117+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:53:33.089117+0000","last_undegraded":"2023-12-16T01:53:33.089117+0000","last_fullsized":"2023-12-16T01:53:33.089117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'11","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.858325+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:53:25.858325+0000","last_peered":"2023-12-16T01:53:25.858325+0000","last_clean":"2023-12-16T01:53:25.858325+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:53:25.858325+0000","last_undegraded":"2023-12-16T01:53:25.858325+0000","last_fullsized":"2023-12-16T01:53:25.858325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.894062+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:53:03.894062+0000","last_peered":"2023-12-16T01:53:03.894062+0000","last_clean":"2023-12-16T01:53:03.894062+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:53:03.894062+0000","last_undegraded":"2023-12-16T01:53:03.894062+0000","last_fullsized":"2023-12-16T01:53:03.894062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089363+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:53:33.089363+0000","last_peered":"2023-12-16T01:53:33.089363+0000","last_clean":"2023-12-16T01:53:33.089363+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:53:33.089363+0000","last_undegraded":"2023-12-16T01:53:33.089363+0000","last_fullsized":"2023-12-16T01:53:33.089363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'310","reported_seq":341,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:29.053543+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:53:29.053543+0000","last_peered":"2023-12-16T01:53:29.053543+0000","last_clean":"2023-12-16T01:53:29.053543+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:53:29.053543+0000","last_undegraded":"2023-12-16T01:53:29.053543+0000","last_fullsized":"2023-12-16T01:53:29.053543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.545783+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:53:04.545783+0000","last_peered":"2023-12-16T01:53:04.545783+0000","last_clean":"2023-12-16T01:53:04.545783+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:53:04.545783+0000","last_undegraded":"2023-12-16T01:53:04.545783+0000","last_fullsized":"2023-12-16T01:53:04.545783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.984623+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:53:32.984623+0000","last_peered":"2023-12-16T01:53:32.984623+0000","last_clean":"2023-12-16T01:53:32.984623+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:53:32.984623+0000","last_undegraded":"2023-12-16T01:53:32.984623+0000","last_fullsized":"2023-12-16T01:53:32.984623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:16.660057+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:53:16.660057+0000","last_peered":"2023-12-16T01:53:16.660057+0000","last_clean":"2023-12-16T01:53:16.660057+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:53:16.660057+0000","last_undegraded":"2023-12-16T01:53:16.660057+0000","last_fullsized":"2023-12-16T01:53:16.660057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.562047+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:53:04.562047+0000","last_peered":"2023-12-16T01:53:04.562047+0000","last_clean":"2023-12-16T01:53:04.562047+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:53:04.562047+0000","last_undegraded":"2023-12-16T01:53:04.562047+0000","last_fullsized":"2023-12-16T01:53:04.562047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013234+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:53:33.013234+0000","last_peered":"2023-12-16T01:53:33.013234+0000","last_clean":"2023-12-16T01:53:33.013234+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:33.013234+0000","last_undegraded":"2023-12-16T01:53:33.013234+0000","last_fullsized":"2023-12-16T01:53:33.013234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:09.553576+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:53:09.553576+0000","last_peered":"2023-12-16T01:53:09.553576+0000","last_clean":"2023-12-16T01:53:09.553576+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:09.553576+0000","last_undegraded":"2023-12-16T01:53:09.553576+0000","last_fullsized":"2023-12-16T01:53:09.553576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:59.749941+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:52:59.749941+0000","last_peered":"2023-12-16T01:52:59.749941+0000","last_clean":"2023-12-16T01:52:59.749941+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:52:59.749941+0000","last_undegraded":"2023-12-16T01:52:59.749941+0000","last_fullsized":"2023-12-16T01:52:59.749941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.043561+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:53:33.043561+0000","last_peered":"2023-12-16T01:53:33.043561+0000","last_clean":"2023-12-16T01:53:33.043561+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:53:33.043561+0000","last_undegraded":"2023-12-16T01:53:33.043561+0000","last_fullsized":"2023-12-16T01:53:33.043561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.733213+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:53:19.733213+0000","last_peered":"2023-12-16T01:53:19.733213+0000","last_clean":"2023-12-16T01:53:19.733213+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:53:19.733213+0000","last_undegraded":"2023-12-16T01:53:19.733213+0000","last_fullsized":"2023-12-16T01:53:19.733213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.525881+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:53:05.525881+0000","last_peered":"2023-12-16T01:53:05.525881+0000","last_clean":"2023-12-16T01:53:05.525881+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:53:05.525881+0000","last_undegraded":"2023-12-16T01:53:05.525881+0000","last_fullsized":"2023-12-16T01:53:05.525881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048436+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:53:33.048436+0000","last_peered":"2023-12-16T01:53:33.048436+0000","last_clean":"2023-12-16T01:53:33.048436+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:53:33.048436+0000","last_undegraded":"2023-12-16T01:53:33.048436+0000","last_fullsized":"2023-12-16T01:53:33.048436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:30.852212+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:53:30.852212+0000","last_peered":"2023-12-16T01:53:30.852212+0000","last_clean":"2023-12-16T01:53:30.852212+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:30.852212+0000","last_undegraded":"2023-12-16T01:53:30.852212+0000","last_fullsized":"2023-12-16T01:53:30.852212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394771+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:53:03.394771+0000","last_peered":"2023-12-16T01:53:03.394771+0000","last_clean":"2023-12-16T01:53:03.394771+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:53:03.394771+0000","last_undegraded":"2023-12-16T01:53:03.394771+0000","last_fullsized":"2023-12-16T01:53:03.394771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985745+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:53:32.985745+0000","last_peered":"2023-12-16T01:53:32.985745+0000","last_clean":"2023-12-16T01:53:32.985745+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:53:32.985745+0000","last_undegraded":"2023-12-16T01:53:32.985745+0000","last_fullsized":"2023-12-16T01:53:32.985745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'555","reported_seq":586,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859131+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:53:25.859131+0000","last_peered":"2023-12-16T01:53:25.859131+0000","last_clean":"2023-12-16T01:53:25.859131+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:53:25.859131+0000","last_undegraded":"2023-12-16T01:53:25.859131+0000","last_fullsized":"2023-12-16T01:53:25.859131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.498426+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:53:05.498426+0000","last_peered":"2023-12-16T01:53:05.498426+0000","last_clean":"2023-12-16T01:53:05.498426+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:53:05.498426+0000","last_undegraded":"2023-12-16T01:53:05.498426+0000","last_fullsized":"2023-12-16T01:53:05.498426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092052+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:53:33.092052+0000","last_peered":"2023-12-16T01:53:33.092052+0000","last_clean":"2023-12-16T01:53:33.092052+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:53:33.092052+0000","last_undegraded":"2023-12-16T01:53:33.092052+0000","last_fullsized":"2023-12-16T01:53:33.092052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.958970+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:52:53.958970+0000","last_peered":"2023-12-16T01:52:53.958970+0000","last_clean":"2023-12-16T01:52:53.958970+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:52:53.958970+0000","last_undegraded":"2023-12-16T01:52:53.958970+0000","last_fullsized":"2023-12-16T01:52:53.958970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:43.837180+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:49:43.837180+0000","last_peered":"2023-12-16T01:49:43.837180+0000","last_clean":"2023-12-16T01:49:43.837180+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:49:43.837180+0000","last_undegraded":"2023-12-16T01:49:43.837180+0000","last_fullsized":"2023-12-16T01:49:43.837180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394625+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:53:03.394625+0000","last_peered":"2023-12-16T01:53:03.394625+0000","last_clean":"2023-12-16T01:53:03.394625+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:53:03.394625+0000","last_undegraded":"2023-12-16T01:53:03.394625+0000","last_fullsized":"2023-12-16T01:53:03.394625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003140+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:53:33.003140+0000","last_peered":"2023-12-16T01:53:33.003140+0000","last_clean":"2023-12-16T01:53:33.003140+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:33.003140+0000","last_undegraded":"2023-12-16T01:53:33.003140+0000","last_fullsized":"2023-12-16T01:53:33.003140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.701145+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:53:17.701145+0000","last_peered":"2023-12-16T01:53:17.701145+0000","last_clean":"2023-12-16T01:53:17.701145+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:17.701145+0000","last_undegraded":"2023-12-16T01:53:17.701145+0000","last_fullsized":"2023-12-16T01:53:17.701145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.614282+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:53:02.614282+0000","last_peered":"2023-12-16T01:53:02.614282+0000","last_clean":"2023-12-16T01:53:02.614282+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:53:02.614282+0000","last_undegraded":"2023-12-16T01:53:02.614282+0000","last_fullsized":"2023-12-16T01:53:02.614282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051127+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:53:33.051127+0000","last_peered":"2023-12-16T01:53:33.051127+0000","last_clean":"2023-12-16T01:53:33.051127+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:53:33.051127+0000","last_undegraded":"2023-12-16T01:53:33.051127+0000","last_fullsized":"2023-12-16T01:53:33.051127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.702497+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:53:17.702497+0000","last_peered":"2023-12-16T01:53:17.702497+0000","last_clean":"2023-12-16T01:53:17.702497+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:17.702497+0000","last_undegraded":"2023-12-16T01:53:17.702497+0000","last_fullsized":"2023-12-16T01:53:17.702497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399892+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:53:03.399892+0000","last_peered":"2023-12-16T01:53:03.399892+0000","last_clean":"2023-12-16T01:53:03.399892+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:53:03.399892+0000","last_undegraded":"2023-12-16T01:53:03.399892+0000","last_fullsized":"2023-12-16T01:53:03.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075246+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:53:33.075246+0000","last_peered":"2023-12-16T01:53:33.075246+0000","last_clean":"2023-12-16T01:53:33.075246+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:53:33.075246+0000","last_undegraded":"2023-12-16T01:53:33.075246+0000","last_fullsized":"2023-12-16T01:53:33.075246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735726+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:53:19.735726+0000","last_peered":"2023-12-16T01:53:19.735726+0000","last_clean":"2023-12-16T01:53:19.735726+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:53:19.735726+0000","last_undegraded":"2023-12-16T01:53:19.735726+0000","last_fullsized":"2023-12-16T01:53:19.735726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.758398+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:53:01.758398+0000","last_peered":"2023-12-16T01:53:01.758398+0000","last_clean":"2023-12-16T01:53:01.758398+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:53:01.758398+0000","last_undegraded":"2023-12-16T01:53:01.758398+0000","last_fullsized":"2023-12-16T01:53:01.758398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002598+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:53:33.002598+0000","last_peered":"2023-12-16T01:53:33.002598+0000","last_clean":"2023-12-16T01:53:33.002598+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:33.002598+0000","last_undegraded":"2023-12-16T01:53:33.002598+0000","last_fullsized":"2023-12-16T01:53:33.002598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.984895+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:52:53.984895+0000","last_peered":"2023-12-16T01:52:53.984895+0000","last_clean":"2023-12-16T01:52:53.984895+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:52:53.984895+0000","last_undegraded":"2023-12-16T01:52:53.984895+0000","last_fullsized":"2023-12-16T01:52:53.984895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.588615+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:53:02.588615+0000","last_peered":"2023-12-16T01:53:02.588615+0000","last_clean":"2023-12-16T01:53:02.588615+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:53:02.588615+0000","last_undegraded":"2023-12-16T01:53:02.588615+0000","last_fullsized":"2023-12-16T01:53:02.588615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.998352+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:53:32.998352+0000","last_peered":"2023-12-16T01:53:32.998352+0000","last_clean":"2023-12-16T01:53:32.998352+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:32.998352+0000","last_undegraded":"2023-12-16T01:53:32.998352+0000","last_fullsized":"2023-12-16T01:53:32.998352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:51:29.781913+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:51:29.781913+0000","last_peered":"2023-12-16T01:51:29.781913+0000","last_clean":"2023-12-16T01:51:29.781913+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:51:29.781913+0000","last_undegraded":"2023-12-16T01:51:29.781913+0000","last_fullsized":"2023-12-16T01:51:29.781913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394238+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:53:03.394238+0000","last_peered":"2023-12-16T01:53:03.394238+0000","last_clean":"2023-12-16T01:53:03.394238+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:53:03.394238+0000","last_undegraded":"2023-12-16T01:53:03.394238+0000","last_fullsized":"2023-12-16T01:53:03.394238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.082967+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:53:33.082967+0000","last_peered":"2023-12-16T01:53:33.082967+0000","last_clean":"2023-12-16T01:53:33.082967+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:33.082967+0000","last_undegraded":"2023-12-16T01:53:33.082967+0000","last_fullsized":"2023-12-16T01:53:33.082967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.781615+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:53:22.781615+0000","last_peered":"2023-12-16T01:53:22.781615+0000","last_clean":"2023-12-16T01:53:22.781615+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:53:22.781615+0000","last_undegraded":"2023-12-16T01:53:22.781615+0000","last_fullsized":"2023-12-16T01:53:22.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.024631+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:52:58.024631+0000","last_peered":"2023-12-16T01:52:58.024631+0000","last_clean":"2023-12-16T01:52:58.024631+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:52:58.024631+0000","last_undegraded":"2023-12-16T01:52:58.024631+0000","last_fullsized":"2023-12-16T01:52:58.024631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.005175+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:53:33.005175+0000","last_peered":"2023-12-16T01:53:33.005175+0000","last_clean":"2023-12-16T01:53:33.005175+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:53:33.005175+0000","last_undegraded":"2023-12-16T01:53:33.005175+0000","last_fullsized":"2023-12-16T01:53:33.005175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859130+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:53:25.859130+0000","last_peered":"2023-12-16T01:53:25.859130+0000","last_clean":"2023-12-16T01:53:25.859130+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:53:25.859130+0000","last_undegraded":"2023-12-16T01:53:25.859130+0000","last_fullsized":"2023-12-16T01:53:25.859130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":146,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.755626+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:53:01.755626+0000","last_peered":"2023-12-16T01:53:01.755626+0000","last_clean":"2023-12-16T01:53:01.755626+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:53:01.755626+0000","last_undegraded":"2023-12-16T01:53:01.755626+0000","last_fullsized":"2023-12-16T01:53:01.755626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.991774+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:53:32.991774+0000","last_peered":"2023-12-16T01:53:32.991774+0000","last_clean":"2023-12-16T01:53:32.991774+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:53:32.991774+0000","last_undegraded":"2023-12-16T01:53:32.991774+0000","last_fullsized":"2023-12-16T01:53:32.991774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'303","reported_seq":333,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.800001+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:53:32.800001+0000","last_peered":"2023-12-16T01:53:32.800001+0000","last_clean":"2023-12-16T01:53:32.800001+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:32.800001+0000","last_undegraded":"2023-12-16T01:53:32.800001+0000","last_fullsized":"2023-12-16T01:53:32.800001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:00.568175+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:00.568175+0000","last_peered":"2023-12-16T01:53:00.568175+0000","last_clean":"2023-12-16T01:53:00.568175+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:00.568175+0000","last_undegraded":"2023-12-16T01:53:00.568175+0000","last_fullsized":"2023-12-16T01:53:00.568175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051233+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:53:33.051233+0000","last_peered":"2023-12-16T01:53:33.051233+0000","last_clean":"2023-12-16T01:53:33.051233+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:33.051233+0000","last_undegraded":"2023-12-16T01:53:33.051233+0000","last_fullsized":"2023-12-16T01:53:33.051233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'859","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.771475+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:53:22.771475+0000","last_peered":"2023-12-16T01:53:22.771475+0000","last_clean":"2023-12-16T01:53:22.771475+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:22.771475+0000","last_undegraded":"2023-12-16T01:53:22.771475+0000","last_fullsized":"2023-12-16T01:53:22.771475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546516+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:53:04.546516+0000","last_peered":"2023-12-16T01:53:04.546516+0000","last_clean":"2023-12-16T01:53:04.546516+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:53:04.546516+0000","last_undegraded":"2023-12-16T01:53:04.546516+0000","last_fullsized":"2023-12-16T01:53:04.546516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013492+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:53:33.013492+0000","last_peered":"2023-12-16T01:53:33.013492+0000","last_clean":"2023-12-16T01:53:33.013492+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:33.013492+0000","last_undegraded":"2023-12-16T01:53:33.013492+0000","last_fullsized":"2023-12-16T01:53:33.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'732","reported_seq":762,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:26.858591+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:53:26.858591+0000","last_peered":"2023-12-16T01:53:26.858591+0000","last_clean":"2023-12-16T01:53:26.858591+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:26.858591+0000","last_undegraded":"2023-12-16T01:53:26.858591+0000","last_fullsized":"2023-12-16T01:53:26.858591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.620159+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:53:02.620159+0000","last_peered":"2023-12-16T01:53:02.620159+0000","last_clean":"2023-12-16T01:53:02.620159+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:53:02.620159+0000","last_undegraded":"2023-12-16T01:53:02.620159+0000","last_fullsized":"2023-12-16T01:53:02.620159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051987+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:53:33.051987+0000","last_peered":"2023-12-16T01:53:33.051987+0000","last_clean":"2023-12-16T01:53:33.051987+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:53:33.051987+0000","last_undegraded":"2023-12-16T01:53:33.051987+0000","last_fullsized":"2023-12-16T01:53:33.051987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735578+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:53:19.735578+0000","last_peered":"2023-12-16T01:53:19.735578+0000","last_clean":"2023-12-16T01:53:19.735578+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:19.735578+0000","last_undegraded":"2023-12-16T01:53:19.735578+0000","last_fullsized":"2023-12-16T01:53:19.735578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551096+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:53:04.551096+0000","last_peered":"2023-12-16T01:53:04.551096+0000","last_clean":"2023-12-16T01:53:04.551096+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:53:04.551096+0000","last_undegraded":"2023-12-16T01:53:04.551096+0000","last_fullsized":"2023-12-16T01:53:04.551096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.014454+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:53:33.014454+0000","last_peered":"2023-12-16T01:53:33.014454+0000","last_clean":"2023-12-16T01:53:33.014454+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:53:33.014454+0000","last_undegraded":"2023-12-16T01:53:33.014454+0000","last_fullsized":"2023-12-16T01:53:33.014454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.703191+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:53:17.703191+0000","last_peered":"2023-12-16T01:53:17.703191+0000","last_clean":"2023-12-16T01:53:17.703191+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:17.703191+0000","last_undegraded":"2023-12-16T01:53:17.703191+0000","last_fullsized":"2023-12-16T01:53:17.703191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":188,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546309+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:53:04.546309+0000","last_peered":"2023-12-16T01:53:04.546309+0000","last_clean":"2023-12-16T01:53:04.546309+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:53:04.546309+0000","last_undegraded":"2023-12-16T01:53:04.546309+0000","last_fullsized":"2023-12-16T01:53:04.546309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399829+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:53:03.399829+0000","last_peered":"2023-12-16T01:53:03.399829+0000","last_clean":"2023-12-16T01:53:03.399829+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:53:03.399829+0000","last_undegraded":"2023-12-16T01:53:03.399829+0000","last_fullsized":"2023-12-16T01:53:03.399829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.091709+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:53:33.091709+0000","last_peered":"2023-12-16T01:53:33.091709+0000","last_clean":"2023-12-16T01:53:33.091709+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:53:33.091709+0000","last_undegraded":"2023-12-16T01:53:33.091709+0000","last_fullsized":"2023-12-16T01:53:33.091709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.782204+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:53:22.782204+0000","last_peered":"2023-12-16T01:53:22.782204+0000","last_clean":"2023-12-16T01:53:22.782204+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:53:22.782204+0000","last_undegraded":"2023-12-16T01:53:22.782204+0000","last_fullsized":"2023-12-16T01:53:22.782204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":178,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553813+0000","last_change":"2023-12-16T01:26:31.583645+0000","last_active":"2023-12-16T01:53:04.553813+0000","last_peered":"2023-12-16T01:53:04.553813+0000","last_clean":"2023-12-16T01:53:04.553813+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:53:04.553813+0000","last_undegraded":"2023-12-16T01:53:04.553813+0000","last_fullsized":"2023-12-16T01:53:04.553813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:33:04.088136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.050878+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:53:33.050878+0000","last_peered":"2023-12-16T01:53:33.050878+0000","last_clean":"2023-12-16T01:53:33.050878+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:33.050878+0000","last_undegraded":"2023-12-16T01:53:33.050878+0000","last_fullsized":"2023-12-16T01:53:33.050878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.713624+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:53:15.713624+0000","last_peered":"2023-12-16T01:53:15.713624+0000","last_clean":"2023-12-16T01:53:15.713624+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:15.713624+0000","last_undegraded":"2023-12-16T01:53:15.713624+0000","last_fullsized":"2023-12-16T01:53:15.713624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'706","reported_seq":735,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.727664+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:53:15.727664+0000","last_peered":"2023-12-16T01:53:15.727664+0000","last_clean":"2023-12-16T01:53:15.727664+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:53:15.727664+0000","last_undegraded":"2023-12-16T01:53:15.727664+0000","last_fullsized":"2023-12-16T01:53:15.727664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092144+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:53:33.092144+0000","last_peered":"2023-12-16T01:53:33.092144+0000","last_clean":"2023-12-16T01:53:33.092144+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:53:33.092144+0000","last_undegraded":"2023-12-16T01:53:33.092144+0000","last_fullsized":"2023-12-16T01:53:33.092144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.397888+0000","last_change":"2023-12-16T01:26:31.583485+0000","last_active":"2023-12-16T01:53:03.397888+0000","last_peered":"2023-12-16T01:53:03.397888+0000","last_clean":"2023-12-16T01:53:03.397888+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:53:03.397888+0000","last_undegraded":"2023-12-16T01:53:03.397888+0000","last_fullsized":"2023-12-16T01:53:03.397888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:51.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'707","reported_seq":736,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746082+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:53:20.746082+0000","last_peered":"2023-12-16T01:53:20.746082+0000","last_clean":"2023-12-16T01:53:20.746082+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:53:20.746082+0000","last_undegraded":"2023-12-16T01:53:20.746082+0000","last_fullsized":"2023-12-16T01:53:20.746082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088690+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:53:33.088690+0000","last_peered":"2023-12-16T01:53:33.088690+0000","last_clean":"2023-12-16T01:53:33.088690+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:33.088690+0000","last_undegraded":"2023-12-16T01:53:33.088690+0000","last_fullsized":"2023-12-16T01:53:33.088690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.526023+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:53:05.526023+0000","last_peered":"2023-12-16T01:53:05.526023+0000","last_clean":"2023-12-16T01:53:05.526023+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:53:05.526023+0000","last_undegraded":"2023-12-16T01:53:05.526023+0000","last_fullsized":"2023-12-16T01:53:05.526023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013111+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:53:33.013111+0000","last_peered":"2023-12-16T01:53:33.013111+0000","last_clean":"2023-12-16T01:53:33.013111+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:33.013111+0000","last_undegraded":"2023-12-16T01:53:33.013111+0000","last_fullsized":"2023-12-16T01:53:33.013111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.974726+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:53:32.974726+0000","last_peered":"2023-12-16T01:53:32.974726+0000","last_clean":"2023-12-16T01:53:32.974726+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:32.974726+0000","last_undegraded":"2023-12-16T01:53:32.974726+0000","last_fullsized":"2023-12-16T01:53:32.974726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.996419+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:53:32.996419+0000","last_peered":"2023-12-16T01:53:32.996419+0000","last_clean":"2023-12-16T01:53:32.996419+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:53:32.996419+0000","last_undegraded":"2023-12-16T01:53:32.996419+0000","last_fullsized":"2023-12-16T01:53:32.996419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048222+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:53:33.048222+0000","last_peered":"2023-12-16T01:53:33.048222+0000","last_clean":"2023-12-16T01:53:33.048222+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:33.048222+0000","last_undegraded":"2023-12-16T01:53:33.048222+0000","last_fullsized":"2023-12-16T01:53:33.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988764+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:53:32.988764+0000","last_peered":"2023-12-16T01:53:32.988764+0000","last_clean":"2023-12-16T01:53:32.988764+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:53:32.988764+0000","last_undegraded":"2023-12-16T01:53:32.988764+0000","last_fullsized":"2023-12-16T01:53:32.988764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.983477+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:53:32.983477+0000","last_peered":"2023-12-16T01:53:32.983477+0000","last_clean":"2023-12-16T01:53:32.983477+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:53:32.983477+0000","last_undegraded":"2023-12-16T01:53:32.983477+0000","last_fullsized":"2023-12-16T01:53:32.983477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013189+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:53:33.013189+0000","last_peered":"2023-12-16T01:53:33.013189+0000","last_clean":"2023-12-16T01:53:33.013189+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:53:33.013189+0000","last_undegraded":"2023-12-16T01:53:33.013189+0000","last_fullsized":"2023-12-16T01:53:33.013189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052390+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:53:33.052390+0000","last_peered":"2023-12-16T01:53:33.052390+0000","last_clean":"2023-12-16T01:53:33.052390+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:53:33.052390+0000","last_undegraded":"2023-12-16T01:53:33.052390+0000","last_fullsized":"2023-12-16T01:53:33.052390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002679+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:53:33.002679+0000","last_peered":"2023-12-16T01:53:33.002679+0000","last_clean":"2023-12-16T01:53:33.002679+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:53:33.002679+0000","last_undegraded":"2023-12-16T01:53:33.002679+0000","last_fullsized":"2023-12-16T01:53:33.002679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052472+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:53:33.052472+0000","last_peered":"2023-12-16T01:53:33.052472+0000","last_clean":"2023-12-16T01:53:33.052472+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:53:33.052472+0000","last_undegraded":"2023-12-16T01:53:33.052472+0000","last_fullsized":"2023-12-16T01:53:33.052472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089039+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:53:33.089039+0000","last_peered":"2023-12-16T01:53:33.089039+0000","last_clean":"2023-12-16T01:53:33.089039+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:33.089039+0000","last_undegraded":"2023-12-16T01:53:33.089039+0000","last_fullsized":"2023-12-16T01:53:33.089039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.093269+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:53:33.093269+0000","last_peered":"2023-12-16T01:53:33.093269+0000","last_clean":"2023-12-16T01:53:33.093269+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:33.093269+0000","last_undegraded":"2023-12-16T01:53:33.093269+0000","last_fullsized":"2023-12-16T01:53:33.093269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.074698+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:53:33.074698+0000","last_peered":"2023-12-16T01:53:33.074698+0000","last_clean":"2023-12-16T01:53:33.074698+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:53:33.074698+0000","last_undegraded":"2023-12-16T01:53:33.074698+0000","last_fullsized":"2023-12-16T01:53:33.074698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.997000+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:53:32.997000+0000","last_peered":"2023-12-16T01:53:32.997000+0000","last_clean":"2023-12-16T01:53:32.997000+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:53:32.997000+0000","last_undegraded":"2023-12-16T01:53:32.997000+0000","last_fullsized":"2023-12-16T01:53:32.997000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.975471+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:53:32.975471+0000","last_peered":"2023-12-16T01:53:32.975471+0000","last_clean":"2023-12-16T01:53:32.975471+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:32.975471+0000","last_undegraded":"2023-12-16T01:53:32.975471+0000","last_fullsized":"2023-12-16T01:53:32.975471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002376+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:53:33.002376+0000","last_peered":"2023-12-16T01:53:33.002376+0000","last_clean":"2023-12-16T01:53:33.002376+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:33.002376+0000","last_undegraded":"2023-12-16T01:53:33.002376+0000","last_fullsized":"2023-12-16T01:53:33.002376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002747+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:53:33.002747+0000","last_peered":"2023-12-16T01:53:33.002747+0000","last_clean":"2023-12-16T01:53:33.002747+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:53:33.002747+0000","last_undegraded":"2023-12-16T01:53:33.002747+0000","last_fullsized":"2023-12-16T01:53:33.002747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052466+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:53:33.052466+0000","last_peered":"2023-12-16T01:53:33.052466+0000","last_clean":"2023-12-16T01:53:33.052466+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:53:33.052466+0000","last_undegraded":"2023-12-16T01:53:33.052466+0000","last_fullsized":"2023-12-16T01:53:33.052466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985017+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:53:32.985017+0000","last_peered":"2023-12-16T01:53:32.985017+0000","last_clean":"2023-12-16T01:53:32.985017+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:53:32.985017+0000","last_undegraded":"2023-12-16T01:53:32.985017+0000","last_fullsized":"2023-12-16T01:53:32.985017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988929+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:53:32.988929+0000","last_peered":"2023-12-16T01:53:32.988929+0000","last_clean":"2023-12-16T01:53:32.988929+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:53:32.988929+0000","last_undegraded":"2023-12-16T01:53:32.988929+0000","last_fullsized":"2023-12-16T01:53:32.988929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075656+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:53:33.075656+0000","last_peered":"2023-12-16T01:53:33.075656+0000","last_clean":"2023-12-16T01:53:33.075656+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:53:33.075656+0000","last_undegraded":"2023-12-16T01:53:33.075656+0000","last_fullsized":"2023-12-16T01:53:33.075656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.071227+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:53:33.071227+0000","last_peered":"2023-12-16T01:53:33.071227+0000","last_clean":"2023-12-16T01:53:33.071227+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:53:33.071227+0000","last_undegraded":"2023-12-16T01:53:33.071227+0000","last_fullsized":"2023-12-16T01:53:33.071227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075442+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:53:33.075442+0000","last_peered":"2023-12-16T01:53:33.075442+0000","last_clean":"2023-12-16T01:53:33.075442+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:53:33.075442+0000","last_undegraded":"2023-12-16T01:53:33.075442+0000","last_fullsized":"2023-12-16T01:53:33.075442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088834+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:53:33.088834+0000","last_peered":"2023-12-16T01:53:33.088834+0000","last_clean":"2023-12-16T01:53:33.088834+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:53:33.088834+0000","last_undegraded":"2023-12-16T01:53:33.088834+0000","last_fullsized":"2023-12-16T01:53:33.088834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.054078+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:53:33.054078+0000","last_peered":"2023-12-16T01:53:33.054078+0000","last_clean":"2023-12-16T01:53:33.054078+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:53:33.054078+0000","last_undegraded":"2023-12-16T01:53:33.054078+0000","last_fullsized":"2023-12-16T01:53:33.054078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.041450+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:53:33.041450+0000","last_peered":"2023-12-16T01:53:33.041450+0000","last_clean":"2023-12-16T01:53:33.041450+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:53:33.041450+0000","last_undegraded":"2023-12-16T01:53:33.041450+0000","last_fullsized":"2023-12-16T01:53:33.041450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.007767+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:53:33.007767+0000","last_peered":"2023-12-16T01:53:33.007767+0000","last_clean":"2023-12-16T01:53:33.007767+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:53:33.007767+0000","last_undegraded":"2023-12-16T01:53:33.007767+0000","last_fullsized":"2023-12-16T01:53:33.007767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051311+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:53:33.051311+0000","last_peered":"2023-12-16T01:53:33.051311+0000","last_clean":"2023-12-16T01:53:33.051311+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:33.051311+0000","last_undegraded":"2023-12-16T01:53:33.051311+0000","last_fullsized":"2023-12-16T01:53:33.051311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013429+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:53:33.013429+0000","last_peered":"2023-12-16T01:53:33.013429+0000","last_clean":"2023-12-16T01:53:33.013429+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:33.013429+0000","last_undegraded":"2023-12-16T01:53:33.013429+0000","last_fullsized":"2023-12-16T01:53:33.013429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.047865+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:53:33.047865+0000","last_peered":"2023-12-16T01:53:33.047865+0000","last_clean":"2023-12-16T01:53:33.047865+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:33.047865+0000","last_undegraded":"2023-12-16T01:53:33.047865+0000","last_fullsized":"2023-12-16T01:53:33.047865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.046823+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:53:33.046823+0000","last_peered":"2023-12-16T01:53:33.046823+0000","last_clean":"2023-12-16T01:53:33.046823+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:53:33.046823+0000","last_undegraded":"2023-12-16T01:53:33.046823+0000","last_fullsized":"2023-12-16T01:53:33.046823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051513+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:53:33.051513+0000","last_peered":"2023-12-16T01:53:33.051513+0000","last_clean":"2023-12-16T01:53:33.051513+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:33.051513+0000","last_undegraded":"2023-12-16T01:53:33.051513+0000","last_fullsized":"2023-12-16T01:53:33.051513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8651,"ondisk_log_size":8651,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542485,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.41099999999999998},"min":{"1min":0.34899999999999998,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.753}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42399999999999999,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.64800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.435,"15min":0.437},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.72799999999999998},"last":0.73299999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.65800000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.80300000000000005}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.66300000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.28899999999999998},"max":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.66400000000000003},"last":0.622}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.224},"max":{"1min":0.501,"5min":0.61799999999999999,"15min":0.69699999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.60299999999999998,"5min":0.627,"15min":0.67900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.503,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.315,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.66700000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":0.77700000000000002},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542483,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.214,"15min":0.214},"max":{"1min":0.59099999999999997,"5min":0.624,"15min":0.71599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.26000000000000001,"15min":0.23899999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.69699999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.36599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58899999999999997,"5min":0.627,"15min":0.86599999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.442,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.81599999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.442,"15min":0.432},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.78200000000000003},"last":0.60999999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.33400000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.92300000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46700000000000003,"15min":0.46200000000000002},"min":{"1min":0.38,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.63600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.49299999999999999,"5min":0.65000000000000002,"15min":0.82299999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41399999999999998,"15min":0.42699999999999999},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.67200000000000004,"15min":0.89700000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56200000000000006}]}]},{"osd":5,"up_from":14,"seq":60129542484,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.438,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.78700000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.26000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.71699999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":0.54300000000000004,"5min":0.56499999999999995,"15min":0.67400000000000004},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.70799999999999996},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.31},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.34699999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.69799999999999995},"last":0.375},{"interface":"front","average":{"1min":0.436,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.437}]}]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.625,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66300000000000003},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.68100000000000005},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.434,"15min":0.42699999999999999},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.443,"15min":0.442},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.40000000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":0.628,"15min":0.68300000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.252},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.72099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60499999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.69599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542484,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.28699999999999998},"min":{"1min":0.22,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29999999999999999},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.312,"15min":0.30499999999999999},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.45200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.52400000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.497,"5min":0.51300000000000001,"15min":0.63400000000000001},"last":0.38}]},{"osd":4,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.69799999999999995,"15min":0.79300000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.499},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.64700000000000002},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.55900000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.314},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.70099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48799999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.28499999999999998,"15min":0.29299999999999998},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.60499999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.309,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.54600000000000004},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.31,"15min":0.318},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.438,"5min":0.48199999999999998,"15min":0.56599999999999995},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.314,"15min":0.317},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.437,"5min":0.503,"15min":0.55000000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.67800000000000005},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.438},"min":{"1min":0.38,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.59199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58699999999999997,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.60699999999999998,"15min":0.67900000000000005},"last":0.501},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.82899999999999996},"last":0.629}]},{"osd":6,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.56799999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.74299999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.76000000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71099999999999997},"last":0.53100000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542484,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.314,"15min":0.29899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.29899999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30399999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.33400000000000002},"min":{"1min":0.23200000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.20200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.51500000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35799999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.77700000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.76200000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.627,"5min":0.747,"15min":0.96699999999999997},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.74099999999999999,"15min":0.80700000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.748,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.505}]}]},{"osd":0,"up_from":14,"seq":60129542484,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.216,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54900000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.379}]},{"osd":3,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.67700000000000005},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.70399999999999996,"15min":0.753},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.73099999999999998},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:53:40.298 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T01:53:40.298 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:53:40.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.433+0000 7f6797541640 1 Processor -- start 2023-12-16T01:53:40.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.433+0000 7f6797541640 1 -- start start 2023-12-16T01:53:40.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.434+0000 7f6797541640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f679006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.434+0000 7f6797541640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67900c83f0 0x7f679006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.434+0000 7f6797541640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900c5f60 con 0x7f67900c7190 2023-12-16T01:53:40.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.434+0000 7f6797541640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67900c2c60 con 0x7f67900c83f0 2023-12-16T01:53:40.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.434+0000 7f6797541640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c2f20 con 0x7f67901504e0 2023-12-16T01:53:40.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.435+0000 7f67952dd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f679006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.435+0000 7f6795ade640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67900c83f0 0x7f679006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.435+0000 7f6794adc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f67900c7190 0x7f67900c7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55290/0 (socket says 172.21.15.107:55290) 2023-12-16T01:53:40.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.435+0000 7f6794adc640 1 -- 172.21.15.107:0/895760005 learned_addr learned my addr 172.21.15.107:0/895760005 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:40.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.437+0000 7f67952dd640 1 -- 172.21.15.107:0/895760005 >> v2:172.21.15.107:3300/0 conn(0x7f67900c83f0 msgr2=0x7f679006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:40.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.437+0000 7f67952dd640 1 --2- 172.21.15.107:0/895760005 >> v2:172.21.15.107:3300/0 conn(0x7f67900c83f0 0x7f679006e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.437+0000 7f67952dd640 1 -- 172.21.15.107:0/895760005 >> v1:172.21.15.107:6789/0 conn(0x7f67900c7190 legacy=0x7f67900c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.437+0000 7f67952dd640 1 -- 172.21.15.107:0/895760005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900c61b0 con 0x7f67901504e0 2023-12-16T01:53:40.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.439+0000 7f67952dd640 1 --2- 172.21.15.107:0/895760005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f679006e1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67800097a0 tx=0x7f678002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f263ff32bc82a883 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:40.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6787fff640 1 -- 172.21.15.107:0/895760005 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780031780 con 0x7f67901504e0 2023-12-16T01:53:40.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6787fff640 1 -- 172.21.15.107:0/895760005 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800318e0 con 0x7f67901504e0 2023-12-16T01:53:40.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6787fff640 1 -- 172.21.15.107:0/895760005 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780031c70 con 0x7f67901504e0 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 -- 172.21.15.107:0/895760005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 msgr2=0x7f679006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 --2- 172.21.15.107:0/895760005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f679006e1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67800097a0 tx=0x7f678002b820 comp rx=0 tx=0).stop 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 -- 172.21.15.107:0/895760005 shutdown_connections 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 --2- 172.21.15.107:0/895760005 >> v2:172.21.15.107:3300/0 conn(0x7f67900c83f0 0x7f679006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 --2- 172.21.15.107:0/895760005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f679006e1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 -- 172.21.15.107:0/895760005 >> 172.21.15.107:0/895760005 conn(0x7f67900cbef0 msgr2=0x7f67900cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 -- 172.21.15.107:0/895760005 shutdown_connections 2023-12-16T01:53:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.443+0000 7f6797541640 1 -- 172.21.15.107:0/895760005 wait complete. 2023-12-16T01:53:40.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 Processor -- start 2023-12-16T01:53:40.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 -- start start 2023-12-16T01:53:40.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67900c7190 0x7f67901573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 0x7f6790159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f6790159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790158ec0 con 0x7f67900c83f0 2023-12-16T01:53:40.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790159890 con 0x7f67900c7190 2023-12-16T01:53:40.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.445+0000 7f6797541640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679006b350 con 0x7f67901504e0 2023-12-16T01:53:40.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.446+0000 7f6794adc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 0x7f6790159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.446+0000 7f6795ade640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f6790159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.446+0000 7f67952dd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67900c7190 0x7f67901573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.446+0000 7f6794adc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 0x7f6790159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51892/0 (socket says 172.21.15.107:51892) 2023-12-16T01:53:40.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.446+0000 7f6794adc640 1 -- 172.21.15.107:0/2930414079 learned_addr learned my addr 172.21.15.107:0/2930414079 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:40.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.449+0000 7f6794adc640 1 -- 172.21.15.107:0/2930414079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 msgr2=0x7f6790159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.449+0000 7f6794adc640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f6790159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.449+0000 7f6794adc640 1 -- 172.21.15.107:0/2930414079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67900c7190 msgr2=0x7f67901573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.449+0000 7f6794adc640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67900c7190 0x7f67901573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.449+0000 7f6794adc640 1 -- 172.21.15.107:0/2930414079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009400 con 0x7f67900c83f0 2023-12-16T01:53:40.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.451+0000 7f6794adc640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 0x7f6790159350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f678c00c400 tx=0x7f678c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:40.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.455+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c005ce0 con 0x7f67900c83f0 2023-12-16T01:53:40.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.455+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c005e40 con 0x7f67900c83f0 2023-12-16T01:53:40.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.455+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0072d0 con 0x7f67900c83f0 2023-12-16T01:53:40.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.455+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67901ed070 con 0x7f67900c83f0 2023-12-16T01:53:40.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.455+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6790158b50 con 0x7f67900c83f0 2023-12-16T01:53:40.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.456+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67901586c0 con 0x7f67900c83f0 2023-12-16T01:53:40.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.480+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f678c0074f0 con 0x7f67900c83f0 2023-12-16T01:53:40.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.480+0000 7f6785ffb640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f677406ae90 0x7f677406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:40.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.480+0000 7f67952dd640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f677406ae90 0x7f677406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:40.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.481+0000 7f67952dd640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f677406ae90 0x7f677406d350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6780036000 tx=0x7f678003d040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.745+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f678c057e20 con 0x7f67900c83f0 2023-12-16T01:53:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.745+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f678c054160 con 0x7f67900c83f0 2023-12-16T01:53:40.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.916+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67900c1390 con 0x7f677406ae90 2023-12-16T01:53:40.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.925+0000 7f6785ffb640 1 -- 172.21.15.107:0/2930414079 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370983 (secure 0 0 0) 0x7f6780031a50 con 0x7f677406ae90 2023-12-16T01:53:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:40.933 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f677406ae90 msgr2=0x7f677406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f677406ae90 0x7f677406d350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6780036000 tx=0x7f678003d040 comp rx=0 tx=0).stop 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 msgr2=0x7f6790159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 0x7f6790159350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f678c00c400 tx=0x7f678c00c8c0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 shutdown_connections 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67901504e0 0x7f6790159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67900c83f0 0x7f6790159350 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f677406ae90 0x7f677406d350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 --2- 172.21.15.107:0/2930414079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67900c7190 0x7f67901573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 >> 172.21.15.107:0/2930414079 conn(0x7f67900cbef0 msgr2=0x7f679014f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 shutdown_connections 2023-12-16T01:53:40.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:40.929+0000 7f6797541640 1 -- 172.21.15.107:0/2930414079 wait complete. 2023-12-16T01:53:40.942 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-12-16T01:53:40.088954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15784,"ondisk_log_size":15784,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":68410,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":32,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002607"},"pg_stats":[{"pgid":"2.1f","version":"28'621","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.736627+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:53:19.736627+0000","last_peered":"2023-12-16T01:53:19.736627+0000","last_clean":"2023-12-16T01:53:19.736627+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:19.736627+0000","last_undegraded":"2023-12-16T01:53:19.736627+0000","last_fullsized":"2023-12-16T01:53:19.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052203+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:53:33.052203+0000","last_peered":"2023-12-16T01:53:33.052203+0000","last_clean":"2023-12-16T01:53:33.052203+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:53:33.052203+0000","last_undegraded":"2023-12-16T01:53:33.052203+0000","last_fullsized":"2023-12-16T01:53:33.052203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546299+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:53:04.546299+0000","last_peered":"2023-12-16T01:53:04.546299+0000","last_clean":"2023-12-16T01:53:04.546299+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:53:04.546299+0000","last_undegraded":"2023-12-16T01:53:04.546299+0000","last_fullsized":"2023-12-16T01:53:04.546299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'727","reported_seq":758,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642747+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:53:13.642747+0000","last_peered":"2023-12-16T01:53:13.642747+0000","last_clean":"2023-12-16T01:53:13.642747+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:53:13.642747+0000","last_undegraded":"2023-12-16T01:53:13.642747+0000","last_fullsized":"2023-12-16T01:53:13.642747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052578+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:53:33.052578+0000","last_peered":"2023-12-16T01:53:33.052578+0000","last_clean":"2023-12-16T01:53:33.052578+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:33.052578+0000","last_undegraded":"2023-12-16T01:53:33.052578+0000","last_fullsized":"2023-12-16T01:53:33.052578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.950355+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:52:58.950355+0000","last_peered":"2023-12-16T01:52:58.950355+0000","last_clean":"2023-12-16T01:52:58.950355+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:52:58.950355+0000","last_undegraded":"2023-12-16T01:52:58.950355+0000","last_fullsized":"2023-12-16T01:52:58.950355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1394","reported_seq":1423,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.861096+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:53:25.861096+0000","last_peered":"2023-12-16T01:53:25.861096+0000","last_clean":"2023-12-16T01:53:25.861096+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:25.861096+0000","last_undegraded":"2023-12-16T01:53:25.861096+0000","last_fullsized":"2023-12-16T01:53:25.861096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1394,"log_dups_size":0,"ondisk_log_size":1394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089082+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:53:33.089082+0000","last_peered":"2023-12-16T01:53:33.089082+0000","last_clean":"2023-12-16T01:53:33.089082+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:33.089082+0000","last_undegraded":"2023-12-16T01:53:33.089082+0000","last_fullsized":"2023-12-16T01:53:33.089082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.523291+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:53:05.523291+0000","last_peered":"2023-12-16T01:53:05.523291+0000","last_clean":"2023-12-16T01:53:05.523291+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:53:05.523291+0000","last_undegraded":"2023-12-16T01:53:05.523291+0000","last_fullsized":"2023-12-16T01:53:05.523291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:18.987587+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:53:18.987587+0000","last_peered":"2023-12-16T01:53:18.987587+0000","last_clean":"2023-12-16T01:53:18.987587+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:53:18.987587+0000","last_undegraded":"2023-12-16T01:53:18.987587+0000","last_fullsized":"2023-12-16T01:53:18.987587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003080+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003080+0000","last_peered":"2023-12-16T01:53:33.003080+0000","last_clean":"2023-12-16T01:53:33.003080+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003080+0000","last_undegraded":"2023-12-16T01:53:33.003080+0000","last_fullsized":"2023-12-16T01:53:33.003080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:29:57.092568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.513556+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:53:05.513556+0000","last_peered":"2023-12-16T01:53:05.513556+0000","last_clean":"2023-12-16T01:53:05.513556+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:53:05.513556+0000","last_undegraded":"2023-12-16T01:53:05.513556+0000","last_fullsized":"2023-12-16T01:53:05.513556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.011587+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:53:33.011587+0000","last_peered":"2023-12-16T01:53:33.011587+0000","last_clean":"2023-12-16T01:53:33.011587+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:53:33.011587+0000","last_undegraded":"2023-12-16T01:53:33.011587+0000","last_fullsized":"2023-12-16T01:53:33.011587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'637","reported_seq":667,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:21.784478+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:53:21.784478+0000","last_peered":"2023-12-16T01:53:21.784478+0000","last_clean":"2023-12-16T01:53:21.784478+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:53:21.784478+0000","last_undegraded":"2023-12-16T01:53:21.784478+0000","last_fullsized":"2023-12-16T01:53:21.784478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503323+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503323+0000","last_peered":"2023-12-16T01:53:05.503323+0000","last_clean":"2023-12-16T01:53:05.503323+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503323+0000","last_undegraded":"2023-12-16T01:53:05.503323+0000","last_fullsized":"2023-12-16T01:53:05.503323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.970424+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:53:32.970424+0000","last_peered":"2023-12-16T01:53:32.970424+0000","last_clean":"2023-12-16T01:53:32.970424+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:53:32.970424+0000","last_undegraded":"2023-12-16T01:53:32.970424+0000","last_fullsized":"2023-12-16T01:53:32.970424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642954+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:53:13.642954+0000","last_peered":"2023-12-16T01:53:13.642954+0000","last_clean":"2023-12-16T01:53:13.642954+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:53:13.642954+0000","last_undegraded":"2023-12-16T01:53:13.642954+0000","last_fullsized":"2023-12-16T01:53:13.642954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546380+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:53:04.546380+0000","last_peered":"2023-12-16T01:53:04.546380+0000","last_clean":"2023-12-16T01:53:04.546380+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:53:04.546380+0000","last_undegraded":"2023-12-16T01:53:04.546380+0000","last_fullsized":"2023-12-16T01:53:04.546380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089208+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:53:33.089208+0000","last_peered":"2023-12-16T01:53:33.089208+0000","last_clean":"2023-12-16T01:53:33.089208+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:53:33.089208+0000","last_undegraded":"2023-12-16T01:53:33.089208+0000","last_fullsized":"2023-12-16T01:53:33.089208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:39.770859+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:49:39.770859+0000","last_peered":"2023-12-16T01:49:39.770859+0000","last_clean":"2023-12-16T01:49:39.770859+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:49:39.770859+0000","last_undegraded":"2023-12-16T01:49:39.770859+0000","last_fullsized":"2023-12-16T01:49:39.770859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.402834+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:53:03.402834+0000","last_peered":"2023-12-16T01:53:03.402834+0000","last_clean":"2023-12-16T01:53:03.402834+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:53:03.402834+0000","last_undegraded":"2023-12-16T01:53:03.402834+0000","last_fullsized":"2023-12-16T01:53:03.402834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.576104+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:53:02.576104+0000","last_peered":"2023-12-16T01:53:02.576104+0000","last_clean":"2023-12-16T01:53:02.576104+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:02.576104+0000","last_undegraded":"2023-12-16T01:53:02.576104+0000","last_fullsized":"2023-12-16T01:53:02.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746058+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:53:20.746058+0000","last_peered":"2023-12-16T01:53:20.746058+0000","last_clean":"2023-12-16T01:53:20.746058+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:20.746058+0000","last_undegraded":"2023-12-16T01:53:20.746058+0000","last_fullsized":"2023-12-16T01:53:20.746058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":150,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.511655+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:53:05.511655+0000","last_peered":"2023-12-16T01:53:05.511655+0000","last_clean":"2023-12-16T01:53:05.511655+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:53:05.511655+0000","last_undegraded":"2023-12-16T01:53:05.511655+0000","last_fullsized":"2023-12-16T01:53:05.511655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089117+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:53:33.089117+0000","last_peered":"2023-12-16T01:53:33.089117+0000","last_clean":"2023-12-16T01:53:33.089117+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:53:33.089117+0000","last_undegraded":"2023-12-16T01:53:33.089117+0000","last_fullsized":"2023-12-16T01:53:33.089117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'11","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.858325+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:53:25.858325+0000","last_peered":"2023-12-16T01:53:25.858325+0000","last_clean":"2023-12-16T01:53:25.858325+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:53:25.858325+0000","last_undegraded":"2023-12-16T01:53:25.858325+0000","last_fullsized":"2023-12-16T01:53:25.858325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.894062+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:53:03.894062+0000","last_peered":"2023-12-16T01:53:03.894062+0000","last_clean":"2023-12-16T01:53:03.894062+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:53:03.894062+0000","last_undegraded":"2023-12-16T01:53:03.894062+0000","last_fullsized":"2023-12-16T01:53:03.894062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089363+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:53:33.089363+0000","last_peered":"2023-12-16T01:53:33.089363+0000","last_clean":"2023-12-16T01:53:33.089363+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:53:33.089363+0000","last_undegraded":"2023-12-16T01:53:33.089363+0000","last_fullsized":"2023-12-16T01:53:33.089363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'310","reported_seq":341,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:29.053543+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:53:29.053543+0000","last_peered":"2023-12-16T01:53:29.053543+0000","last_clean":"2023-12-16T01:53:29.053543+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:53:29.053543+0000","last_undegraded":"2023-12-16T01:53:29.053543+0000","last_fullsized":"2023-12-16T01:53:29.053543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.545783+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:53:04.545783+0000","last_peered":"2023-12-16T01:53:04.545783+0000","last_clean":"2023-12-16T01:53:04.545783+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:53:04.545783+0000","last_undegraded":"2023-12-16T01:53:04.545783+0000","last_fullsized":"2023-12-16T01:53:04.545783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.984623+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:53:32.984623+0000","last_peered":"2023-12-16T01:53:32.984623+0000","last_clean":"2023-12-16T01:53:32.984623+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:53:32.984623+0000","last_undegraded":"2023-12-16T01:53:32.984623+0000","last_fullsized":"2023-12-16T01:53:32.984623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:16.660057+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:53:16.660057+0000","last_peered":"2023-12-16T01:53:16.660057+0000","last_clean":"2023-12-16T01:53:16.660057+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:53:16.660057+0000","last_undegraded":"2023-12-16T01:53:16.660057+0000","last_fullsized":"2023-12-16T01:53:16.660057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.562047+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:53:04.562047+0000","last_peered":"2023-12-16T01:53:04.562047+0000","last_clean":"2023-12-16T01:53:04.562047+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:53:04.562047+0000","last_undegraded":"2023-12-16T01:53:04.562047+0000","last_fullsized":"2023-12-16T01:53:04.562047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013234+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:53:33.013234+0000","last_peered":"2023-12-16T01:53:33.013234+0000","last_clean":"2023-12-16T01:53:33.013234+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:33.013234+0000","last_undegraded":"2023-12-16T01:53:33.013234+0000","last_fullsized":"2023-12-16T01:53:33.013234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:09.553576+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:53:09.553576+0000","last_peered":"2023-12-16T01:53:09.553576+0000","last_clean":"2023-12-16T01:53:09.553576+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:09.553576+0000","last_undegraded":"2023-12-16T01:53:09.553576+0000","last_fullsized":"2023-12-16T01:53:09.553576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:59.749941+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:52:59.749941+0000","last_peered":"2023-12-16T01:52:59.749941+0000","last_clean":"2023-12-16T01:52:59.749941+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:52:59.749941+0000","last_undegraded":"2023-12-16T01:52:59.749941+0000","last_fullsized":"2023-12-16T01:52:59.749941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.043561+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:53:33.043561+0000","last_peered":"2023-12-16T01:53:33.043561+0000","last_clean":"2023-12-16T01:53:33.043561+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:53:33.043561+0000","last_undegraded":"2023-12-16T01:53:33.043561+0000","last_fullsized":"2023-12-16T01:53:33.043561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.733213+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:53:19.733213+0000","last_peered":"2023-12-16T01:53:19.733213+0000","last_clean":"2023-12-16T01:53:19.733213+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:53:19.733213+0000","last_undegraded":"2023-12-16T01:53:19.733213+0000","last_fullsized":"2023-12-16T01:53:19.733213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.525881+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:53:05.525881+0000","last_peered":"2023-12-16T01:53:05.525881+0000","last_clean":"2023-12-16T01:53:05.525881+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:53:05.525881+0000","last_undegraded":"2023-12-16T01:53:05.525881+0000","last_fullsized":"2023-12-16T01:53:05.525881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048436+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:53:33.048436+0000","last_peered":"2023-12-16T01:53:33.048436+0000","last_clean":"2023-12-16T01:53:33.048436+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:53:33.048436+0000","last_undegraded":"2023-12-16T01:53:33.048436+0000","last_fullsized":"2023-12-16T01:53:33.048436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:30.852212+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:53:30.852212+0000","last_peered":"2023-12-16T01:53:30.852212+0000","last_clean":"2023-12-16T01:53:30.852212+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:30.852212+0000","last_undegraded":"2023-12-16T01:53:30.852212+0000","last_fullsized":"2023-12-16T01:53:30.852212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394771+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:53:03.394771+0000","last_peered":"2023-12-16T01:53:03.394771+0000","last_clean":"2023-12-16T01:53:03.394771+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:53:03.394771+0000","last_undegraded":"2023-12-16T01:53:03.394771+0000","last_fullsized":"2023-12-16T01:53:03.394771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985745+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:53:32.985745+0000","last_peered":"2023-12-16T01:53:32.985745+0000","last_clean":"2023-12-16T01:53:32.985745+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:53:32.985745+0000","last_undegraded":"2023-12-16T01:53:32.985745+0000","last_fullsized":"2023-12-16T01:53:32.985745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'555","reported_seq":586,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859131+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:53:25.859131+0000","last_peered":"2023-12-16T01:53:25.859131+0000","last_clean":"2023-12-16T01:53:25.859131+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:53:25.859131+0000","last_undegraded":"2023-12-16T01:53:25.859131+0000","last_fullsized":"2023-12-16T01:53:25.859131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.498426+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:53:05.498426+0000","last_peered":"2023-12-16T01:53:05.498426+0000","last_clean":"2023-12-16T01:53:05.498426+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:53:05.498426+0000","last_undegraded":"2023-12-16T01:53:05.498426+0000","last_fullsized":"2023-12-16T01:53:05.498426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092052+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:53:33.092052+0000","last_peered":"2023-12-16T01:53:33.092052+0000","last_clean":"2023-12-16T01:53:33.092052+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:53:33.092052+0000","last_undegraded":"2023-12-16T01:53:33.092052+0000","last_fullsized":"2023-12-16T01:53:33.092052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.958970+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:52:53.958970+0000","last_peered":"2023-12-16T01:52:53.958970+0000","last_clean":"2023-12-16T01:52:53.958970+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:52:53.958970+0000","last_undegraded":"2023-12-16T01:52:53.958970+0000","last_fullsized":"2023-12-16T01:52:53.958970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:43.837180+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:49:43.837180+0000","last_peered":"2023-12-16T01:49:43.837180+0000","last_clean":"2023-12-16T01:49:43.837180+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:49:43.837180+0000","last_undegraded":"2023-12-16T01:49:43.837180+0000","last_fullsized":"2023-12-16T01:49:43.837180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394625+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:53:03.394625+0000","last_peered":"2023-12-16T01:53:03.394625+0000","last_clean":"2023-12-16T01:53:03.394625+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:53:03.394625+0000","last_undegraded":"2023-12-16T01:53:03.394625+0000","last_fullsized":"2023-12-16T01:53:03.394625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003140+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:53:33.003140+0000","last_peered":"2023-12-16T01:53:33.003140+0000","last_clean":"2023-12-16T01:53:33.003140+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:33.003140+0000","last_undegraded":"2023-12-16T01:53:33.003140+0000","last_fullsized":"2023-12-16T01:53:33.003140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.701145+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:53:17.701145+0000","last_peered":"2023-12-16T01:53:17.701145+0000","last_clean":"2023-12-16T01:53:17.701145+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:17.701145+0000","last_undegraded":"2023-12-16T01:53:17.701145+0000","last_fullsized":"2023-12-16T01:53:17.701145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.614282+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:53:02.614282+0000","last_peered":"2023-12-16T01:53:02.614282+0000","last_clean":"2023-12-16T01:53:02.614282+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:53:02.614282+0000","last_undegraded":"2023-12-16T01:53:02.614282+0000","last_fullsized":"2023-12-16T01:53:02.614282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051127+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:53:33.051127+0000","last_peered":"2023-12-16T01:53:33.051127+0000","last_clean":"2023-12-16T01:53:33.051127+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:53:33.051127+0000","last_undegraded":"2023-12-16T01:53:33.051127+0000","last_fullsized":"2023-12-16T01:53:33.051127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.702497+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:53:17.702497+0000","last_peered":"2023-12-16T01:53:17.702497+0000","last_clean":"2023-12-16T01:53:17.702497+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:17.702497+0000","last_undegraded":"2023-12-16T01:53:17.702497+0000","last_fullsized":"2023-12-16T01:53:17.702497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399892+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:53:03.399892+0000","last_peered":"2023-12-16T01:53:03.399892+0000","last_clean":"2023-12-16T01:53:03.399892+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:53:03.399892+0000","last_undegraded":"2023-12-16T01:53:03.399892+0000","last_fullsized":"2023-12-16T01:53:03.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075246+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:53:33.075246+0000","last_peered":"2023-12-16T01:53:33.075246+0000","last_clean":"2023-12-16T01:53:33.075246+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:53:33.075246+0000","last_undegraded":"2023-12-16T01:53:33.075246+0000","last_fullsized":"2023-12-16T01:53:33.075246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735726+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:53:19.735726+0000","last_peered":"2023-12-16T01:53:19.735726+0000","last_clean":"2023-12-16T01:53:19.735726+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:53:19.735726+0000","last_undegraded":"2023-12-16T01:53:19.735726+0000","last_fullsized":"2023-12-16T01:53:19.735726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.758398+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:53:01.758398+0000","last_peered":"2023-12-16T01:53:01.758398+0000","last_clean":"2023-12-16T01:53:01.758398+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:53:01.758398+0000","last_undegraded":"2023-12-16T01:53:01.758398+0000","last_fullsized":"2023-12-16T01:53:01.758398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002598+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:53:33.002598+0000","last_peered":"2023-12-16T01:53:33.002598+0000","last_clean":"2023-12-16T01:53:33.002598+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:33.002598+0000","last_undegraded":"2023-12-16T01:53:33.002598+0000","last_fullsized":"2023-12-16T01:53:33.002598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.984895+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:52:53.984895+0000","last_peered":"2023-12-16T01:52:53.984895+0000","last_clean":"2023-12-16T01:52:53.984895+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:52:53.984895+0000","last_undegraded":"2023-12-16T01:52:53.984895+0000","last_fullsized":"2023-12-16T01:52:53.984895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.588615+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:53:02.588615+0000","last_peered":"2023-12-16T01:53:02.588615+0000","last_clean":"2023-12-16T01:53:02.588615+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:53:02.588615+0000","last_undegraded":"2023-12-16T01:53:02.588615+0000","last_fullsized":"2023-12-16T01:53:02.588615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.998352+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:53:32.998352+0000","last_peered":"2023-12-16T01:53:32.998352+0000","last_clean":"2023-12-16T01:53:32.998352+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:32.998352+0000","last_undegraded":"2023-12-16T01:53:32.998352+0000","last_fullsized":"2023-12-16T01:53:32.998352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:51:29.781913+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:51:29.781913+0000","last_peered":"2023-12-16T01:51:29.781913+0000","last_clean":"2023-12-16T01:51:29.781913+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:51:29.781913+0000","last_undegraded":"2023-12-16T01:51:29.781913+0000","last_fullsized":"2023-12-16T01:51:29.781913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394238+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:53:03.394238+0000","last_peered":"2023-12-16T01:53:03.394238+0000","last_clean":"2023-12-16T01:53:03.394238+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:53:03.394238+0000","last_undegraded":"2023-12-16T01:53:03.394238+0000","last_fullsized":"2023-12-16T01:53:03.394238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.082967+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:53:33.082967+0000","last_peered":"2023-12-16T01:53:33.082967+0000","last_clean":"2023-12-16T01:53:33.082967+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:33.082967+0000","last_undegraded":"2023-12-16T01:53:33.082967+0000","last_fullsized":"2023-12-16T01:53:33.082967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.781615+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:53:22.781615+0000","last_peered":"2023-12-16T01:53:22.781615+0000","last_clean":"2023-12-16T01:53:22.781615+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:53:22.781615+0000","last_undegraded":"2023-12-16T01:53:22.781615+0000","last_fullsized":"2023-12-16T01:53:22.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:13.926127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.024631+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:52:58.024631+0000","last_peered":"2023-12-16T01:52:58.024631+0000","last_clean":"2023-12-16T01:52:58.024631+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:52:58.024631+0000","last_undegraded":"2023-12-16T01:52:58.024631+0000","last_fullsized":"2023-12-16T01:52:58.024631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.005175+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:53:33.005175+0000","last_peered":"2023-12-16T01:53:33.005175+0000","last_clean":"2023-12-16T01:53:33.005175+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:53:33.005175+0000","last_undegraded":"2023-12-16T01:53:33.005175+0000","last_fullsized":"2023-12-16T01:53:33.005175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859130+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:53:25.859130+0000","last_peered":"2023-12-16T01:53:25.859130+0000","last_clean":"2023-12-16T01:53:25.859130+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:53:25.859130+0000","last_undegraded":"2023-12-16T01:53:25.859130+0000","last_fullsized":"2023-12-16T01:53:25.859130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":146,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.755626+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:53:01.755626+0000","last_peered":"2023-12-16T01:53:01.755626+0000","last_clean":"2023-12-16T01:53:01.755626+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:53:01.755626+0000","last_undegraded":"2023-12-16T01:53:01.755626+0000","last_fullsized":"2023-12-16T01:53:01.755626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.991774+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:53:32.991774+0000","last_peered":"2023-12-16T01:53:32.991774+0000","last_clean":"2023-12-16T01:53:32.991774+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:53:32.991774+0000","last_undegraded":"2023-12-16T01:53:32.991774+0000","last_fullsized":"2023-12-16T01:53:32.991774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'303","reported_seq":333,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.800001+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:53:32.800001+0000","last_peered":"2023-12-16T01:53:32.800001+0000","last_clean":"2023-12-16T01:53:32.800001+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:32.800001+0000","last_undegraded":"2023-12-16T01:53:32.800001+0000","last_fullsized":"2023-12-16T01:53:32.800001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:00.568175+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:00.568175+0000","last_peered":"2023-12-16T01:53:00.568175+0000","last_clean":"2023-12-16T01:53:00.568175+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:00.568175+0000","last_undegraded":"2023-12-16T01:53:00.568175+0000","last_fullsized":"2023-12-16T01:53:00.568175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051233+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:53:33.051233+0000","last_peered":"2023-12-16T01:53:33.051233+0000","last_clean":"2023-12-16T01:53:33.051233+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:33.051233+0000","last_undegraded":"2023-12-16T01:53:33.051233+0000","last_fullsized":"2023-12-16T01:53:33.051233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'859","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.771475+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:53:22.771475+0000","last_peered":"2023-12-16T01:53:22.771475+0000","last_clean":"2023-12-16T01:53:22.771475+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:22.771475+0000","last_undegraded":"2023-12-16T01:53:22.771475+0000","last_fullsized":"2023-12-16T01:53:22.771475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546516+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:53:04.546516+0000","last_peered":"2023-12-16T01:53:04.546516+0000","last_clean":"2023-12-16T01:53:04.546516+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:53:04.546516+0000","last_undegraded":"2023-12-16T01:53:04.546516+0000","last_fullsized":"2023-12-16T01:53:04.546516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013492+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:53:33.013492+0000","last_peered":"2023-12-16T01:53:33.013492+0000","last_clean":"2023-12-16T01:53:33.013492+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:33.013492+0000","last_undegraded":"2023-12-16T01:53:33.013492+0000","last_fullsized":"2023-12-16T01:53:33.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'732","reported_seq":762,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:26.858591+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:53:26.858591+0000","last_peered":"2023-12-16T01:53:26.858591+0000","last_clean":"2023-12-16T01:53:26.858591+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:26.858591+0000","last_undegraded":"2023-12-16T01:53:26.858591+0000","last_fullsized":"2023-12-16T01:53:26.858591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.620159+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:53:02.620159+0000","last_peered":"2023-12-16T01:53:02.620159+0000","last_clean":"2023-12-16T01:53:02.620159+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:53:02.620159+0000","last_undegraded":"2023-12-16T01:53:02.620159+0000","last_fullsized":"2023-12-16T01:53:02.620159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051987+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:53:33.051987+0000","last_peered":"2023-12-16T01:53:33.051987+0000","last_clean":"2023-12-16T01:53:33.051987+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:53:33.051987+0000","last_undegraded":"2023-12-16T01:53:33.051987+0000","last_fullsized":"2023-12-16T01:53:33.051987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735578+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:53:19.735578+0000","last_peered":"2023-12-16T01:53:19.735578+0000","last_clean":"2023-12-16T01:53:19.735578+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:19.735578+0000","last_undegraded":"2023-12-16T01:53:19.735578+0000","last_fullsized":"2023-12-16T01:53:19.735578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:21.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551096+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:53:04.551096+0000","last_peered":"2023-12-16T01:53:04.551096+0000","last_clean":"2023-12-16T01:53:04.551096+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:53:04.551096+0000","last_undegraded":"2023-12-16T01:53:04.551096+0000","last_fullsized":"2023-12-16T01:53:04.551096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.014454+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:53:33.014454+0000","last_peered":"2023-12-16T01:53:33.014454+0000","last_clean":"2023-12-16T01:53:33.014454+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:53:33.014454+0000","last_undegraded":"2023-12-16T01:53:33.014454+0000","last_fullsized":"2023-12-16T01:53:33.014454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.703191+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:53:17.703191+0000","last_peered":"2023-12-16T01:53:17.703191+0000","last_clean":"2023-12-16T01:53:17.703191+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:17.703191+0000","last_undegraded":"2023-12-16T01:53:17.703191+0000","last_fullsized":"2023-12-16T01:53:17.703191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":188,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546309+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:53:04.546309+0000","last_peered":"2023-12-16T01:53:04.546309+0000","last_clean":"2023-12-16T01:53:04.546309+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:53:04.546309+0000","last_undegraded":"2023-12-16T01:53:04.546309+0000","last_fullsized":"2023-12-16T01:53:04.546309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399829+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:53:03.399829+0000","last_peered":"2023-12-16T01:53:03.399829+0000","last_clean":"2023-12-16T01:53:03.399829+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:53:03.399829+0000","last_undegraded":"2023-12-16T01:53:03.399829+0000","last_fullsized":"2023-12-16T01:53:03.399829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.091709+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:53:33.091709+0000","last_peered":"2023-12-16T01:53:33.091709+0000","last_clean":"2023-12-16T01:53:33.091709+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:53:33.091709+0000","last_undegraded":"2023-12-16T01:53:33.091709+0000","last_fullsized":"2023-12-16T01:53:33.091709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.782204+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:53:22.782204+0000","last_peered":"2023-12-16T01:53:22.782204+0000","last_clean":"2023-12-16T01:53:22.782204+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:53:22.782204+0000","last_undegraded":"2023-12-16T01:53:22.782204+0000","last_fullsized":"2023-12-16T01:53:22.782204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":178,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553813+0000","last_change":"2023-12-16T01:26:31.583645+0000","last_active":"2023-12-16T01:53:04.553813+0000","last_peered":"2023-12-16T01:53:04.553813+0000","last_clean":"2023-12-16T01:53:04.553813+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:53:04.553813+0000","last_undegraded":"2023-12-16T01:53:04.553813+0000","last_fullsized":"2023-12-16T01:53:04.553813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:33:04.088136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.050878+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:53:33.050878+0000","last_peered":"2023-12-16T01:53:33.050878+0000","last_clean":"2023-12-16T01:53:33.050878+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:33.050878+0000","last_undegraded":"2023-12-16T01:53:33.050878+0000","last_fullsized":"2023-12-16T01:53:33.050878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.713624+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:53:15.713624+0000","last_peered":"2023-12-16T01:53:15.713624+0000","last_clean":"2023-12-16T01:53:15.713624+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:15.713624+0000","last_undegraded":"2023-12-16T01:53:15.713624+0000","last_fullsized":"2023-12-16T01:53:15.713624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'706","reported_seq":735,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.727664+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:53:15.727664+0000","last_peered":"2023-12-16T01:53:15.727664+0000","last_clean":"2023-12-16T01:53:15.727664+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:53:15.727664+0000","last_undegraded":"2023-12-16T01:53:15.727664+0000","last_fullsized":"2023-12-16T01:53:15.727664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092144+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:53:33.092144+0000","last_peered":"2023-12-16T01:53:33.092144+0000","last_clean":"2023-12-16T01:53:33.092144+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:53:33.092144+0000","last_undegraded":"2023-12-16T01:53:33.092144+0000","last_fullsized":"2023-12-16T01:53:33.092144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.397888+0000","last_change":"2023-12-16T01:26:31.583485+0000","last_active":"2023-12-16T01:53:03.397888+0000","last_peered":"2023-12-16T01:53:03.397888+0000","last_clean":"2023-12-16T01:53:03.397888+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:53:03.397888+0000","last_undegraded":"2023-12-16T01:53:03.397888+0000","last_fullsized":"2023-12-16T01:53:03.397888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:51.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'707","reported_seq":736,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746082+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:53:20.746082+0000","last_peered":"2023-12-16T01:53:20.746082+0000","last_clean":"2023-12-16T01:53:20.746082+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:53:20.746082+0000","last_undegraded":"2023-12-16T01:53:20.746082+0000","last_fullsized":"2023-12-16T01:53:20.746082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088690+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:53:33.088690+0000","last_peered":"2023-12-16T01:53:33.088690+0000","last_clean":"2023-12-16T01:53:33.088690+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:33.088690+0000","last_undegraded":"2023-12-16T01:53:33.088690+0000","last_fullsized":"2023-12-16T01:53:33.088690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.526023+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:53:05.526023+0000","last_peered":"2023-12-16T01:53:05.526023+0000","last_clean":"2023-12-16T01:53:05.526023+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:53:05.526023+0000","last_undegraded":"2023-12-16T01:53:05.526023+0000","last_fullsized":"2023-12-16T01:53:05.526023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013111+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:53:33.013111+0000","last_peered":"2023-12-16T01:53:33.013111+0000","last_clean":"2023-12-16T01:53:33.013111+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:33.013111+0000","last_undegraded":"2023-12-16T01:53:33.013111+0000","last_fullsized":"2023-12-16T01:53:33.013111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.974726+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:53:32.974726+0000","last_peered":"2023-12-16T01:53:32.974726+0000","last_clean":"2023-12-16T01:53:32.974726+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:32.974726+0000","last_undegraded":"2023-12-16T01:53:32.974726+0000","last_fullsized":"2023-12-16T01:53:32.974726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.996419+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:53:32.996419+0000","last_peered":"2023-12-16T01:53:32.996419+0000","last_clean":"2023-12-16T01:53:32.996419+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:53:32.996419+0000","last_undegraded":"2023-12-16T01:53:32.996419+0000","last_fullsized":"2023-12-16T01:53:32.996419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048222+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:53:33.048222+0000","last_peered":"2023-12-16T01:53:33.048222+0000","last_clean":"2023-12-16T01:53:33.048222+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:33.048222+0000","last_undegraded":"2023-12-16T01:53:33.048222+0000","last_fullsized":"2023-12-16T01:53:33.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988764+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:53:32.988764+0000","last_peered":"2023-12-16T01:53:32.988764+0000","last_clean":"2023-12-16T01:53:32.988764+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:53:32.988764+0000","last_undegraded":"2023-12-16T01:53:32.988764+0000","last_fullsized":"2023-12-16T01:53:32.988764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.983477+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:53:32.983477+0000","last_peered":"2023-12-16T01:53:32.983477+0000","last_clean":"2023-12-16T01:53:32.983477+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:53:32.983477+0000","last_undegraded":"2023-12-16T01:53:32.983477+0000","last_fullsized":"2023-12-16T01:53:32.983477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013189+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:53:33.013189+0000","last_peered":"2023-12-16T01:53:33.013189+0000","last_clean":"2023-12-16T01:53:33.013189+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:53:33.013189+0000","last_undegraded":"2023-12-16T01:53:33.013189+0000","last_fullsized":"2023-12-16T01:53:33.013189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052390+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:53:33.052390+0000","last_peered":"2023-12-16T01:53:33.052390+0000","last_clean":"2023-12-16T01:53:33.052390+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:53:33.052390+0000","last_undegraded":"2023-12-16T01:53:33.052390+0000","last_fullsized":"2023-12-16T01:53:33.052390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002679+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:53:33.002679+0000","last_peered":"2023-12-16T01:53:33.002679+0000","last_clean":"2023-12-16T01:53:33.002679+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:53:33.002679+0000","last_undegraded":"2023-12-16T01:53:33.002679+0000","last_fullsized":"2023-12-16T01:53:33.002679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052472+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:53:33.052472+0000","last_peered":"2023-12-16T01:53:33.052472+0000","last_clean":"2023-12-16T01:53:33.052472+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:53:33.052472+0000","last_undegraded":"2023-12-16T01:53:33.052472+0000","last_fullsized":"2023-12-16T01:53:33.052472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089039+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:53:33.089039+0000","last_peered":"2023-12-16T01:53:33.089039+0000","last_clean":"2023-12-16T01:53:33.089039+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:33.089039+0000","last_undegraded":"2023-12-16T01:53:33.089039+0000","last_fullsized":"2023-12-16T01:53:33.089039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.093269+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:53:33.093269+0000","last_peered":"2023-12-16T01:53:33.093269+0000","last_clean":"2023-12-16T01:53:33.093269+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:33.093269+0000","last_undegraded":"2023-12-16T01:53:33.093269+0000","last_fullsized":"2023-12-16T01:53:33.093269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.074698+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:53:33.074698+0000","last_peered":"2023-12-16T01:53:33.074698+0000","last_clean":"2023-12-16T01:53:33.074698+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:53:33.074698+0000","last_undegraded":"2023-12-16T01:53:33.074698+0000","last_fullsized":"2023-12-16T01:53:33.074698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.997000+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:53:32.997000+0000","last_peered":"2023-12-16T01:53:32.997000+0000","last_clean":"2023-12-16T01:53:32.997000+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:53:32.997000+0000","last_undegraded":"2023-12-16T01:53:32.997000+0000","last_fullsized":"2023-12-16T01:53:32.997000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.975471+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:53:32.975471+0000","last_peered":"2023-12-16T01:53:32.975471+0000","last_clean":"2023-12-16T01:53:32.975471+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:32.975471+0000","last_undegraded":"2023-12-16T01:53:32.975471+0000","last_fullsized":"2023-12-16T01:53:32.975471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002376+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:53:33.002376+0000","last_peered":"2023-12-16T01:53:33.002376+0000","last_clean":"2023-12-16T01:53:33.002376+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:33.002376+0000","last_undegraded":"2023-12-16T01:53:33.002376+0000","last_fullsized":"2023-12-16T01:53:33.002376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002747+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:53:33.002747+0000","last_peered":"2023-12-16T01:53:33.002747+0000","last_clean":"2023-12-16T01:53:33.002747+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:53:33.002747+0000","last_undegraded":"2023-12-16T01:53:33.002747+0000","last_fullsized":"2023-12-16T01:53:33.002747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052466+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:53:33.052466+0000","last_peered":"2023-12-16T01:53:33.052466+0000","last_clean":"2023-12-16T01:53:33.052466+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:53:33.052466+0000","last_undegraded":"2023-12-16T01:53:33.052466+0000","last_fullsized":"2023-12-16T01:53:33.052466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985017+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:53:32.985017+0000","last_peered":"2023-12-16T01:53:32.985017+0000","last_clean":"2023-12-16T01:53:32.985017+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:53:32.985017+0000","last_undegraded":"2023-12-16T01:53:32.985017+0000","last_fullsized":"2023-12-16T01:53:32.985017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988929+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:53:32.988929+0000","last_peered":"2023-12-16T01:53:32.988929+0000","last_clean":"2023-12-16T01:53:32.988929+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:53:32.988929+0000","last_undegraded":"2023-12-16T01:53:32.988929+0000","last_fullsized":"2023-12-16T01:53:32.988929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075656+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:53:33.075656+0000","last_peered":"2023-12-16T01:53:33.075656+0000","last_clean":"2023-12-16T01:53:33.075656+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:53:33.075656+0000","last_undegraded":"2023-12-16T01:53:33.075656+0000","last_fullsized":"2023-12-16T01:53:33.075656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.071227+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:53:33.071227+0000","last_peered":"2023-12-16T01:53:33.071227+0000","last_clean":"2023-12-16T01:53:33.071227+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:53:33.071227+0000","last_undegraded":"2023-12-16T01:53:33.071227+0000","last_fullsized":"2023-12-16T01:53:33.071227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075442+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:53:33.075442+0000","last_peered":"2023-12-16T01:53:33.075442+0000","last_clean":"2023-12-16T01:53:33.075442+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:53:33.075442+0000","last_undegraded":"2023-12-16T01:53:33.075442+0000","last_fullsized":"2023-12-16T01:53:33.075442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088834+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:53:33.088834+0000","last_peered":"2023-12-16T01:53:33.088834+0000","last_clean":"2023-12-16T01:53:33.088834+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:53:33.088834+0000","last_undegraded":"2023-12-16T01:53:33.088834+0000","last_fullsized":"2023-12-16T01:53:33.088834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.054078+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:53:33.054078+0000","last_peered":"2023-12-16T01:53:33.054078+0000","last_clean":"2023-12-16T01:53:33.054078+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:53:33.054078+0000","last_undegraded":"2023-12-16T01:53:33.054078+0000","last_fullsized":"2023-12-16T01:53:33.054078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.041450+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:53:33.041450+0000","last_peered":"2023-12-16T01:53:33.041450+0000","last_clean":"2023-12-16T01:53:33.041450+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:53:33.041450+0000","last_undegraded":"2023-12-16T01:53:33.041450+0000","last_fullsized":"2023-12-16T01:53:33.041450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.007767+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:53:33.007767+0000","last_peered":"2023-12-16T01:53:33.007767+0000","last_clean":"2023-12-16T01:53:33.007767+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:53:33.007767+0000","last_undegraded":"2023-12-16T01:53:33.007767+0000","last_fullsized":"2023-12-16T01:53:33.007767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051311+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:53:33.051311+0000","last_peered":"2023-12-16T01:53:33.051311+0000","last_clean":"2023-12-16T01:53:33.051311+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:33.051311+0000","last_undegraded":"2023-12-16T01:53:33.051311+0000","last_fullsized":"2023-12-16T01:53:33.051311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013429+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:53:33.013429+0000","last_peered":"2023-12-16T01:53:33.013429+0000","last_clean":"2023-12-16T01:53:33.013429+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:33.013429+0000","last_undegraded":"2023-12-16T01:53:33.013429+0000","last_fullsized":"2023-12-16T01:53:33.013429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.047865+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:53:33.047865+0000","last_peered":"2023-12-16T01:53:33.047865+0000","last_clean":"2023-12-16T01:53:33.047865+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:33.047865+0000","last_undegraded":"2023-12-16T01:53:33.047865+0000","last_fullsized":"2023-12-16T01:53:33.047865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.046823+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:53:33.046823+0000","last_peered":"2023-12-16T01:53:33.046823+0000","last_clean":"2023-12-16T01:53:33.046823+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:53:33.046823+0000","last_undegraded":"2023-12-16T01:53:33.046823+0000","last_fullsized":"2023-12-16T01:53:33.046823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051513+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:53:33.051513+0000","last_peered":"2023-12-16T01:53:33.051513+0000","last_clean":"2023-12-16T01:53:33.051513+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:33.051513+0000","last_undegraded":"2023-12-16T01:53:33.051513+0000","last_fullsized":"2023-12-16T01:53:33.051513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8651,"ondisk_log_size":8651,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542485,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.41099999999999998},"min":{"1min":0.34899999999999998,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.753}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42399999999999999,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.64800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.435,"15min":0.437},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.72799999999999998},"last":0.73299999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.65800000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.80300000000000005}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.66300000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.28899999999999998},"max":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.66400000000000003},"last":0.622}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.224},"max":{"1min":0.501,"5min":0.61799999999999999,"15min":0.69699999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.60299999999999998,"5min":0.627,"15min":0.67900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.503,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.315,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.66700000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":0.77700000000000002},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542483,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.214,"15min":0.214},"max":{"1min":0.59099999999999997,"5min":0.624,"15min":0.71599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.26000000000000001,"15min":0.23899999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.69699999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.36599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58899999999999997,"5min":0.627,"15min":0.86599999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.442,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.81599999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.442,"15min":0.432},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.78200000000000003},"last":0.60999999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.33400000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.92300000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46700000000000003,"15min":0.46200000000000002},"min":{"1min":0.38,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.63600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.49299999999999999,"5min":0.65000000000000002,"15min":0.82299999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41399999999999998,"15min":0.42699999999999999},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.67200000000000004,"15min":0.89700000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Dec 16 01:52:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56200000000000006}]}]},{"osd":5,"up_from":14,"seq":60129542484,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.438,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.78700000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.26000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.71699999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":0.54300000000000004,"5min":0.56499999999999995,"15min":0.67400000000000004},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.70799999999999996},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.31},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.34699999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.69799999999999995},"last":0.375},{"interface":"front","average":{"1min":0.436,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.437}]}]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.625,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66300000000000003},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.68100000000000005},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.434,"15min":0.42699999999999999},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.443,"15min":0.442},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.40000000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":0.628,"15min":0.68300000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.252},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.72099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60499999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.69599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542484,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.28699999999999998},"min":{"1min":0.22,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29999999999999999},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.312,"15min":0.30499999999999999},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.45200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.52400000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.497,"5min":0.51300000000000001,"15min":0.63400000000000001},"last":0.38}]},{"osd":4,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.69799999999999995,"15min":0.79300000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.499},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.64700000000000002},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.55900000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.314},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.70099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48799999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.28499999999999998,"15min":0.29299999999999998},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.45200000000000001,"5min":0.45500000000000002,"15min":0.60499999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.309,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.54600000000000004},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.31,"15min":0.318},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.438,"5min":0.48199999999999998,"15min":0.56599999999999995},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.314,"15min":0.317},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.437,"5min":0.503,"15min":0.55000000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.67800000000000005},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42999999999999999,"15min":0.438},"min":{"1min":0.38,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.59199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58699999999999997,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.60699999999999998,"15min":0.67900000000000005},"last":0.501},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.82899999999999996},"last":0.629}]},{"osd":6,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.56799999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.74299999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Sat Dec 16 01:52:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45800000000000002,"15min":0.46600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.76000000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71099999999999997},"last":0.53100000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542484,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.314,"15min":0.29899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.29899999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30399999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.33400000000000002},"min":{"1min":0.23200000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.20200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.51500000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35799999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.77700000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.76200000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.627,"5min":0.747,"15min":0.96699999999999997},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.74099999999999999,"15min":0.80700000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.748,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.505}]}]},{"osd":0,"up_from":14,"seq":60129542484,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.216,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54900000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.379}]},{"osd":3,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.67700000000000005},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.70399999999999996,"15min":0.753},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.73099999999999998},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:53:40.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:53:41.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.083+0000 7fa4fcacf640 1 Processor -- start 2023-12-16T01:53:41.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.083+0000 7fa4fcacf640 1 -- start start 2023-12-16T01:53:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.084+0000 7fa4fcacf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa4f8070ee0 0x7fa4f81614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.084+0000 7fa4fcacf640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f81592d0 con 0x7fa4f814fd70 2023-12-16T01:53:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.084+0000 7fa4fcacf640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80c65f0 con 0x7fa4f8071c40 2023-12-16T01:53:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.084+0000 7fa4fcacf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f8155b20 con 0x7fa4f8070ee0 2023-12-16T01:53:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.085+0000 7fa4f659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa4f814fd70 0x7fa4f80c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55296/0 (socket says 172.21.15.107:55296) 2023-12-16T01:53:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.085+0000 7fa4f659c640 1 -- 172.21.15.107:0/1352626923 learned_addr learned my addr 172.21.15.107:0/1352626923 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.085+0000 7fa4f6d9d640 1 --2- 172.21.15.107:0/1352626923 >> v2:172.21.15.157:3300/0 conn(0x7fa4f8070ee0 0x7fa4f81614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:41.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.087+0000 7fa4f5d9b640 1 -- 172.21.15.107:0/1352626923 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108314939 0 0) 0x7fa4f81592d0 con 0x7fa4f814fd70 2023-12-16T01:53:41.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.087+0000 7fa4f5d9b640 1 -- 172.21.15.107:0/1352626923 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e4003520 con 0x7fa4f814fd70 2023-12-16T01:53:41.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.089+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/1352626923 >> v1:172.21.15.157:6789/0 conn(0x7fa4f8071c40 legacy=0x7fa4f8159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.089+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/1352626923 >> v1:172.21.15.107:6789/0 conn(0x7fa4f814fd70 legacy=0x7fa4f80c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.089+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/1352626923 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80c68d0 con 0x7fa4f8070ee0 2023-12-16T01:53:41.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.094+0000 7fa4f6d9d640 1 --2- 172.21.15.107:0/1352626923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8070ee0 0x7fa4f81614b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000aea0 tx=0x7fa4f002cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd9391fdd0a600 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:41.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.098+0000 7fa4f5d9b640 1 -- 172.21.15.107:0/1352626923 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f002dac0 con 0x7fa4f8070ee0 2023-12-16T01:53:41.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4f5d9b640 1 -- 172.21.15.107:0/1352626923 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f002dc20 con 0x7fa4f8070ee0 2023-12-16T01:53:41.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4f5d9b640 1 -- 172.21.15.107:0/1352626923 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f000a2e0 con 0x7fa4f8070ee0 2023-12-16T01:53:41.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 -- 172.21.15.107:0/1352626923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8070ee0 msgr2=0x7fa4f81614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/1352626923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8070ee0 0x7fa4f81614b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000aea0 tx=0x7fa4f002cf20 comp rx=0 tx=0).stop 2023-12-16T01:53:41.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 -- 172.21.15.107:0/1352626923 shutdown_connections 2023-12-16T01:53:41.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/1352626923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8070ee0 0x7fa4f81614b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 -- 172.21.15.107:0/1352626923 >> 172.21.15.107:0/1352626923 conn(0x7fa4f806cd60 msgr2=0x7fa4f806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:41.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 -- 172.21.15.107:0/1352626923 shutdown_connections 2023-12-16T01:53:41.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.099+0000 7fa4fcacf640 1 -- 172.21.15.107:0/1352626923 wait complete. 2023-12-16T01:53:41.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 Processor -- start 2023-12-16T01:53:41.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 -- start start 2023-12-16T01:53:41.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4f8070ee0 0x7fa4f81e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:41.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8071c40 0x7fa4f81ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:41.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 0x7fa4f81efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:41.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f814af80 con 0x7fa4f814fd70 2023-12-16T01:53:41.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81f25d0 con 0x7fa4f8071c40 2023-12-16T01:53:41.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.101+0000 7fa4fcacf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f814c170 con 0x7fa4f8070ee0 2023-12-16T01:53:41.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.102+0000 7fa4f6d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 0x7fa4f81efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:41.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.102+0000 7fa4f6d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 0x7fa4f81efaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51900/0 (socket says 172.21.15.107:51900) 2023-12-16T01:53:41.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.102+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/970406542 learned_addr learned my addr 172.21.15.107:0/970406542 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:41.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.102+0000 7fa4f659c640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4f8070ee0 0x7fa4f81e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:41.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.102+0000 7fa4effff640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8071c40 0x7fa4f81ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:41.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.105+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4f8070ee0 msgr2=0x7fa4f81e2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.105+0000 7fa4f6d9d640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4f8070ee0 0x7fa4f81e2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.105+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8071c40 msgr2=0x7fa4f81ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.105+0000 7fa4f6d9d640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8071c40 0x7fa4f81ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.105+0000 7fa4f6d9d640 1 -- 172.21.15.107:0/970406542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f000ab80 con 0x7fa4f814fd70 2023-12-16T01:53:41.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.108+0000 7fa4f6d9d640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 0x7fa4f81efaf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0037040 tx=0x7fa4f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:41.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.111+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0040670 con 0x7fa4f814fd70 2023-12-16T01:53:41.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.111+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0040810 con 0x7fa4f814fd70 2023-12-16T01:53:41.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.111+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f81ef0b0 con 0x7fa4f814fd70 2023-12-16T01:53:41.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.111+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0040bc0 con 0x7fa4f814fd70 2023-12-16T01:53:41.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.111+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f81f2aa0 con 0x7fa4f814fd70 2023-12-16T01:53:41.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.112+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f81ef2d0 con 0x7fa4f814fd70 2023-12-16T01:53:41.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.141+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa4f0040d20 con 0x7fa4f814fd70 2023-12-16T01:53:41.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.142+0000 7fa4eeffd640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa4d806aec0 0x7fa4d806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:41.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.142+0000 7fa4f659c640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa4d806aec0 0x7fa4d806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:41.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.142+0000 7fa4f659c640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa4d806aec0 0x7fa4d806d380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8005880 tx=0x7fa4e8009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.391+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa4f007b8e0 con 0x7fa4f814fd70 2023-12-16T01:53:41.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.392+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa4f0077c20 con 0x7fa4f814fd70 2023-12-16T01:53:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.569+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4f81ef2d0 con 0x7fa4f814fd70 2023-12-16T01:53:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.606+0000 7fa4eeffd640 1 -- 172.21.15.107:0/970406542 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18553 (secure 0 0 0) 0x7fa4f81ef2d0 con 0x7fa4f814fd70 2023-12-16T01:53:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:41.609 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:26:31.279218+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa4d806aec0 msgr2=0x7fa4d806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa4d806aec0 0x7fa4d806d380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8005880 tx=0x7fa4e8009040 comp rx=0 tx=0).stop 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 msgr2=0x7fa4f81efaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 0x7fa4f81efaf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0037040 tx=0x7fa4f0004a40 comp rx=0 tx=0).stop 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 shutdown_connections 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f814fd70 0x7fa4f81efaf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa4d806aec0 0x7fa4d806d380 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f8071c40 0x7fa4f81ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 --2- 172.21.15.107:0/970406542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4f8070ee0 0x7fa4f81e2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 >> 172.21.15.107:0/970406542 conn(0x7fa4f806cd60 msgr2=0x7fa4f8145710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 shutdown_connections 2023-12-16T01:53:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:41.609+0000 7fa4fcacf640 1 -- 172.21.15.107:0/970406542 wait complete. 2023-12-16T01:53:42.623 INFO:tasks.ceph:Scrubbing osd.0 2023-12-16T01:53:42.624 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:42.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.727+0000 7f2977a7c640 1 Processor -- start 2023-12-16T01:53:42.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.727+0000 7f2977a7c640 1 -- start start 2023-12-16T01:53:42.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.728+0000 7f2977a7c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2970151660 0x7f2970157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.728+0000 7f2977a7c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29700c8fa0 0x7f29700c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.728+0000 7f2977a7c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2970151a40 con 0x7f29700c9430 2023-12-16T01:53:42.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.728+0000 7f2977a7c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700c2c10 con 0x7f29700c8fa0 2023-12-16T01:53:42.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.728+0000 7f2977a7c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700c2eb0 con 0x7f2970151660 2023-12-16T01:53:42.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.729+0000 7f2975017640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29700c8fa0 0x7f29700c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.729+0000 7f2975818640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2970151660 0x7f2970157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.729+0000 7f2975017640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29700c8fa0 0x7f29700c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51902/0 (socket says 172.21.15.107:51902) 2023-12-16T01:53:42.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.729+0000 7f2975017640 1 -- 172.21.15.107:0/172931468 learned_addr learned my addr 172.21.15.107:0/172931468 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:42.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.731+0000 7f2975017640 1 -- 172.21.15.107:0/172931468 >> v2:172.21.15.157:3300/0 conn(0x7f2970151660 msgr2=0x7f2970157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:42.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.731+0000 7f2975017640 1 --2- 172.21.15.107:0/172931468 >> v2:172.21.15.157:3300/0 conn(0x7f2970151660 0x7f2970157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.731+0000 7f2975017640 1 -- 172.21.15.107:0/172931468 >> v1:172.21.15.157:6789/0 conn(0x7f29700c9430 legacy=0x7f29700c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.731+0000 7f2975017640 1 -- 172.21.15.107:0/172931468 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700c3190 con 0x7f29700c8fa0 2023-12-16T01:53:42.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.733+0000 7f2975017640 1 --2- 172.21.15.107:0/172931468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c8fa0 0x7f29700c1db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2970071a80 tx=0x7f296002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1f60334d500137 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.736+0000 7f2974816640 1 -- 172.21.15.107:0/172931468 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296002f850 con 0x7f29700c8fa0 2023-12-16T01:53:42.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.736+0000 7f2974816640 1 -- 172.21.15.107:0/172931468 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296002f9b0 con 0x7f29700c8fa0 2023-12-16T01:53:42.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.736+0000 7f2974816640 1 -- 172.21.15.107:0/172931468 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296002fd40 con 0x7f29700c8fa0 2023-12-16T01:53:42.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 -- 172.21.15.107:0/172931468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c8fa0 msgr2=0x7f29700c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 --2- 172.21.15.107:0/172931468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c8fa0 0x7f29700c1db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2970071a80 tx=0x7f296002ba30 comp rx=0 tx=0).stop 2023-12-16T01:53:42.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 -- 172.21.15.107:0/172931468 shutdown_connections 2023-12-16T01:53:42.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 --2- 172.21.15.107:0/172931468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c8fa0 0x7f29700c1db0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 --2- 172.21.15.107:0/172931468 >> v2:172.21.15.157:3300/0 conn(0x7f2970151660 0x7f2970157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 -- 172.21.15.107:0/172931468 >> 172.21.15.107:0/172931468 conn(0x7f29700ccd90 msgr2=0x7f29700cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 -- 172.21.15.107:0/172931468 shutdown_connections 2023-12-16T01:53:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.737+0000 7f2977a7c640 1 -- 172.21.15.107:0/172931468 wait complete. 2023-12-16T01:53:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 Processor -- start 2023-12-16T01:53:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 -- start start 2023-12-16T01:53:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29700c8fa0 0x7f297015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c9430 0x7f297015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2970151660 0x7f29701ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c5310 con 0x7f29700c9430 2023-12-16T01:53:42.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701ed040 con 0x7f29700c8fa0 2023-12-16T01:53:42.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.739+0000 7f2977a7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c4790 con 0x7f2970151660 2023-12-16T01:53:42.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.740+0000 7f2975017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c9430 0x7f297015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.740+0000 7f2975017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c9430 0x7f297015add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51914/0 (socket says 172.21.15.107:51914) 2023-12-16T01:53:42.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.740+0000 7f2975017640 1 -- 172.21.15.107:0/1756155162 learned_addr learned my addr 172.21.15.107:0/1756155162 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:42.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.740+0000 7f2975818640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29700c8fa0 0x7f297015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.740+0000 7f2976019640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2970151660 0x7f29701ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.743+0000 7f2975017640 1 -- 172.21.15.107:0/1756155162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2970151660 msgr2=0x7f29701ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.743+0000 7f2975017640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2970151660 0x7f29701ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.743+0000 7f2975017640 1 -- 172.21.15.107:0/1756155162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29700c8fa0 msgr2=0x7f297015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.743+0000 7f2975017640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29700c8fa0 0x7f297015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.743+0000 7f2975017640 1 -- 172.21.15.107:0/1756155162 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600094d0 con 0x7f29700c9430 2023-12-16T01:53:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.746+0000 7f2975017640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c9430 0x7f297015add0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2960000c00 tx=0x7f29600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.749+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296003b040 con 0x7f29700c9430 2023-12-16T01:53:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.749+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960037c60 con 0x7f29700c9430 2023-12-16T01:53:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.749+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960042480 con 0x7f29700c9430 2023-12-16T01:53:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.749+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700c4a70 con 0x7f29700c9430 2023-12-16T01:53:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.749+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700c5030 con 0x7f29700c9430 2023-12-16T01:53:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.750+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29700c3750 con 0x7f29700c9430 2023-12-16T01:53:42.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.769+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f29600425e0 con 0x7f29700c9430 2023-12-16T01:53:42.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.769+0000 7f29667fc640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f295406ae90 0x7f295406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.769+0000 7f2975818640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f295406ae90 0x7f295406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.770+0000 7f2975818640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f295406ae90 0x7f295406d350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f296c011340 tx=0x7f296c00b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.771+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f296007bd40 con 0x7f29700c9430 2023-12-16T01:53:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.772+0000 7f29667fc640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f29540744f0 0x7f2954076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.772+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 --> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2954077060 con 0x7f29540744f0 2023-12-16T01:53:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.772+0000 7f2976019640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f29540744f0 0x7f2954076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.772+0000 7f2976019640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f29540744f0 0x7f2954076990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.773+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== osd.0 v2:172.21.15.107:6824/1495769768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2954077060 con 0x7f29540744f0 2023-12-16T01:53:42.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.774+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2960078080 con 0x7f29700c9430 2023-12-16T01:53:42.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.786+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 --> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f29701ed1b0 con 0x7f29540744f0 2023-12-16T01:53:42.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.786+0000 7f29667fc640 1 -- 172.21.15.107:0/1756155162 <== osd.0 v2:172.21.15.107:6824/1495769768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f29701ed1b0 con 0x7f29540744f0 2023-12-16T01:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f29540744f0 msgr2=0x7f2954076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6824/1495769768,v1:172.21.15.107:6825/1495769768] conn(0x7f29540744f0 0x7f2954076990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f295406ae90 msgr2=0x7f295406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f295406ae90 0x7f295406d350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f296c011340 tx=0x7f296c00b040 comp rx=0 tx=0).stop 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c9430 msgr2=0x7f297015add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 --2- 172.21.15.107:0/1756155162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29700c9430 0x7f297015add0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2960000c00 tx=0x7f29600046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2976019640 1 -- 172.21.15.107:0/1756155162 reap_dead start 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 shutdown_connections 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 >> 172.21.15.107:0/1756155162 conn(0x7f29700ccd90 msgr2=0x7f29700c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 shutdown_connections 2023-12-16T01:53:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.787+0000 7f2977a7c640 1 -- 172.21.15.107:0/1756155162 wait complete. 2023-12-16T01:53:42.799 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-16T01:53:42.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.898+0000 7fcaf51c9640 1 Processor -- start 2023-12-16T01:53:42.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.898+0000 7fcaf51c9640 1 -- start start 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaf51c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcaf0153be0 0x7fcaf0159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaf51c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf006fa00 0x7fcaf00c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaf51c9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcaf00c5e60 0x7fcaf00c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaf51c9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00c3340 con 0x7fcaf0153be0 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaf51c9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf0153fc0 con 0x7fcaf00c5e60 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaf51c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf006b7b0 con 0x7fcaf006fa00 2023-12-16T01:53:42.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.899+0000 7fcaeed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcaf0153be0 0x7fcaf0159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.900+0000 7fcaeed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcaf0153be0 0x7fcaf0159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51916/0 (socket says 172.21.15.107:51916) 2023-12-16T01:53:42.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.900+0000 7fcaeed9d640 1 -- 172.21.15.107:0/3619080346 learned_addr learned my addr 172.21.15.107:0/3619080346 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:42.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.900+0000 7fcaef59e640 1 --2- 172.21.15.107:0/3619080346 >> v2:172.21.15.157:3300/0 conn(0x7fcaf00c5e60 0x7fcaf00c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.900+0000 7fcaee59c640 1 --2- 172.21.15.107:0/3619080346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf006fa00 0x7fcaf00c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.902+0000 7fcaeed9d640 1 -- 172.21.15.107:0/3619080346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf006fa00 msgr2=0x7fcaf00c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:42.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.902+0000 7fcaeed9d640 1 --2- 172.21.15.107:0/3619080346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf006fa00 0x7fcaf00c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.902+0000 7fcaeed9d640 1 -- 172.21.15.107:0/3619080346 >> v2:172.21.15.157:3300/0 conn(0x7fcaf00c5e60 msgr2=0x7fcaf00c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:42.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.902+0000 7fcaeed9d640 1 --2- 172.21.15.107:0/3619080346 >> v2:172.21.15.157:3300/0 conn(0x7fcaf00c5e60 0x7fcaf00c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.902+0000 7fcaeed9d640 1 -- 172.21.15.107:0/3619080346 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf006ba90 con 0x7fcaf0153be0 2023-12-16T01:53:42.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.904+0000 7fcaeed9d640 1 --2- 172.21.15.107:0/3619080346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf0153be0 0x7fcaf0159890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcaf015a990 tx=0x7fcae002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5db66e5b7300e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.906+0000 7fcaedd9b640 1 -- 172.21.15.107:0/3619080346 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0031870 con 0x7fcaf0153be0 2023-12-16T01:53:42.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.907+0000 7fcaedd9b640 1 -- 172.21.15.107:0/3619080346 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00319d0 con 0x7fcaf0153be0 2023-12-16T01:53:42.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.907+0000 7fcaedd9b640 1 -- 172.21.15.107:0/3619080346 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0031d60 con 0x7fcaf0153be0 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 -- 172.21.15.107:0/3619080346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf0153be0 msgr2=0x7fcaf0159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/3619080346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf0153be0 0x7fcaf0159890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcaf015a990 tx=0x7fcae002b910 comp rx=0 tx=0).stop 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 -- 172.21.15.107:0/3619080346 shutdown_connections 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/3619080346 >> v2:172.21.15.157:3300/0 conn(0x7fcaf00c5e60 0x7fcaf00c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/3619080346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf006fa00 0x7fcaf00c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/3619080346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf0153be0 0x7fcaf0159890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 -- 172.21.15.107:0/3619080346 >> 172.21.15.107:0/3619080346 conn(0x7fcaf00c7f60 msgr2=0x7fcaf00c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 -- 172.21.15.107:0/3619080346 shutdown_connections 2023-12-16T01:53:42.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.908+0000 7fcaf51c9640 1 -- 172.21.15.107:0/3619080346 wait complete. 2023-12-16T01:53:42.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.910+0000 7fcaf51c9640 1 Processor -- start 2023-12-16T01:53:42.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.910+0000 7fcaf51c9640 1 -- start start 2023-12-16T01:53:42.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.910+0000 7fcaf51c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf006fa00 0x7fcaf014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaf51c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 0x7fcaf00cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaf51c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf0153be0 0x7fcaf01f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaf51c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf015a7b0 con 0x7fcaf00c5e60 2023-12-16T01:53:42.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaf51c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01ef3d0 con 0x7fcaf006fa00 2023-12-16T01:53:42.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaf51c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0159c30 con 0x7fcaf0153be0 2023-12-16T01:53:42.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaee59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 0x7fcaf00cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaee59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 0x7fcaf00cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51926/0 (socket says 172.21.15.107:51926) 2023-12-16T01:53:42.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaee59c640 1 -- 172.21.15.107:0/1861054524 learned_addr learned my addr 172.21.15.107:0/1861054524 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:42.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaef59e640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf0153be0 0x7fcaf01f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.911+0000 7fcaeed9d640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf006fa00 0x7fcaf014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.915+0000 7fcaee59c640 1 -- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf0153be0 msgr2=0x7fcaf01f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.915+0000 7fcaee59c640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf0153be0 0x7fcaf01f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.915+0000 7fcaee59c640 1 -- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf006fa00 msgr2=0x7fcaf014e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:42.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.915+0000 7fcaee59c640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf006fa00 0x7fcaf014e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:42.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.915+0000 7fcaee59c640 1 -- 172.21.15.107:0/1861054524 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00094d0 con 0x7fcaf00c5e60 2023-12-16T01:53:42.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.917+0000 7fcaee59c640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 0x7fcaf00cac30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcae400e860 tx=0x7fcae400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.921+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40095f0 con 0x7fcaf00c5e60 2023-12-16T01:53:42.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.921+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae400c940 con 0x7fcaf00c5e60 2023-12-16T01:53:42.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.921+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf0159f10 con 0x7fcaf00c5e60 2023-12-16T01:53:42.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.921+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae400ccd0 con 0x7fcaf00c5e60 2023-12-16T01:53:42.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.921+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf015a4d0 con 0x7fcaf00c5e60 2023-12-16T01:53:42.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.922+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf0067500 con 0x7fcaf00c5e60 2023-12-16T01:53:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.940+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fcae4013470 con 0x7fcaf00c5e60 2023-12-16T01:53:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.940+0000 7fcad77fe640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcadc06ae40 0x7fcadc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.941+0000 7fcaeed9d640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcadc06ae40 0x7fcadc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:42.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.941+0000 7fcaeed9d640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcadc06ae40 0x7fcadc06d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcae0036000 tx=0x7fcae003c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:42.943+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcae400ce30 con 0x7fcaf00c5e60 2023-12-16T01:53:43.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.173+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fcae40551c0 con 0x7fcaf00c5e60 2023-12-16T01:53:43.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.349+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaf006ef20 con 0x7fcadc06ae40 2023-12-16T01:53:43.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.349+0000 7fcad77fe640 1 -- 172.21.15.107:0/1861054524 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcae0031670 con 0x7fcadc06ae40 2023-12-16T01:53:43.351 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.351+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcadc06ae40 msgr2=0x7fcadc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.351+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcadc06ae40 0x7fcadc06d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcae0036000 tx=0x7fcae003c040 comp rx=0 tx=0).stop 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.351+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 msgr2=0x7fcaf00cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.351+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 0x7fcaf00cac30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcae400e860 tx=0x7fcae400ed20 comp rx=0 tx=0).stop 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 shutdown_connections 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcaf0153be0 0x7fcaf01f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf00c5e60 0x7fcaf00cac30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fcadc06ae40 0x7fcadc06d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 --2- 172.21.15.107:0/1861054524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf006fa00 0x7fcaf014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 >> 172.21.15.107:0/1861054524 conn(0x7fcaf00c7f60 msgr2=0x7fcaf006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:43.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 shutdown_connections 2023-12-16T01:53:43.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.352+0000 7fcaf51c9640 1 -- 172.21.15.107:0/1861054524 wait complete. 2023-12-16T01:53:43.365 INFO:tasks.ceph:Scrubbing osd.1 2023-12-16T01:53:43.365 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:43.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.466+0000 7fbc5fb48640 1 Processor -- start 2023-12-16T01:53:43.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.466+0000 7fbc5fb48640 1 -- start start 2023-12-16T01:53:43.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.467+0000 7fbc5fb48640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc580c85e0 0x7fbc5806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.467+0000 7fbc5fb48640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 0x7fbc580c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.467+0000 7fbc5fb48640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc580c2930 con 0x7fbc5806dd70 2023-12-16T01:53:43.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.467+0000 7fbc5fb48640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5806e690 con 0x7fbc580c85e0 2023-12-16T01:53:43.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.467+0000 7fbc5fb48640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580c3130 con 0x7fbc5806ea30 2023-12-16T01:53:43.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.468+0000 7fbc5e0e5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 0x7fbc580c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.468+0000 7fbc5d0e3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc580c85e0 0x7fbc5806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.468+0000 7fbc5e0e5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 0x7fbc580c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:32794/0 (socket says 172.21.15.107:32794) 2023-12-16T01:53:43.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.468+0000 7fbc5d8e4640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbc5806dd70 0x7fbc5806f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:51348/0 (socket says 172.21.15.107:51348) 2023-12-16T01:53:43.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.468+0000 7fbc5e0e5640 1 -- 172.21.15.107:0/2423816457 learned_addr learned my addr 172.21.15.107:0/2423816457 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:43.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.471+0000 7fbc5e0e5640 1 -- 172.21.15.107:0/2423816457 >> v2:172.21.15.157:3300/0 conn(0x7fbc580c85e0 msgr2=0x7fbc5806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:43.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.471+0000 7fbc5e0e5640 1 --2- 172.21.15.107:0/2423816457 >> v2:172.21.15.157:3300/0 conn(0x7fbc580c85e0 0x7fbc5806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.471+0000 7fbc5e0e5640 1 -- 172.21.15.107:0/2423816457 >> v1:172.21.15.157:6789/0 conn(0x7fbc5806dd70 legacy=0x7fbc5806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.471+0000 7fbc5e0e5640 1 -- 172.21.15.107:0/2423816457 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc580c8150 con 0x7fbc5806ea30 2023-12-16T01:53:43.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.473+0000 7fbc5e0e5640 1 --2- 172.21.15.107:0/2423816457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 0x7fbc580c23f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009e50 tx=0x7fbc5002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af7f4d3f5f569410 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5c8e2640 1 -- 172.21.15.107:0/2423816457 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5002caf0 con 0x7fbc5806ea30 2023-12-16T01:53:43.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5c8e2640 1 -- 172.21.15.107:0/2423816457 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5002cc50 con 0x7fbc5806ea30 2023-12-16T01:53:43.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5c8e2640 1 -- 172.21.15.107:0/2423816457 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500343f0 con 0x7fbc5806ea30 2023-12-16T01:53:43.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 -- 172.21.15.107:0/2423816457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 msgr2=0x7fbc580c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 --2- 172.21.15.107:0/2423816457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 0x7fbc580c23f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009e50 tx=0x7fbc5002bf50 comp rx=0 tx=0).stop 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 -- 172.21.15.107:0/2423816457 shutdown_connections 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 --2- 172.21.15.107:0/2423816457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806ea30 0x7fbc580c23f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 --2- 172.21.15.107:0/2423816457 >> v2:172.21.15.157:3300/0 conn(0x7fbc580c85e0 0x7fbc5806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 -- 172.21.15.107:0/2423816457 >> 172.21.15.107:0/2423816457 conn(0x7fbc580cbf60 msgr2=0x7fbc580cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 -- 172.21.15.107:0/2423816457 shutdown_connections 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.477+0000 7fbc5fb48640 1 -- 172.21.15.107:0/2423816457 wait complete. 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.478+0000 7fbc5fb48640 1 Processor -- start 2023-12-16T01:53:43.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.478+0000 7fbc5fb48640 1 -- start start 2023-12-16T01:53:43.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.479+0000 7fbc5fb48640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806dd70 0x7fbc5814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.479+0000 7fbc5fb48640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5806ea30 0x7fbc5814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.479+0000 7fbc5fb48640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc580c85e0 0x7fbc5814b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.479+0000 7fbc5fb48640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5814d5c0 con 0x7fbc5806ea30 2023-12-16T01:53:43.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.479+0000 7fbc5fb48640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580c3490 con 0x7fbc580c85e0 2023-12-16T01:53:43.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.479+0000 7fbc5fb48640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580c3a10 con 0x7fbc5806dd70 2023-12-16T01:53:43.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.480+0000 7fbc5d0e3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5806ea30 0x7fbc5814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.480+0000 7fbc5e0e5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc580c85e0 0x7fbc5814b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.480+0000 7fbc5d8e4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806dd70 0x7fbc5814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.480+0000 7fbc5d0e3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5806ea30 0x7fbc5814b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51928/0 (socket says 172.21.15.107:51928) 2023-12-16T01:53:43.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.480+0000 7fbc5d0e3640 1 -- 172.21.15.107:0/711462474 learned_addr learned my addr 172.21.15.107:0/711462474 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:43.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.484+0000 7fbc5d0e3640 1 -- 172.21.15.107:0/711462474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806dd70 msgr2=0x7fbc5814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.484+0000 7fbc5d0e3640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc5806dd70 0x7fbc5814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.484+0000 7fbc5d0e3640 1 -- 172.21.15.107:0/711462474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc580c85e0 msgr2=0x7fbc5814b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.484+0000 7fbc5d0e3640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc580c85e0 0x7fbc5814b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.484+0000 7fbc5d0e3640 1 -- 172.21.15.107:0/711462474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009b30 con 0x7fbc5806ea30 2023-12-16T01:53:43.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.486+0000 7fbc5d0e3640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5806ea30 0x7fbc5814b070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800e870 tx=0x7fbc4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.489+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480094f0 con 0x7fbc5806ea30 2023-12-16T01:53:43.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.489+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4800c940 con 0x7fbc5806ea30 2023-12-16T01:53:43.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.489+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc580c3730 con 0x7fbc5806ea30 2023-12-16T01:53:43.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.489+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4800ccf0 con 0x7fbc5806ea30 2023-12-16T01:53:43.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.489+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc58152e50 con 0x7fbc5806ea30 2023-12-16T01:53:43.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.490+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc580c7b00 con 0x7fbc5806ea30 2023-12-16T01:53:43.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.509+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fbc48013470 con 0x7fbc5806ea30 2023-12-16T01:53:43.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.509+0000 7fbc4e7fc640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbc3c06ae90 0x7fbc3c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.509+0000 7fbc5d8e4640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbc3c06ae90 0x7fbc3c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.509+0000 7fbc5d8e4640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbc3c06ae90 0x7fbc3c06d350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007fd0 tx=0x7fbc54007e80 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.512+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbc480587a0 con 0x7fbc5806ea30 2023-12-16T01:53:43.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.512+0000 7fbc4e7fc640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7fbc3c0744f0 0x7fbc3c076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.512+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 --> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc3c077060 con 0x7fbc3c0744f0 2023-12-16T01:53:43.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.512+0000 7fbc5e0e5640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7fbc3c0744f0 0x7fbc3c076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.512+0000 7fbc5e0e5640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7fbc3c0744f0 0x7fbc3c076990 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.513+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== osd.1 v2:172.21.15.107:6808/2478942825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbc3c077060 con 0x7fbc3c0744f0 2023-12-16T01:53:43.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.513+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc48054ae0 con 0x7fbc5806ea30 2023-12-16T01:53:43.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.526+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 --> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc580c2e50 con 0x7fbc3c0744f0 2023-12-16T01:53:43.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.526+0000 7fbc4e7fc640 1 -- 172.21.15.107:0/711462474 <== osd.1 v2:172.21.15.107:6808/2478942825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbc5002c990 con 0x7fbc3c0744f0 2023-12-16T01:53:43.528 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:43.528 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:43.528 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:43.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7fbc3c0744f0 msgr2=0x7fbc3c076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6808/2478942825,v1:172.21.15.107:6810/2478942825] conn(0x7fbc3c0744f0 0x7fbc3c076990 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbc3c06ae90 msgr2=0x7fbc3c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbc3c06ae90 0x7fbc3c06d350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007fd0 tx=0x7fbc54007e80 comp rx=0 tx=0).stop 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5806ea30 msgr2=0x7fbc5814b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 --2- 172.21.15.107:0/711462474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5806ea30 0x7fbc5814b070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800e870 tx=0x7fbc4800ed30 comp rx=0 tx=0).stop 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5e0e5640 1 -- 172.21.15.107:0/711462474 reap_dead start 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 shutdown_connections 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 >> 172.21.15.107:0/711462474 conn(0x7fbc580cbf60 msgr2=0x7fbc58073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 shutdown_connections 2023-12-16T01:53:43.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.527+0000 7fbc5fb48640 1 -- 172.21.15.107:0/711462474 wait complete. 2023-12-16T01:53:43.539 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-16T01:53:43.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.638+0000 7f9bef1d5640 1 Processor -- start 2023-12-16T01:53:43.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.639+0000 7f9bef1d5640 1 -- start start 2023-12-16T01:53:43.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.639+0000 7f9bef1d5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9be815d950 0x7f9be815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.639+0000 7f9bef1d5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be815a700 con 0x7f9be8153890 2023-12-16T01:53:43.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.639+0000 7f9bef1d5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be80ca870 con 0x7f9be8153c70 2023-12-16T01:53:43.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.639+0000 7f9bef1d5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be815dd60 con 0x7f9be815d950 2023-12-16T01:53:43.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.640+0000 7f9becf71640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9be8153890 0x7f9be80c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55304/0 (socket says 172.21.15.107:55304) 2023-12-16T01:53:43.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.640+0000 7f9becf71640 1 -- 172.21.15.107:0/3310022588 learned_addr learned my addr 172.21.15.107:0/3310022588 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:43.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.640+0000 7f9bed772640 1 --2- 172.21.15.107:0/3310022588 >> v2:172.21.15.157:3300/0 conn(0x7f9be815d950 0x7f9be815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.642+0000 7f9be77fe640 1 -- 172.21.15.107:0/3310022588 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104816900 0 0) 0x7f9be815a700 con 0x7f9be8153890 2023-12-16T01:53:43.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.642+0000 7f9be77fe640 1 -- 172.21.15.107:0/3310022588 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd8003520 con 0x7f9be8153890 2023-12-16T01:53:43.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.644+0000 7f9bed772640 1 -- 172.21.15.107:0/3310022588 >> v1:172.21.15.157:6789/0 conn(0x7f9be8153c70 legacy=0x7f9be80ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.644+0000 7f9bed772640 1 -- 172.21.15.107:0/3310022588 >> v1:172.21.15.107:6789/0 conn(0x7f9be8153890 legacy=0x7f9be80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.644+0000 7f9bed772640 1 -- 172.21.15.107:0/3310022588 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8159af0 con 0x7f9be815d950 2023-12-16T01:53:43.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.650+0000 7f9bed772640 1 --2- 172.21.15.107:0/3310022588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be815d950 0x7f9be815aed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009d90 tx=0x7f9be002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f403dc3e82e8ef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9be77fe640 1 -- 172.21.15.107:0/3310022588 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be002cd80 con 0x7f9be815d950 2023-12-16T01:53:43.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9be77fe640 1 -- 172.21.15.107:0/3310022588 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be0034440 con 0x7f9be815d950 2023-12-16T01:53:43.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9be77fe640 1 -- 172.21.15.107:0/3310022588 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be00347d0 con 0x7f9be815d950 2023-12-16T01:53:43.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 -- 172.21.15.107:0/3310022588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be815d950 msgr2=0x7f9be815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/3310022588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be815d950 0x7f9be815aed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009d90 tx=0x7f9be002bfd0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 -- 172.21.15.107:0/3310022588 shutdown_connections 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/3310022588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be815d950 0x7f9be815aed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 -- 172.21.15.107:0/3310022588 >> 172.21.15.107:0/3310022588 conn(0x7f9be806ba00 msgr2=0x7f9be806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 -- 172.21.15.107:0/3310022588 shutdown_connections 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.654+0000 7f9bef1d5640 1 -- 172.21.15.107:0/3310022588 wait complete. 2023-12-16T01:53:43.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.656+0000 7f9bef1d5640 1 Processor -- start 2023-12-16T01:53:43.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.656+0000 7f9bef1d5640 1 -- start start 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.656+0000 7f9bef1d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 0x7f9be8149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.656+0000 7f9bef1d5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be8153c70 0x7f9be814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9bef1d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9be815d950 0x7f9be814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9bef1d5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be814a2a0 con 0x7f9be8153890 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9bef1d5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8155f70 con 0x7f9be8153c70 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9bef1d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be814f180 con 0x7f9be815d950 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9becf71640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 0x7f9be8149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9be7fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be8153c70 0x7f9be814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9becf71640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 0x7f9be8149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51944/0 (socket says 172.21.15.107:51944) 2023-12-16T01:53:43.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9becf71640 1 -- 172.21.15.107:0/1743245103 learned_addr learned my addr 172.21.15.107:0/1743245103 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:43.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.657+0000 7f9bed772640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9be815d950 0x7f9be814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.661+0000 7f9becf71640 1 -- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9be815d950 msgr2=0x7f9be814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.661+0000 7f9becf71640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9be815d950 0x7f9be814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.661+0000 7f9becf71640 1 -- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be8153c70 msgr2=0x7f9be814f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:43.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.661+0000 7f9becf71640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be8153c70 0x7f9be814f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:43.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.661+0000 7f9becf71640 1 -- 172.21.15.107:0/1743245103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0009a70 con 0x7f9be8153890 2023-12-16T01:53:43.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.661+0000 7f9be7fff640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be8153c70 0x7f9be814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T01:53:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.663+0000 7f9becf71640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 0x7f9be8149d60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c440 tx=0x7f9bdc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.667+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc005ce0 con 0x7f9be8153890 2023-12-16T01:53:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.667+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc005e40 con 0x7f9be8153890 2023-12-16T01:53:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.667+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0072b0 con 0x7f9be8153890 2023-12-16T01:53:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.667+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be8154580 con 0x7f9be8153890 2023-12-16T01:53:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.667+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be814e850 con 0x7f9be8153890 2023-12-16T01:53:43.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.668+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8067500 con 0x7f9be8153890 2023-12-16T01:53:43.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.913+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f9bdc007410 con 0x7f9be8153890 2023-12-16T01:53:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.914+0000 7f9be57fa640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bcc06ae40 0x7f9bcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.914+0000 7f9be7fff640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bcc06ae40 0x7f9bcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.914+0000 7f9be7fff640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bcc06ae40 0x7f9bcc06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9be8158190 tx=0x7f9bd4009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:43.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.940+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9bdc057e90 con 0x7f9be8153890 2023-12-16T01:53:43.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:43.940+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f9bdc057c60 con 0x7f9be8153890 2023-12-16T01:53:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.116+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9be80c9d70 con 0x7f9bcc06ae40 2023-12-16T01:53:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.117+0000 7f9be57fa640 1 -- 172.21.15.107:0/1743245103 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9be80c9d70 con 0x7f9bcc06ae40 2023-12-16T01:53:44.119 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2023-12-16T01:53:44.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bcc06ae40 msgr2=0x7f9bcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bcc06ae40 0x7f9bcc06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9be8158190 tx=0x7f9bd4009040 comp rx=0 tx=0).stop 2023-12-16T01:53:44.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 msgr2=0x7f9be8149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 0x7f9be8149d60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c440 tx=0x7f9bdc00c900 comp rx=0 tx=0).stop 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 shutdown_connections 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9be815d950 0x7f9be814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f9bcc06ae40 0x7f9bcc06d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9be8153c70 0x7f9be814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 --2- 172.21.15.107:0/1743245103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9be8153890 0x7f9be8149d60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 >> 172.21.15.107:0/1743245103 conn(0x7f9be806ba00 msgr2=0x7f9be815b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 shutdown_connections 2023-12-16T01:53:44.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.119+0000 7f9bef1d5640 1 -- 172.21.15.107:0/1743245103 wait complete. 2023-12-16T01:53:44.132 INFO:tasks.ceph:Scrubbing osd.2 2023-12-16T01:53:44.132 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.242+0000 7f247f73e640 1 Processor -- start 2023-12-16T01:53:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.242+0000 7f247f73e640 1 -- start start 2023-12-16T01:53:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.243+0000 7f247f73e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 0x7f247815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.243+0000 7f247f73e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f24780cafa0 0x7f247806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.243+0000 7f247f73e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247806b970 con 0x7f247815aa50 2023-12-16T01:53:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.243+0000 7f247f73e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247806c900 con 0x7f24780cafa0 2023-12-16T01:53:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.243+0000 7f247f73e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24780cb600 con 0x7f2478153900 2023-12-16T01:53:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.264+0000 7f247dcdb640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f247815aa50 0x7f24780cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55318/0 (socket says 172.21.15.107:55318) 2023-12-16T01:53:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.264+0000 7f247dcdb640 1 -- 172.21.15.107:0/593482789 learned_addr learned my addr 172.21.15.107:0/593482789 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.265+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610615330 0 0) 0x7f247806b970 con 0x7f247815aa50 2023-12-16T01:53:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.266+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2464003520 con 0x7f247815aa50 2023-12-16T01:53:44.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.267+0000 7f247d4da640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 0x7f247815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.269+0000 7f247ccd9640 1 --2- 172.21.15.107:0/593482789 >> v2:172.21.15.157:3300/0 conn(0x7f24780cafa0 0x7f247806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.269+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171896266 0 0) 0x7f2464003520 con 0x7f247815aa50 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 msgr2=0x7f247815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 0x7f247815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 >> v2:172.21.15.157:3300/0 conn(0x7f24780cafa0 msgr2=0x7f247806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 --2- 172.21.15.107:0/593482789 >> v2:172.21.15.157:3300/0 conn(0x7f24780cafa0 0x7f247806c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478153ce0 con 0x7f247815aa50 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7f24700019f0 con 0x7f247815aa50 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 >> v1:172.21.15.107:6789/0 conn(0x7f247815aa50 legacy=0x7f24780cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 0x7f2464003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2464003ff0 0x7f24640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2464004d00 0x7f2464005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247806c900 con 0x7f2464004d00 2023-12-16T01:53:44.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780cb600 con 0x7f2464003ff0 2023-12-16T01:53:44.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.270+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246400bbc0 con 0x7f2478153900 2023-12-16T01:53:44.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.272+0000 7f247ccd9640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2464003ff0 0x7f24640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.274+0000 7f247d4da640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 0x7f2464003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.274+0000 7f247dcdb640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2464004d00 0x7f2464005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.277+0000 7f247ccd9640 1 -- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 msgr2=0x7f2464003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:44.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.277+0000 7f247ccd9640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2478153900 0x7f2464003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.277+0000 7f247ccd9640 1 -- 172.21.15.107:0/593482789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2464004d00 msgr2=0x7f2464005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:44.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.277+0000 7f247ccd9640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2464004d00 0x7f2464005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.277+0000 7f247ccd9640 1 -- 172.21.15.107:0/593482789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464003520 con 0x7f2464003ff0 2023-12-16T01:53:44.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.279+0000 7f247ccd9640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2464003ff0 0x7f24640047c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f247400a970 tx=0x7f24640057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8532ce7480579f59 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.283+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474030620 con 0x7f2464003ff0 2023-12-16T01:53:44.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.283+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474030780 con 0x7f2464003ff0 2023-12-16T01:53:44.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.283+0000 7f246ffff640 1 -- 172.21.15.107:0/593482789 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474030bb0 con 0x7f2464003ff0 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247f73e640 1 -- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2464003ff0 msgr2=0x7f24640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247f73e640 1 --2- 172.21.15.107:0/593482789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2464003ff0 0x7f24640047c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f247400a970 tx=0x7f24640057f0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247dcdb640 1 -- 172.21.15.107:0/593482789 reap_dead start 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247f73e640 1 -- 172.21.15.107:0/593482789 shutdown_connections 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247f73e640 1 -- 172.21.15.107:0/593482789 >> 172.21.15.107:0/593482789 conn(0x7f2478061100 msgr2=0x7f2478061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247f73e640 1 -- 172.21.15.107:0/593482789 shutdown_connections 2023-12-16T01:53:44.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.284+0000 7f247f73e640 1 -- 172.21.15.107:0/593482789 wait complete. 2023-12-16T01:53:44.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.285+0000 7f247f73e640 1 Processor -- start 2023-12-16T01:53:44.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.285+0000 7f247f73e640 1 -- start start 2023-12-16T01:53:44.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247f73e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2464003ff0 0x7f24780c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247f73e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24780c4910 0x7f24781e5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247f73e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24781e58d0 0x7f247814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247f73e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781f30c0 con 0x7f24781e58d0 2023-12-16T01:53:44.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247f73e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781e50d0 con 0x7f24780c4910 2023-12-16T01:53:44.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247f73e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24781f2c30 con 0x7f2464003ff0 2023-12-16T01:53:44.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247ccd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24780c4910 0x7f24781e5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.286+0000 7f247d4da640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2464003ff0 0x7f24780c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.287+0000 7f247ccd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24780c4910 0x7f24781e5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44842/0 (socket says 172.21.15.107:44842) 2023-12-16T01:53:44.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.287+0000 7f247ccd9640 1 -- 172.21.15.107:0/2526906933 learned_addr learned my addr 172.21.15.107:0/2526906933 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:44.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.290+0000 7f247ccd9640 1 -- 172.21.15.107:0/2526906933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2464003ff0 msgr2=0x7f24780c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.290+0000 7f247ccd9640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2464003ff0 0x7f24780c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.290+0000 7f247ccd9640 1 -- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24781e58d0 msgr2=0x7f247814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.290+0000 7f247ccd9640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24781e58d0 0x7f247814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.290+0000 7f247ccd9640 1 -- 172.21.15.107:0/2526906933 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247815a540 con 0x7f24780c4910 2023-12-16T01:53:44.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.293+0000 7f247ccd9640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24780c4910 0x7f24781e5390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f247400a120 tx=0x7f24740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.297+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247403e040 con 0x7f24780c4910 2023-12-16T01:53:44.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.297+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474039860 con 0x7f24780c4910 2023-12-16T01:53:44.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.297+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24781f2300 con 0x7f24780c4910 2023-12-16T01:53:44.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.297+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474039c10 con 0x7f24780c4910 2023-12-16T01:53:44.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.297+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24781f28c0 con 0x7f24780c4910 2023-12-16T01:53:44.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.298+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f247806bbc0 con 0x7f24780c4910 2023-12-16T01:53:44.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.317+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f247404d3b0 con 0x7f24780c4910 2023-12-16T01:53:44.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.317+0000 7f246dffb640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f245c06aec0 0x7f245c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.317+0000 7f247d4da640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f245c06aec0 0x7f245c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.318+0000 7f247d4da640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f245c06aec0 0x7f245c06d380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2468006fd0 tx=0x7f2468008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.320+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f247404fe40 con 0x7f24780c4910 2023-12-16T01:53:44.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.320+0000 7f246dffb640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f245c074520 0x7f245c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.320+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 --> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f245c077090 con 0x7f245c074520 2023-12-16T01:53:44.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.321+0000 7f247dcdb640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f245c074520 0x7f245c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.321+0000 7f247dcdb640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f245c074520 0x7f245c0769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.321+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== osd.2 v2:172.21.15.107:6809/1376588586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f245c077090 con 0x7f245c074520 2023-12-16T01:53:44.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.339+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 --> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24781e50d0 con 0x7f245c074520 2023-12-16T01:53:44.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f246dffb640 1 -- 172.21.15.107:0/2526906933 <== osd.2 v2:172.21.15.107:6809/1376588586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f24781e50d0 con 0x7f245c074520 2023-12-16T01:53:44.342 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:44.342 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:44.342 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:44.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f245c074520 msgr2=0x7f245c0769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6809/1376588586,v1:172.21.15.107:6811/1376588586] conn(0x7f245c074520 0x7f245c0769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f245c06aec0 msgr2=0x7f245c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f245c06aec0 0x7f245c06d380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2468006fd0 tx=0x7f2468008040 comp rx=0 tx=0).stop 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24780c4910 msgr2=0x7f24781e5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 --2- 172.21.15.107:0/2526906933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24780c4910 0x7f24781e5390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f247400a120 tx=0x7f24740046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247dcdb640 1 -- 172.21.15.107:0/2526906933 reap_dead start 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 shutdown_connections 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 >> 172.21.15.107:0/2526906933 conn(0x7f2478061100 msgr2=0x7f24780cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 shutdown_connections 2023-12-16T01:53:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.340+0000 7f247f73e640 1 -- 172.21.15.107:0/2526906933 wait complete. 2023-12-16T01:53:44.353 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-16T01:53:44.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.452+0000 7ff353883640 1 Processor -- start 2023-12-16T01:53:44.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.452+0000 7ff353883640 1 -- start start 2023-12-16T01:53:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.453+0000 7ff353883640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff34c153890 0x7ff34c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.453+0000 7ff353883640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c15a700 con 0x7ff34c153c70 2023-12-16T01:53:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.453+0000 7ff353883640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0ca870 con 0x7ff34c0ceef0 2023-12-16T01:53:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.453+0000 7ff353883640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c159af0 con 0x7ff34c153890 2023-12-16T01:53:44.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.454+0000 7ff351e20640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff34c0ceef0 0x7ff34c15aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:51362/0 (socket says 172.21.15.107:51362) 2023-12-16T01:53:44.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.454+0000 7ff351e20640 1 -- 172.21.15.107:0/3045792252 learned_addr learned my addr 172.21.15.107:0/3045792252 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:44.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.454+0000 7ff35161f640 1 --2- 172.21.15.107:0/3045792252 >> v2:172.21.15.107:3300/0 conn(0x7ff34c153890 0x7ff34c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.456+0000 7ff343fff640 1 -- 172.21.15.107:0/3045792252 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385898253 0 0) 0x7ff34c0ca870 con 0x7ff34c0ceef0 2023-12-16T01:53:44.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.456+0000 7ff343fff640 1 -- 172.21.15.107:0/3045792252 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff338003520 con 0x7ff34c0ceef0 2023-12-16T01:53:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.457+0000 7ff35161f640 1 -- 172.21.15.107:0/3045792252 >> v1:172.21.15.157:6789/0 conn(0x7ff34c0ceef0 legacy=0x7ff34c15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.457+0000 7ff35161f640 1 -- 172.21.15.107:0/3045792252 >> v1:172.21.15.107:6789/0 conn(0x7ff34c153c70 legacy=0x7ff34c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.457+0000 7ff35161f640 1 -- 172.21.15.107:0/3045792252 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c159dd0 con 0x7ff34c153890 2023-12-16T01:53:44.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.461+0000 7ff35161f640 1 --2- 172.21.15.107:0/3045792252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c153890 0x7ff34c15d950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff348009d90 tx=0x7ff34802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3770eb26d09c2d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.464+0000 7ff343fff640 1 -- 172.21.15.107:0/3045792252 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34802cd80 con 0x7ff34c153890 2023-12-16T01:53:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.464+0000 7ff343fff640 1 -- 172.21.15.107:0/3045792252 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348034440 con 0x7ff34c153890 2023-12-16T01:53:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.464+0000 7ff343fff640 1 -- 172.21.15.107:0/3045792252 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3480347d0 con 0x7ff34c153890 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 -- 172.21.15.107:0/3045792252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c153890 msgr2=0x7ff34c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 --2- 172.21.15.107:0/3045792252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c153890 0x7ff34c15d950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff348009d90 tx=0x7ff34802bfd0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 -- 172.21.15.107:0/3045792252 shutdown_connections 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 --2- 172.21.15.107:0/3045792252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c153890 0x7ff34c15d950 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 -- 172.21.15.107:0/3045792252 >> 172.21.15.107:0/3045792252 conn(0x7ff34c06ba00 msgr2=0x7ff34c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 -- 172.21.15.107:0/3045792252 shutdown_connections 2023-12-16T01:53:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.465+0000 7ff353883640 1 -- 172.21.15.107:0/3045792252 wait complete. 2023-12-16T01:53:44.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 Processor -- start 2023-12-16T01:53:44.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 -- start start 2023-12-16T01:53:44.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 0x7ff34c1f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff34c153890 0x7ff34c0b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff34c153c70 0x7ff34c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0b5010 con 0x7ff34c0ceef0 2023-12-16T01:53:44.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0b4080 con 0x7ff34c153c70 2023-12-16T01:53:44.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.467+0000 7ff353883640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0b4640 con 0x7ff34c153890 2023-12-16T01:53:44.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.468+0000 7ff35161f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 0x7ff34c1f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.468+0000 7ff35161f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 0x7ff34c1f2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51986/0 (socket says 172.21.15.107:51986) 2023-12-16T01:53:44.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.468+0000 7ff35161f640 1 -- 172.21.15.107:0/3532137884 learned_addr learned my addr 172.21.15.107:0/3532137884 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.468+0000 7ff351e20640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff34c153c70 0x7ff34c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.468+0000 7ff350e1e640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff34c153890 0x7ff34c0b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.472+0000 7ff35161f640 1 -- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff34c153890 msgr2=0x7ff34c0b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.472+0000 7ff35161f640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff34c153890 0x7ff34c0b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.472+0000 7ff35161f640 1 -- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff34c153c70 msgr2=0x7ff34c0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.472+0000 7ff35161f640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff34c153c70 0x7ff34c0c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.472+0000 7ff35161f640 1 -- 172.21.15.107:0/3532137884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009a70 con 0x7ff34c0ceef0 2023-12-16T01:53:44.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.474+0000 7ff35161f640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 0x7ff34c1f2890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff348009eb0 tx=0x7ff348004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.477+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34803e610 con 0x7ff34c0ceef0 2023-12-16T01:53:44.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.477+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34803e790 con 0x7ff34c0ceef0 2023-12-16T01:53:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.477+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34803eb40 con 0x7ff34c0ceef0 2023-12-16T01:53:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.477+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c14ee90 con 0x7ff34c0ceef0 2023-12-16T01:53:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.478+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c14f410 con 0x7ff34c0ceef0 2023-12-16T01:53:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.479+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c067500 con 0x7ff34c0ceef0 2023-12-16T01:53:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.719+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff34803b050 con 0x7ff34c0ceef0 2023-12-16T01:53:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.719+0000 7ff341ffb640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff33006aec0 0x7ff33006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.720+0000 7ff350e1e640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff33006aec0 0x7ff33006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:44.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.720+0000 7ff350e1e640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff33006aec0 0x7ff33006d380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff34c1f3950 tx=0x7ff33c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:44.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.732+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff34807a530 con 0x7ff34c0ceef0 2023-12-16T01:53:44.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.732+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff348076870 con 0x7ff34c0ceef0 2023-12-16T01:53:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.900+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff34c1597a0 con 0x7ff33006aec0 2023-12-16T01:53:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.900+0000 7ff341ffb640 1 -- 172.21.15.107:0/3532137884 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff33c001d10 con 0x7ff33006aec0 2023-12-16T01:53:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff33006aec0 msgr2=0x7ff33006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff33006aec0 0x7ff33006d380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff34c1f3950 tx=0x7ff33c009040 comp rx=0 tx=0).stop 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 msgr2=0x7ff34c1f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 0x7ff34c1f2890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff348009eb0 tx=0x7ff348004a40 comp rx=0 tx=0).stop 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 shutdown_connections 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff33006aec0 0x7ff33006d380 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff34c153c70 0x7ff34c0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff34c153890 0x7ff34c0b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 --2- 172.21.15.107:0/3532137884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff34c0ceef0 0x7ff34c1f2890 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 >> 172.21.15.107:0/3532137884 conn(0x7ff34c06ba00 msgr2=0x7ff34c150430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 shutdown_connections 2023-12-16T01:53:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:44.902+0000 7ff353883640 1 -- 172.21.15.107:0/3532137884 wait complete. 2023-12-16T01:53:44.915 INFO:tasks.ceph:Scrubbing osd.3 2023-12-16T01:53:44.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.017+0000 7f53bf705640 1 Processor -- start 2023-12-16T01:53:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.017+0000 7f53bf705640 1 -- start start 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bf705640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b8151990 0x7f53b8060f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bf705640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b81578d0 con 0x7f53b81515b0 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bf705640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b8157bb0 con 0x7f53b80c5e60 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bf705640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80b7100 con 0x7f53b8151990 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bd4a1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f53b81515b0 0x7f53b80c4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55328/0 (socket says 172.21.15.107:55328) 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bd4a1640 1 -- 172.21.15.107:0/242720842 learned_addr learned my addr 172.21.15.107:0/242720842 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.018+0000 7f53bcca0640 1 --2- 172.21.15.107:0/242720842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b8151990 0x7f53b8060f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.020+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154392919 0 0) 0x7f53b8157bb0 con 0x7f53b80c5e60 2023-12-16T01:53:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.020+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a4003520 con 0x7f53b80c5e60 2023-12-16T01:53:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.021+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881156637 0 0) 0x7f53b81578d0 con 0x7f53b81515b0 2023-12-16T01:53:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.021+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b8157bb0 con 0x7f53b81515b0 2023-12-16T01:53:45.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.021+0000 7f53bcca0640 1 -- 172.21.15.107:0/242720842 >> v1:172.21.15.157:6789/0 conn(0x7f53b80c5e60 legacy=0x7f53b806ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.021+0000 7f53bcca0640 1 -- 172.21.15.107:0/242720842 >> v1:172.21.15.107:6789/0 conn(0x7f53b81515b0 legacy=0x7f53b80c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.021+0000 7f53bcca0640 1 -- 172.21.15.107:0/242720842 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8157e90 con 0x7f53b8151990 2023-12-16T01:53:45.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.023+0000 7f53bcca0640 1 --2- 172.21.15.107:0/242720842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b8151990 0x7f53b8060f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53a80097d0 tx=0x7f53a802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa19effe7165990 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.027+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8030880 con 0x7f53b8151990 2023-12-16T01:53:45.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.027+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a80309e0 con 0x7f53b8151990 2023-12-16T01:53:45.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.027+0000 7f53affff640 1 -- 172.21.15.107:0/242720842 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8030d70 con 0x7f53b8151990 2023-12-16T01:53:45.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 -- 172.21.15.107:0/242720842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b8151990 msgr2=0x7f53b8060f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 --2- 172.21.15.107:0/242720842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b8151990 0x7f53b8060f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53a80097d0 tx=0x7f53a802b9c0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 -- 172.21.15.107:0/242720842 shutdown_connections 2023-12-16T01:53:45.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 --2- 172.21.15.107:0/242720842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b8151990 0x7f53b8060f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 -- 172.21.15.107:0/242720842 >> 172.21.15.107:0/242720842 conn(0x7f53b80c7f60 msgr2=0x7f53b80c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 -- 172.21.15.107:0/242720842 shutdown_connections 2023-12-16T01:53:45.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.028+0000 7f53bf705640 1 -- 172.21.15.107:0/242720842 wait complete. 2023-12-16T01:53:45.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.029+0000 7f53bf705640 1 Processor -- start 2023-12-16T01:53:45.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.029+0000 7f53bf705640 1 -- start start 2023-12-16T01:53:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.030+0000 7f53bf705640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53b80c5e60 0x7f53b80c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.030+0000 7f53bf705640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b81515b0 0x7f53b8143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.030+0000 7f53bf705640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53b8151990 0x7f53b80c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.030+0000 7f53bf705640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80c3ba0 con 0x7f53b80c5e60 2023-12-16T01:53:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.030+0000 7f53bf705640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81e2ef0 con 0x7f53b8151990 2023-12-16T01:53:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.030+0000 7f53bf705640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81e2c30 con 0x7f53b81515b0 2023-12-16T01:53:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.031+0000 7f53bd4a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53b80c5e60 0x7f53b80c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.031+0000 7f53bd4a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53b80c5e60 0x7f53b80c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52000/0 (socket says 172.21.15.107:52000) 2023-12-16T01:53:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.031+0000 7f53bd4a1640 1 -- 172.21.15.107:0/525775170 learned_addr learned my addr 172.21.15.107:0/525775170 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.031+0000 7f53bcca0640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b81515b0 0x7f53b8143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.031+0000 7f53bdca2640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53b8151990 0x7f53b80c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.034+0000 7f53bd4a1640 1 -- 172.21.15.107:0/525775170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b81515b0 msgr2=0x7f53b8143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.034+0000 7f53bd4a1640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53b81515b0 0x7f53b8143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.034+0000 7f53bd4a1640 1 -- 172.21.15.107:0/525775170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53b8151990 msgr2=0x7f53b80c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.034+0000 7f53bd4a1640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53b8151990 0x7f53b80c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.034+0000 7f53bd4a1640 1 -- 172.21.15.107:0/525775170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a8009400 con 0x7f53b80c5e60 2023-12-16T01:53:45.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.036+0000 7f53bd4a1640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53b80c5e60 0x7f53b80c3660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53b400cbc0 tx=0x7f53b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.040+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400ad40 con 0x7f53b80c5e60 2023-12-16T01:53:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.040+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4012400 con 0x7f53b80c5e60 2023-12-16T01:53:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.040+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400aea0 con 0x7f53b80c5e60 2023-12-16T01:53:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.040+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b81f3ac0 con 0x7f53b80c5e60 2023-12-16T01:53:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.040+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b81e2400 con 0x7f53b80c5e60 2023-12-16T01:53:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.041+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53b80c52c0 con 0x7f53b80c5e60 2023-12-16T01:53:45.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.059+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f53b4007070 con 0x7f53b80c5e60 2023-12-16T01:53:45.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.060+0000 7f53adffb640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f539c06ae90 0x7f539c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.060+0000 7f53bcca0640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f539c06ae90 0x7f539c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.061+0000 7f53bcca0640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f539c06ae90 0x7f539c06d350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f53a8036000 tx=0x7f53a803b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.064+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f53b4058b90 con 0x7f53b80c5e60 2023-12-16T01:53:45.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.064+0000 7f53adffb640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f539c0744f0 0x7f539c076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.064+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 --> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f539c077060 con 0x7f539c0744f0 2023-12-16T01:53:45.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.064+0000 7f53bdca2640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f539c0744f0 0x7f539c076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.065+0000 7f53bdca2640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f539c0744f0 0x7f539c076990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.065+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== osd.3 v2:172.21.15.107:6800/2440758538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f539c077060 con 0x7f539c0744f0 2023-12-16T01:53:45.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.066+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53b4054ed0 con 0x7f53b80c5e60 2023-12-16T01:53:45.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.078+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 --> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f53b8158450 con 0x7f539c0744f0 2023-12-16T01:53:45.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.078+0000 7f53adffb640 1 -- 172.21.15.107:0/525775170 <== osd.3 v2:172.21.15.107:6800/2440758538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f53b0001450 con 0x7f539c0744f0 2023-12-16T01:53:45.080 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:45.081 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:45.081 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f539c0744f0 msgr2=0x7f539c076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6800/2440758538,v1:172.21.15.107:6801/2440758538] conn(0x7f539c0744f0 0x7f539c076990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f539c06ae90 msgr2=0x7f539c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f539c06ae90 0x7f539c06d350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f53a8036000 tx=0x7f53a803b040 comp rx=0 tx=0).stop 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53b80c5e60 msgr2=0x7f53b80c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 --2- 172.21.15.107:0/525775170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53b80c5e60 0x7f53b80c3660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53b400cbc0 tx=0x7f53b400a430 comp rx=0 tx=0).stop 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bdca2640 1 -- 172.21.15.107:0/525775170 reap_dead start 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 shutdown_connections 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 >> 172.21.15.107:0/525775170 conn(0x7f53b80c7f60 msgr2=0x7f53b8150110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 shutdown_connections 2023-12-16T01:53:45.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.079+0000 7f53bf705640 1 -- 172.21.15.107:0/525775170 wait complete. 2023-12-16T01:53:45.092 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-16T01:53:45.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.192+0000 7f2526f1d640 1 Processor -- start 2023-12-16T01:53:45.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.192+0000 7f2526f1d640 1 -- start start 2023-12-16T01:53:45.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.193+0000 7f2526f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f252006c000 0x7f252006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.193+0000 7f2526f1d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25200c4370 con 0x7f2520153c50 2023-12-16T01:53:45.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.193+0000 7f2526f1d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25200cb360 con 0x7f252006bc20 2023-12-16T01:53:45.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.193+0000 7f2526f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200cb640 con 0x7f252006c000 2023-12-16T01:53:45.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.194+0000 7f251ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2520153c50 0x7f25200c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55340/0 (socket says 172.21.15.107:55340) 2023-12-16T01:53:45.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.194+0000 7f251ffff640 1 -- 172.21.15.107:0/1792491849 learned_addr learned my addr 172.21.15.107:0/1792491849 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:45.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.194+0000 7f25254ba640 1 --2- 172.21.15.107:0/1792491849 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f252006c000 0x7f252006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084967651 0 0) 0x7f25200c4370 con 0x7f2520153c50 2023-12-16T01:53:45.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2508003520 con 0x7f2520153c50 2023-12-16T01:53:45.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478143948 0 0) 0x7f25200cb360 con 0x7f252006bc20 2023-12-16T01:53:45.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25200c4370 con 0x7f252006bc20 2023-12-16T01:53:45.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f25254ba640 1 -- 172.21.15.107:0/1792491849 >> v1:172.21.15.157:6789/0 conn(0x7f252006bc20 legacy=0x7f2520153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f25254ba640 1 -- 172.21.15.107:0/1792491849 >> v1:172.21.15.107:6789/0 conn(0x7f2520153c50 legacy=0x7f25200c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.196+0000 7f25254ba640 1 -- 172.21.15.107:0/1792491849 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200c3d20 con 0x7f252006c000 2023-12-16T01:53:45.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.199+0000 7f25254ba640 1 --2- 172.21.15.107:0/1792491849 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f252006c000 0x7f252006c9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2518009dc0 tx=0x7f251802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892a93c86ff0a9b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.203+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251802ccd0 con 0x7f252006c000 2023-12-16T01:53:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.203+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251802ce30 con 0x7f252006c000 2023-12-16T01:53:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.203+0000 7f251f7fe640 1 -- 172.21.15.107:0/1792491849 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518034660 con 0x7f252006c000 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 -- 172.21.15.107:0/1792491849 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f252006c000 msgr2=0x7f252006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1792491849 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f252006c000 0x7f252006c9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2518009dc0 tx=0x7f251802bf20 comp rx=0 tx=0).stop 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 -- 172.21.15.107:0/1792491849 shutdown_connections 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1792491849 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f252006c000 0x7f252006c9b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 -- 172.21.15.107:0/1792491849 >> 172.21.15.107:0/1792491849 conn(0x7f25200ceea0 msgr2=0x7f25200cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 -- 172.21.15.107:0/1792491849 shutdown_connections 2023-12-16T01:53:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.204+0000 7f2526f1d640 1 -- 172.21.15.107:0/1792491849 wait complete. 2023-12-16T01:53:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.205+0000 7f2526f1d640 1 Processor -- start 2023-12-16T01:53:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.205+0000 7f2526f1d640 1 -- start start 2023-12-16T01:53:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2526f1d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f252006bc20 0x7f25201542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2526f1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 0x7f25201ef150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2526f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2520153c50 0x7f25201ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2526f1d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25201f32c0 con 0x7f252006c000 2023-12-16T01:53:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2526f1d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520155310 con 0x7f252006bc20 2023-12-16T01:53:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2526f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252015a9c0 con 0x7f2520153c50 2023-12-16T01:53:45.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f251ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 0x7f25201ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f25254ba640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2520153c50 0x7f25201ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f2524cb9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f252006bc20 0x7f25201542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f251ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 0x7f25201ef150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52014/0 (socket says 172.21.15.107:52014) 2023-12-16T01:53:45.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.206+0000 7f251ffff640 1 -- 172.21.15.107:0/1206851281 learned_addr learned my addr 172.21.15.107:0/1206851281 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.210+0000 7f251ffff640 1 -- 172.21.15.107:0/1206851281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2520153c50 msgr2=0x7f25201ef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.210+0000 7f251ffff640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2520153c50 0x7f25201ef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.210+0000 7f251ffff640 1 -- 172.21.15.107:0/1206851281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f252006bc20 msgr2=0x7f25201542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.210+0000 7f251ffff640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f252006bc20 0x7f25201542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.210+0000 7f251ffff640 1 -- 172.21.15.107:0/1206851281 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009a70 con 0x7f252006c000 2023-12-16T01:53:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.212+0000 7f251ffff640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 0x7f25201ef150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f251400c410 tx=0x7f251400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.216+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514005ce0 con 0x7f252006c000 2023-12-16T01:53:45.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.216+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514005e40 con 0x7f252006c000 2023-12-16T01:53:45.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.216+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200ca510 con 0x7f252006c000 2023-12-16T01:53:45.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.216+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140072f0 con 0x7f252006c000 2023-12-16T01:53:45.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.216+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2520155560 con 0x7f252006c000 2023-12-16T01:53:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.217+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252015aee0 con 0x7f252006c000 2023-12-16T01:53:45.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.235+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2514007450 con 0x7f252006c000 2023-12-16T01:53:45.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.235+0000 7f251d7fa640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f250c06ae90 0x7f250c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.236+0000 7f2524cb9640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f250c06ae90 0x7f250c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.236+0000 7f2524cb9640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f250c06ae90 0x7f250c06d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f25100011e0 tx=0x7f2510009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.239+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2514057f20 con 0x7f252006c000 2023-12-16T01:53:45.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.476+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2514054260 con 0x7f252006c000 2023-12-16T01:53:45.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.648+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f252015b7d0 con 0x7f250c06ae90 2023-12-16T01:53:45.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.648+0000 7f251d7fa640 1 -- 172.21.15.107:0/1206851281 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f252015b7d0 con 0x7f250c06ae90 2023-12-16T01:53:45.650 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 3 to deep-scrub 2023-12-16T01:53:45.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f250c06ae90 msgr2=0x7f250c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f250c06ae90 0x7f250c06d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f25100011e0 tx=0x7f2510009040 comp rx=0 tx=0).stop 2023-12-16T01:53:45.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 msgr2=0x7f25201ef150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 0x7f25201ef150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f251400c410 tx=0x7f251400c8d0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 shutdown_connections 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2520153c50 0x7f25201ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f252006c000 0x7f25201ef150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f250c06ae90 0x7f250c06d350 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 --2- 172.21.15.107:0/1206851281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f252006bc20 0x7f25201542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 >> 172.21.15.107:0/1206851281 conn(0x7f25200ceea0 msgr2=0x7f25200cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 shutdown_connections 2023-12-16T01:53:45.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.650+0000 7f2526f1d640 1 -- 172.21.15.107:0/1206851281 wait complete. 2023-12-16T01:53:45.663 INFO:tasks.ceph:Scrubbing osd.4 2023-12-16T01:53:45.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:45.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 Processor -- start 2023-12-16T01:53:45.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 -- start start 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f660c153900 0x7f660c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 0x7f660c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f660c15aa50 0x7f660c0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c06b970 con 0x7f660c15aa50 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c06c900 con 0x7f660c153900 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.765+0000 7f6613251640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0cb600 con 0x7f660c0cafa0 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.766+0000 7f6610fed640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f660c153900 0x7f660c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.766+0000 7f660bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 0x7f660c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.766+0000 7f660bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 0x7f660c06c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:32900/0 (socket says 172.21.15.107:32900) 2023-12-16T01:53:45.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.766+0000 7f660bfff640 1 -- 172.21.15.107:0/3711818481 learned_addr learned my addr 172.21.15.107:0/3711818481 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:45.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.769+0000 7f660bfff640 1 -- 172.21.15.107:0/3711818481 >> v2:172.21.15.157:3300/0 conn(0x7f660c153900 msgr2=0x7f660c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:45.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.769+0000 7f660bfff640 1 --2- 172.21.15.107:0/3711818481 >> v2:172.21.15.157:3300/0 conn(0x7f660c153900 0x7f660c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.769+0000 7f660bfff640 1 -- 172.21.15.107:0/3711818481 >> v2:172.21.15.107:3300/0 conn(0x7f660c15aa50 msgr2=0x7f660c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:45.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.769+0000 7f660bfff640 1 --2- 172.21.15.107:0/3711818481 >> v2:172.21.15.107:3300/0 conn(0x7f660c15aa50 0x7f660c0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.769+0000 7f660bfff640 1 -- 172.21.15.107:0/3711818481 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c153ce0 con 0x7f660c0cafa0 2023-12-16T01:53:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.771+0000 7f660bfff640 1 --2- 172.21.15.107:0/3711818481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 0x7f660c06c3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f660c06cd30 tx=0x7f65f802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1f0ef5a5a2a405 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f660b7fe640 1 -- 172.21.15.107:0/3711818481 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8031870 con 0x7f660c0cafa0 2023-12-16T01:53:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f660b7fe640 1 -- 172.21.15.107:0/3711818481 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f80319d0 con 0x7f660c0cafa0 2023-12-16T01:53:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f660b7fe640 1 -- 172.21.15.107:0/3711818481 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8031d60 con 0x7f660c0cafa0 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 -- 172.21.15.107:0/3711818481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 msgr2=0x7f660c06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 --2- 172.21.15.107:0/3711818481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 0x7f660c06c3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f660c06cd30 tx=0x7f65f802b910 comp rx=0 tx=0).stop 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 -- 172.21.15.107:0/3711818481 shutdown_connections 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 --2- 172.21.15.107:0/3711818481 >> v2:172.21.15.107:3300/0 conn(0x7f660c15aa50 0x7f660c0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 --2- 172.21.15.107:0/3711818481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c0cafa0 0x7f660c06c3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 --2- 172.21.15.107:0/3711818481 >> v2:172.21.15.157:3300/0 conn(0x7f660c153900 0x7f660c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.776+0000 7f6613251640 1 -- 172.21.15.107:0/3711818481 >> 172.21.15.107:0/3711818481 conn(0x7f660c061100 msgr2=0x7f660c061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.777+0000 7f6613251640 1 -- 172.21.15.107:0/3711818481 shutdown_connections 2023-12-16T01:53:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.777+0000 7f6613251640 1 -- 172.21.15.107:0/3711818481 wait complete. 2023-12-16T01:53:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 Processor -- start 2023-12-16T01:53:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 -- start start 2023-12-16T01:53:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0cafa0 0x7f660c0c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f660c153900 0x7f660c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c15aa50 0x7f660c0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0c8f40 con 0x7f660c153900 2023-12-16T01:53:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1f3550 con 0x7f660c0cafa0 2023-12-16T01:53:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.778+0000 7f6613251640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1f3810 con 0x7f660c15aa50 2023-12-16T01:53:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.779+0000 7f660bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f660c153900 0x7f660c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.779+0000 7f660bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f660c153900 0x7f660c14d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52028/0 (socket says 172.21.15.107:52028) 2023-12-16T01:53:45.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.779+0000 7f660bfff640 1 -- 172.21.15.107:0/3090364283 learned_addr learned my addr 172.21.15.107:0/3090364283 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:45.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.779+0000 7f66117ee640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c15aa50 0x7f660c0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.779+0000 7f6610fed640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0cafa0 0x7f660c0c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.782+0000 7f660bfff640 1 -- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c15aa50 msgr2=0x7f660c0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.782+0000 7f660bfff640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f660c15aa50 0x7f660c0c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.782+0000 7f660bfff640 1 -- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0cafa0 msgr2=0x7f660c0c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.782+0000 7f660bfff640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0cafa0 0x7f660c0c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.782+0000 7f660bfff640 1 -- 172.21.15.107:0/3090364283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80094d0 con 0x7f660c153900 2023-12-16T01:53:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.785+0000 7f660bfff640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f660c153900 0x7f660c14d6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65f80090b0 tx=0x7f65f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.788+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f803abe0 con 0x7f660c153900 2023-12-16T01:53:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.788+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f803ad40 con 0x7f660c153900 2023-12-16T01:53:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.788+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c152f40 con 0x7f660c153900 2023-12-16T01:53:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.788+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8044630 con 0x7f660c153900 2023-12-16T01:53:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.788+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c159ed0 con 0x7f660c153900 2023-12-16T01:53:45.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.789+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f660c06bbc0 con 0x7f660c153900 2023-12-16T01:53:45.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.808+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f65f804d450 con 0x7f660c153900 2023-12-16T01:53:45.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.809+0000 7f66097fa640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f65f006aec0 0x7f65f006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.809+0000 7f6610fed640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f65f006aec0 0x7f65f006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.809+0000 7f6610fed640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f65f006aec0 0x7f65f006d380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6600009aa0 tx=0x7f6600009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.812+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f65f802d040 con 0x7f660c153900 2023-12-16T01:53:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.812+0000 7f66097fa640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7f65f0074520 0x7f65f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.812+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 --> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65f0077090 con 0x7f65f0074520 2023-12-16T01:53:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.813+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65f8076ec0 con 0x7f660c153900 2023-12-16T01:53:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.813+0000 7f66117ee640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7f65f0074520 0x7f65f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.813+0000 7f66117ee640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7f65f0074520 0x7f65f00769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.814+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== osd.4 v2:172.21.15.157:6800/2128955220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f65f0077090 con 0x7f65f0074520 2023-12-16T01:53:45.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.827+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 --> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f660c0c9fa0 con 0x7f65f0074520 2023-12-16T01:53:45.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.827+0000 7f66097fa640 1 -- 172.21.15.107:0/3090364283 <== osd.4 v2:172.21.15.157:6800/2128955220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f660400a4e0 con 0x7f65f0074520 2023-12-16T01:53:45.829 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:45.830 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:45.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7f65f0074520 msgr2=0x7f65f00769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.157:6800/2128955220,v1:172.21.15.157:6801/2128955220] conn(0x7f65f0074520 0x7f65f00769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f65f006aec0 msgr2=0x7f65f006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f65f006aec0 0x7f65f006d380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6600009aa0 tx=0x7f6600009190 comp rx=0 tx=0).stop 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f660c153900 msgr2=0x7f660c14d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 --2- 172.21.15.107:0/3090364283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f660c153900 0x7f660c14d6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65f80090b0 tx=0x7f65f80046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f66117ee640 1 -- 172.21.15.107:0/3090364283 reap_dead start 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 shutdown_connections 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 >> 172.21.15.107:0/3090364283 conn(0x7f660c061100 msgr2=0x7f660c152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 shutdown_connections 2023-12-16T01:53:45.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.828+0000 7f6613251640 1 -- 172.21.15.107:0/3090364283 wait complete. 2023-12-16T01:53:45.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-16T01:53:45.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.943+0000 7faaaab1d640 1 Processor -- start 2023-12-16T01:53:45.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.943+0000 7faaaab1d640 1 -- start start 2023-12-16T01:53:45.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.944+0000 7faaaab1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.944+0000 7faaaab1d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa415b9c0 con 0x7faaa4157f50 2023-12-16T01:53:45.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.944+0000 7faaaab1d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa415ab60 con 0x7faaa40c2000 2023-12-16T01:53:45.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.944+0000 7faaaab1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415ae40 con 0x7faaa4151630 2023-12-16T01:53:45.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.944+0000 7faaa3fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7faaa4157f50 0x7faaa40c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55348/0 (socket says 172.21.15.107:55348) 2023-12-16T01:53:45.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.944+0000 7faaa3fff640 1 -- 172.21.15.107:0/2937359386 learned_addr learned my addr 172.21.15.107:0/2937359386 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:45.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.945+0000 7faaa88b9640 1 --2- 172.21.15.107:0/2937359386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702738694 0 0) 0x7faaa415b9c0 con 0x7faaa4157f50 2023-12-16T01:53:45.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa94003520 con 0x7faaa4157f50 2023-12-16T01:53:45.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721367363 0 0) 0x7faaa415ab60 con 0x7faaa40c2000 2023-12-16T01:53:45.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa415b9c0 con 0x7faaa40c2000 2023-12-16T01:53:45.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa88b9640 1 -- 172.21.15.107:0/2937359386 >> v1:172.21.15.157:6789/0 conn(0x7faaa40c2000 legacy=0x7faaa40c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa88b9640 1 -- 172.21.15.107:0/2937359386 >> v1:172.21.15.107:6789/0 conn(0x7faaa4157f50 legacy=0x7faaa40c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.947+0000 7faaa88b9640 1 -- 172.21.15.107:0/2937359386 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa415b120 con 0x7faaa4151630 2023-12-16T01:53:45.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.950+0000 7faaa88b9640 1 --2- 172.21.15.107:0/2937359386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa406f590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa980097d0 tx=0x7faa9802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c527c516580c80 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.954+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98030880 con 0x7faaa4151630 2023-12-16T01:53:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.954+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa980309e0 con 0x7faaa4151630 2023-12-16T01:53:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.954+0000 7faaa37fe640 1 -- 172.21.15.107:0/2937359386 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98030d70 con 0x7faaa4151630 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 -- 172.21.15.107:0/2937359386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 msgr2=0x7faaa406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2937359386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa406f590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa980097d0 tx=0x7faa9802b9c0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 -- 172.21.15.107:0/2937359386 shutdown_connections 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2937359386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa406f590 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 -- 172.21.15.107:0/2937359386 >> 172.21.15.107:0/2937359386 conn(0x7faaa4061100 msgr2=0x7faaa40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 -- 172.21.15.107:0/2937359386 shutdown_connections 2023-12-16T01:53:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.955+0000 7faaaab1d640 1 -- 172.21.15.107:0/2937359386 wait complete. 2023-12-16T01:53:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.956+0000 7faaaab1d640 1 Processor -- start 2023-12-16T01:53:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.956+0000 7faaaab1d640 1 -- start start 2023-12-16T01:53:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaaab1d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40c2000 0x7faaa41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaaab1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaaab1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 0x7faaa414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaaab1d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40c6a10 con 0x7faaa4157f50 2023-12-16T01:53:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaaab1d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40c6130 con 0x7faaa40c2000 2023-12-16T01:53:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaaab1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4154180 con 0x7faaa4151630 2023-12-16T01:53:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaa90ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 0x7faaa414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.957+0000 7faaa3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.958+0000 7faaa88b9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40c2000 0x7faaa41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.958+0000 7faaa90ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 0x7faaa414cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52042/0 (socket says 172.21.15.107:52042) 2023-12-16T01:53:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.958+0000 7faaa90ba640 1 -- 172.21.15.107:0/2660117381 learned_addr learned my addr 172.21.15.107:0/2660117381 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.961+0000 7faaa90ba640 1 -- 172.21.15.107:0/2660117381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 msgr2=0x7faaa414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.961+0000 7faaa90ba640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa414c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.961+0000 7faaa90ba640 1 -- 172.21.15.107:0/2660117381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40c2000 msgr2=0x7faaa41547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.961+0000 7faaa90ba640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40c2000 0x7faaa41547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.961+0000 7faaa90ba640 1 -- 172.21.15.107:0/2660117381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009400 con 0x7faaa4157f50 2023-12-16T01:53:45.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.963+0000 7faaa90ba640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 0x7faaa414cbd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c790 tx=0x7faa9c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.966+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00cea0 con 0x7faaa4157f50 2023-12-16T01:53:45.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.966+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c003b70 con 0x7faaa4157f50 2023-12-16T01:53:45.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.966+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00a850 con 0x7faaa4157f50 2023-12-16T01:53:45.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.966+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa40c63c0 con 0x7faaa4157f50 2023-12-16T01:53:45.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.967+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa4152e60 con 0x7faaa4157f50 2023-12-16T01:53:45.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.967+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40740e0 con 0x7faaa4157f50 2023-12-16T01:53:45.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.986+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7faa9c00a9b0 con 0x7faaa4157f50 2023-12-16T01:53:45.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.986+0000 7faaa17fa640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa8806ae90 0x7faa8806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:45.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.986+0000 7faaa88b9640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa8806ae90 0x7faa8806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:45.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.987+0000 7faaa88b9640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa8806ae90 0x7faa8806d350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa98036000 tx=0x7faa98008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:45.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:45.989+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa9c058c50 con 0x7faaa4157f50 2023-12-16T01:53:46.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.224+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7faa9c054f90 con 0x7faaa4157f50 2023-12-16T01:53:46.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.411+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa4158390 con 0x7faa8806ae90 2023-12-16T01:53:46.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.411+0000 7faaa17fa640 1 -- 172.21.15.107:0/2660117381 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa98030b50 con 0x7faa8806ae90 2023-12-16T01:53:46.413 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 4 to deep-scrub 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa8806ae90 msgr2=0x7faa8806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa8806ae90 0x7faa8806d350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa98036000 tx=0x7faa98008030 comp rx=0 tx=0).stop 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 msgr2=0x7faaa414cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 0x7faaa414cbd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c790 tx=0x7faa9c00cc50 comp rx=0 tx=0).stop 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 shutdown_connections 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4157f50 0x7faaa414cbd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faaa4151630 0x7faaa414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7faa8806ae90 0x7faa8806d350 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 --2- 172.21.15.107:0/2660117381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40c2000 0x7faaa41547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.413+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 >> 172.21.15.107:0/2660117381 conn(0x7faaa4061100 msgr2=0x7faaa40c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.414+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 shutdown_connections 2023-12-16T01:53:46.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.414+0000 7faaaab1d640 1 -- 172.21.15.107:0/2660117381 wait complete. 2023-12-16T01:53:46.426 INFO:tasks.ceph:Scrubbing osd.5 2023-12-16T01:53:46.427 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:46.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.530+0000 7f90cc06b640 1 Processor -- start 2023-12-16T01:53:46.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.530+0000 7f90cc06b640 1 -- start start 2023-12-16T01:53:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.531+0000 7f90cc06b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c40c6ca0 0x7f90c4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.531+0000 7f90cc06b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f90c40c8580 0x7f90c40c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.531+0000 7f90cc06b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c4153c60 con 0x7f90c4153880 2023-12-16T01:53:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.531+0000 7f90cc06b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40c80f0 con 0x7f90c40c8580 2023-12-16T01:53:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.531+0000 7f90cc06b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40c8f50 con 0x7f90c40c6ca0 2023-12-16T01:53:46.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.556+0000 7f90c9e07640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f90c4153880 0x7f90c40cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55350/0 (socket says 172.21.15.107:55350) 2023-12-16T01:53:46.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.556+0000 7f90c9e07640 1 -- 172.21.15.107:0/1463457572 learned_addr learned my addr 172.21.15.107:0/1463457572 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:46.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.556+0000 7f90ca608640 1 --2- 172.21.15.107:0/1463457572 >> v2:172.21.15.107:3300/0 conn(0x7f90c40c8580 0x7f90c40c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.560+0000 7f90ca608640 1 -- 172.21.15.107:0/1463457572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c40c6ca0 msgr2=0x7f90c4159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:46.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.560+0000 7f90ca608640 1 --2- 172.21.15.107:0/1463457572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c40c6ca0 0x7f90c4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.560+0000 7f90ca608640 1 -- 172.21.15.107:0/1463457572 >> v1:172.21.15.107:6789/0 conn(0x7f90c4153880 legacy=0x7f90c40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.560+0000 7f90ca608640 1 -- 172.21.15.107:0/1463457572 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c40c1fc0 con 0x7f90c40c8580 2023-12-16T01:53:46.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.563+0000 7f90ca608640 1 --2- 172.21.15.107:0/1463457572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 0x7f90c40c8a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009d90 tx=0x7f90bc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3551399bfa2f231 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.568+0000 7f90c8e05640 1 -- 172.21.15.107:0/1463457572 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc02cce0 con 0x7f90c40c8580 2023-12-16T01:53:46.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.568+0000 7f90c8e05640 1 -- 172.21.15.107:0/1463457572 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc02ce40 con 0x7f90c40c8580 2023-12-16T01:53:46.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.568+0000 7f90c8e05640 1 -- 172.21.15.107:0/1463457572 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc034660 con 0x7f90c40c8580 2023-12-16T01:53:46.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 -- 172.21.15.107:0/1463457572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 msgr2=0x7f90c40c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 --2- 172.21.15.107:0/1463457572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 0x7f90c40c8a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009d90 tx=0x7f90bc02bf30 comp rx=0 tx=0).stop 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 -- 172.21.15.107:0/1463457572 shutdown_connections 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 --2- 172.21.15.107:0/1463457572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 0x7f90c40c8a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 --2- 172.21.15.107:0/1463457572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c40c6ca0 0x7f90c4159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 -- 172.21.15.107:0/1463457572 >> 172.21.15.107:0/1463457572 conn(0x7f90c406fa00 msgr2=0x7f90c406fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 -- 172.21.15.107:0/1463457572 shutdown_connections 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.569+0000 7f90cc06b640 1 -- 172.21.15.107:0/1463457572 wait complete. 2023-12-16T01:53:46.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.570+0000 7f90cc06b640 1 Processor -- start 2023-12-16T01:53:46.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.570+0000 7f90cc06b640 1 -- start start 2023-12-16T01:53:46.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.571+0000 7f90cc06b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c40c6ca0 0x7f90c40c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.571+0000 7f90cc06b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 0x7f90c41f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.571+0000 7f90cc06b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c4153880 0x7f90c41f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.571+0000 7f90cc06b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4153f00 con 0x7f90c40c8580 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.571+0000 7f90cc06b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4151550 con 0x7f90c40c6ca0 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.571+0000 7f90cc06b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4151830 con 0x7f90c4153880 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.572+0000 7f90ca608640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c4153880 0x7f90c41f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.572+0000 7f90c9e07640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c40c6ca0 0x7f90c40c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.572+0000 7f90ca608640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c4153880 0x7f90c41f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:32942/0 (socket says 172.21.15.107:32942) 2023-12-16T01:53:46.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.572+0000 7f90ca608640 1 -- 172.21.15.107:0/1537782687 learned_addr learned my addr 172.21.15.107:0/1537782687 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:46.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.575+0000 7f90c9606640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 0x7f90c41f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.576+0000 7f90ca608640 1 -- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c40c6ca0 msgr2=0x7f90c40c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.576+0000 7f90ca608640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c40c6ca0 0x7f90c40c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.576+0000 7f90ca608640 1 -- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 msgr2=0x7f90c41f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.576+0000 7f90ca608640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90c40c8580 0x7f90c41f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.576+0000 7f90ca608640 1 -- 172.21.15.107:0/1537782687 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009a70 con 0x7f90c4153880 2023-12-16T01:53:46.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.579+0000 7f90ca608640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c4153880 0x7f90c41f0470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009d90 tx=0x7f90bc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.583+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc03f680 con 0x7f90c4153880 2023-12-16T01:53:46.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.583+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc03f7e0 con 0x7f90c4153880 2023-12-16T01:53:46.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.583+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc03fb70 con 0x7f90c4153880 2023-12-16T01:53:46.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.583+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c4151b10 con 0x7f90c4153880 2023-12-16T01:53:46.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.583+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c41f3250 con 0x7f90c4153880 2023-12-16T01:53:46.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.584+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90c40c2860 con 0x7f90c4153880 2023-12-16T01:53:46.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.603+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f90bc03b040 con 0x7f90c4153880 2023-12-16T01:53:46.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.604+0000 7f90ba7fc640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f90a806ae90 0x7f90a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.604+0000 7f90c9e07640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f90a806ae90 0x7f90a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.604+0000 7f90c9e07640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f90a806ae90 0x7f90a806d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f90c0007fd0 tx=0x7f90c0007e80 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.607+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f90bc07b2e0 con 0x7f90c4153880 2023-12-16T01:53:46.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.607+0000 7f90ba7fc640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f90a80744f0 0x7f90a8076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.607+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 --> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90a8077060 con 0x7f90a80744f0 2023-12-16T01:53:46.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.608+0000 7f90c9606640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f90a80744f0 0x7f90a8076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.608+0000 7f90c9606640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f90a80744f0 0x7f90a8076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.609+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== osd.5 v2:172.21.15.157:6824/3619027731 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f90a8077060 con 0x7f90a80744f0 2023-12-16T01:53:46.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 --> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f90c40c2580 con 0x7f90a80744f0 2023-12-16T01:53:46.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90ba7fc640 1 -- 172.21.15.107:0/1537782687 <== osd.5 v2:172.21.15.157:6824/3619027731 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f90b400a380 con 0x7f90a80744f0 2023-12-16T01:53:46.624 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:46.624 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:46.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f90a80744f0 msgr2=0x7f90a8076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:6824/3619027731,v1:172.21.15.157:6825/3619027731] conn(0x7f90a80744f0 0x7f90a8076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f90a806ae90 msgr2=0x7f90a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f90a806ae90 0x7f90a806d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f90c0007fd0 tx=0x7f90c0007e80 comp rx=0 tx=0).stop 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c4153880 msgr2=0x7f90c41f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 --2- 172.21.15.107:0/1537782687 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c4153880 0x7f90c41f0470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009d90 tx=0x7f90bc004a40 comp rx=0 tx=0).stop 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90ca608640 1 -- 172.21.15.107:0/1537782687 reap_dead start 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 shutdown_connections 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.622+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 >> 172.21.15.107:0/1537782687 conn(0x7f90c406fa00 msgr2=0x7f90c40c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.623+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 shutdown_connections 2023-12-16T01:53:46.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.623+0000 7f90cc06b640 1 -- 172.21.15.107:0/1537782687 wait complete. 2023-12-16T01:53:46.635 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-16T01:53:46.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.734+0000 7f63cc009640 1 Processor -- start 2023-12-16T01:53:46.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.734+0000 7f63cc009640 1 -- start start 2023-12-16T01:53:46.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.735+0000 7f63cc009640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f63c4070d00 0x7f63c415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.735+0000 7f63cc009640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 0x7f63c4153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.735+0000 7f63cc009640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40ca6c0 con 0x7f63c40c7700 2023-12-16T01:53:46.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.735+0000 7f63cc009640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c415da60 con 0x7f63c4070d00 2023-12-16T01:53:46.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.735+0000 7f63cc009640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4159880 con 0x7f63c40710e0 2023-12-16T01:53:46.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.736+0000 7f63c95a4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 0x7f63c4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.736+0000 7f63c9da5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f63c4070d00 0x7f63c415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.736+0000 7f63c95a4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 0x7f63c4153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:32946/0 (socket says 172.21.15.107:32946) 2023-12-16T01:53:46.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.736+0000 7f63c95a4640 1 -- 172.21.15.107:0/4130392920 learned_addr learned my addr 172.21.15.107:0/4130392920 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:46.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.739+0000 7f63c95a4640 1 -- 172.21.15.107:0/4130392920 >> v2:172.21.15.157:3300/0 conn(0x7f63c4070d00 msgr2=0x7f63c415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:46.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.739+0000 7f63c95a4640 1 --2- 172.21.15.107:0/4130392920 >> v2:172.21.15.157:3300/0 conn(0x7f63c4070d00 0x7f63c415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.739+0000 7f63c95a4640 1 -- 172.21.15.107:0/4130392920 >> v1:172.21.15.157:6789/0 conn(0x7f63c40c7700 legacy=0x7f63c40c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.739+0000 7f63c95a4640 1 -- 172.21.15.107:0/4130392920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4159b60 con 0x7f63c40710e0 2023-12-16T01:53:46.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.741+0000 7f63c95a4640 1 --2- 172.21.15.107:0/4130392920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 0x7f63c4153380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009870 tx=0x7f63b402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9a19c7dfbd8d46 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.744+0000 7f63c8da3640 1 -- 172.21.15.107:0/4130392920 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b402f840 con 0x7f63c40710e0 2023-12-16T01:53:46.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.744+0000 7f63c8da3640 1 -- 172.21.15.107:0/4130392920 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b402f9a0 con 0x7f63c40710e0 2023-12-16T01:53:46.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.744+0000 7f63c8da3640 1 -- 172.21.15.107:0/4130392920 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b402fd30 con 0x7f63c40710e0 2023-12-16T01:53:46.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 -- 172.21.15.107:0/4130392920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 msgr2=0x7f63c4153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 --2- 172.21.15.107:0/4130392920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 0x7f63c4153380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009870 tx=0x7f63b402ba20 comp rx=0 tx=0).stop 2023-12-16T01:53:46.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 -- 172.21.15.107:0/4130392920 shutdown_connections 2023-12-16T01:53:46.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 --2- 172.21.15.107:0/4130392920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40710e0 0x7f63c4153380 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 --2- 172.21.15.107:0/4130392920 >> v2:172.21.15.157:3300/0 conn(0x7f63c4070d00 0x7f63c415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 -- 172.21.15.107:0/4130392920 >> 172.21.15.107:0/4130392920 conn(0x7f63c406ab30 msgr2=0x7f63c406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:46.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 -- 172.21.15.107:0/4130392920 shutdown_connections 2023-12-16T01:53:46.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.745+0000 7f63cc009640 1 -- 172.21.15.107:0/4130392920 wait complete. 2023-12-16T01:53:46.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.746+0000 7f63cc009640 1 Processor -- start 2023-12-16T01:53:46.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.746+0000 7f63cc009640 1 -- start start 2023-12-16T01:53:46.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.747+0000 7f63cc009640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 0x7f63c41eff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.747+0000 7f63cc009640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63c40710e0 0x7f63c414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.747+0000 7f63cc009640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40c7700 0x7f63c40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.747+0000 7f63cc009640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c414dfd0 con 0x7f63c40710e0 2023-12-16T01:53:46.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.747+0000 7f63cc009640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40c5120 con 0x7f63c4070d00 2023-12-16T01:53:46.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.747+0000 7f63cc009640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41f04c0 con 0x7f63c40c7700 2023-12-16T01:53:46.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.748+0000 7f63c9da5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 0x7f63c41eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.748+0000 7f63c9da5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 0x7f63c41eff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44922/0 (socket says 172.21.15.107:44922) 2023-12-16T01:53:46.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.748+0000 7f63c9da5640 1 -- 172.21.15.107:0/185247980 learned_addr learned my addr 172.21.15.107:0/185247980 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:46.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.749+0000 7f63c95a4640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63c40710e0 0x7f63c414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.749+0000 7f63ca5a6640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40c7700 0x7f63c40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.751+0000 7f63c9da5640 1 -- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40c7700 msgr2=0x7f63c40c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.751+0000 7f63c9da5640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40c7700 0x7f63c40c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.751+0000 7f63c9da5640 1 -- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63c40710e0 msgr2=0x7f63c414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:46.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.751+0000 7f63c9da5640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63c40710e0 0x7f63c414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:46.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.752+0000 7f63c9da5640 1 -- 172.21.15.107:0/185247980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40094d0 con 0x7f63c4070d00 2023-12-16T01:53:46.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.755+0000 7f63c9da5640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 0x7f63c41eff80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63c000efc0 tx=0x7f63c000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.761+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0014480 con 0x7f63c4070d00 2023-12-16T01:53:46.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.761+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000f040 con 0x7f63c4070d00 2023-12-16T01:53:46.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.761+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c40c53c0 con 0x7f63c4070d00 2023-12-16T01:53:46.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.761+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0014800 con 0x7f63c4070d00 2023-12-16T01:53:46.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.761+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c414f9d0 con 0x7f63c4070d00 2023-12-16T01:53:46.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.762+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4067500 con 0x7f63c4070d00 2023-12-16T01:53:46.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.780+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f63c0014960 con 0x7f63c4070d00 2023-12-16T01:53:46.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.780+0000 7f63ba7fc640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f63a806ae40 0x7f63a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:46.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.780+0000 7f63c95a4640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f63a806ae40 0x7f63a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:46.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.780+0000 7f63c95a4640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f63a806ae40 0x7f63a806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63b4036000 tx=0x7f63b4008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:46.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:46.782+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f63c0027e30 con 0x7f63c4070d00 2023-12-16T01:53:47.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.023+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f63c0055640 con 0x7f63c4070d00 2023-12-16T01:53:47.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.193+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f63c406d540 con 0x7f63a806ae40 2023-12-16T01:53:47.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.194+0000 7f63ba7fc640 1 -- 172.21.15.107:0/185247980 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f63c406d540 con 0x7f63a806ae40 2023-12-16T01:53:47.196 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 5 to deep-scrub 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f63a806ae40 msgr2=0x7f63a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f63a806ae40 0x7f63a806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63b4036000 tx=0x7f63b4008030 comp rx=0 tx=0).stop 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 msgr2=0x7f63c41eff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 0x7f63c41eff80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63c000efc0 tx=0x7f63c000c490 comp rx=0 tx=0).stop 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 shutdown_connections 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c40c7700 0x7f63c40c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63c40710e0 0x7f63c414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f63a806ae40 0x7f63a806d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 --2- 172.21.15.107:0/185247980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63c4070d00 0x7f63c41eff80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 >> 172.21.15.107:0/185247980 conn(0x7f63c406ab30 msgr2=0x7f63c406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:47.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 shutdown_connections 2023-12-16T01:53:47.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.196+0000 7f63cc009640 1 -- 172.21.15.107:0/185247980 wait complete. 2023-12-16T01:53:47.208 INFO:tasks.ceph:Scrubbing osd.6 2023-12-16T01:53:47.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:47.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.310+0000 7fd23e29b640 1 Processor -- start 2023-12-16T01:53:47.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.310+0000 7fd23e29b640 1 -- start start 2023-12-16T01:53:47.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.311+0000 7fd23e29b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd2380b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.311+0000 7fd23e29b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd2380cac80 0x7fd238168410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.311+0000 7fd23e29b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2380b2960 con 0x7fd2380ca860 2023-12-16T01:53:47.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.311+0000 7fd23e29b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2380b2f90 con 0x7fd2380cac80 2023-12-16T01:53:47.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.311+0000 7fd23e29b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380cb0e0 con 0x7fd23815e590 2023-12-16T01:53:47.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.312+0000 7fd23c838640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd2380cac80 0x7fd238168410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.312+0000 7fd23c838640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd2380cac80 0x7fd238168410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52084/0 (socket says 172.21.15.107:52084) 2023-12-16T01:53:47.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.312+0000 7fd23c838640 1 -- 172.21.15.107:0/2201916758 learned_addr learned my addr 172.21.15.107:0/2201916758 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:47.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.312+0000 7fd237fff640 1 --2- 172.21.15.107:0/2201916758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd2380b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.314+0000 7fd23c838640 1 -- 172.21.15.107:0/2201916758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 msgr2=0x7fd2380b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:47.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.314+0000 7fd23c838640 1 --2- 172.21.15.107:0/2201916758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd2380b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.314+0000 7fd23c838640 1 -- 172.21.15.107:0/2201916758 >> v1:172.21.15.157:6789/0 conn(0x7fd2380ca860 legacy=0x7fd2380cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.314+0000 7fd23c838640 1 -- 172.21.15.107:0/2201916758 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380b1ec0 con 0x7fd2380cac80 2023-12-16T01:53:47.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.316+0000 7fd23c838640 1 --2- 172.21.15.107:0/2201916758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380cac80 0x7fd238168410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd230009e80 tx=0x7fd23002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456301063825ab81 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.320+0000 7fd236ffd640 1 -- 172.21.15.107:0/2201916758 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23002ca50 con 0x7fd2380cac80 2023-12-16T01:53:47.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.320+0000 7fd236ffd640 1 -- 172.21.15.107:0/2201916758 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23002cbb0 con 0x7fd2380cac80 2023-12-16T01:53:47.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.320+0000 7fd236ffd640 1 -- 172.21.15.107:0/2201916758 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300343f0 con 0x7fd2380cac80 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 -- 172.21.15.107:0/2201916758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380cac80 msgr2=0x7fd238168410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 --2- 172.21.15.107:0/2201916758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380cac80 0x7fd238168410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd230009e80 tx=0x7fd23002beb0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 -- 172.21.15.107:0/2201916758 shutdown_connections 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 --2- 172.21.15.107:0/2201916758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380cac80 0x7fd238168410 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 --2- 172.21.15.107:0/2201916758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd2380b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 -- 172.21.15.107:0/2201916758 >> 172.21.15.107:0/2201916758 conn(0x7fd238061100 msgr2=0x7fd238061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 -- 172.21.15.107:0/2201916758 shutdown_connections 2023-12-16T01:53:47.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.321+0000 7fd23e29b640 1 -- 172.21.15.107:0/2201916758 wait complete. 2023-12-16T01:53:47.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.322+0000 7fd23e29b640 1 Processor -- start 2023-12-16T01:53:47.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.322+0000 7fd23e29b640 1 -- start start 2023-12-16T01:53:47.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.323+0000 7fd23e29b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380ca860 0x7fd238157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.323+0000 7fd23e29b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2380cac80 0x7fd23815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.323+0000 7fd23e29b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd23815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.323+0000 7fd23e29b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381f79c0 con 0x7fd2380ca860 2023-12-16T01:53:47.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.323+0000 7fd23e29b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380cd220 con 0x7fd2380cac80 2023-12-16T01:53:47.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.323+0000 7fd23e29b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23815d040 con 0x7fd23815e590 2023-12-16T01:53:47.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.324+0000 7fd237fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380ca860 0x7fd238157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.324+0000 7fd23c838640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd23815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.324+0000 7fd2377fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2380cac80 0x7fd23815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.324+0000 7fd237fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380ca860 0x7fd238157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52098/0 (socket says 172.21.15.107:52098) 2023-12-16T01:53:47.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.324+0000 7fd237fff640 1 -- 172.21.15.107:0/3906658844 learned_addr learned my addr 172.21.15.107:0/3906658844 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:47.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.327+0000 7fd237fff640 1 -- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 msgr2=0x7fd23815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.327+0000 7fd237fff640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd23815e590 0x7fd23815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.327+0000 7fd237fff640 1 -- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2380cac80 msgr2=0x7fd23815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.327+0000 7fd237fff640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2380cac80 0x7fd23815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.327+0000 7fd237fff640 1 -- 172.21.15.107:0/3906658844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230009b30 con 0x7fd2380ca860 2023-12-16T01:53:47.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.329+0000 7fd237fff640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380ca860 0x7fd238157190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd22800e9b0 tx=0x7fd22800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.333+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228009670 con 0x7fd2380ca860 2023-12-16T01:53:47.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.333+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800c9a0 con 0x7fd2380ca860 2023-12-16T01:53:47.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.333+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800cd50 con 0x7fd2380ca860 2023-12-16T01:53:47.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.333+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2381f6a60 con 0x7fd2380ca860 2023-12-16T01:53:47.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.333+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2381f7020 con 0x7fd2380ca860 2023-12-16T01:53:47.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.334+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2380b2bb0 con 0x7fd2380ca860 2023-12-16T01:53:47.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.353+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd228013470 con 0x7fd2380ca860 2023-12-16T01:53:47.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.353+0000 7fd234ff9640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd22406aec0 0x7fd22406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.353+0000 7fd2377fe640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd22406aec0 0x7fd22406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.353+0000 7fd2377fe640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd22406aec0 0x7fd22406d380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd2380b1650 tx=0x7fd22c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.356+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd2280588c0 con 0x7fd2380ca860 2023-12-16T01:53:47.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.356+0000 7fd234ff9640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7fd224074520 0x7fd2240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.356+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 --> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd224077090 con 0x7fd224074520 2023-12-16T01:53:47.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.356+0000 7fd23c838640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7fd224074520 0x7fd2240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.357+0000 7fd23c838640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7fd224074520 0x7fd2240769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.357+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd228004640 con 0x7fd2380ca860 2023-12-16T01:53:47.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.357+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== osd.6 v2:172.21.15.157:6808/3584434830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd224077090 con 0x7fd224074520 2023-12-16T01:53:47.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.370+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 --> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd2380b2480 con 0x7fd224074520 2023-12-16T01:53:47.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd234ff9640 1 -- 172.21.15.107:0/3906658844 <== osd.6 v2:172.21.15.157:6808/3584434830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd23002c9b0 con 0x7fd224074520 2023-12-16T01:53:47.373 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:47.373 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7fd224074520 msgr2=0x7fd2240769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.157:6808/3584434830,v1:172.21.15.157:6809/3584434830] conn(0x7fd224074520 0x7fd2240769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd22406aec0 msgr2=0x7fd22406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fd22406aec0 0x7fd22406d380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd2380b1650 tx=0x7fd22c009040 comp rx=0 tx=0).stop 2023-12-16T01:53:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380ca860 msgr2=0x7fd238157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 --2- 172.21.15.107:0/3906658844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2380ca860 0x7fd238157190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd22800e9b0 tx=0x7fd22800ee70 comp rx=0 tx=0).stop 2023-12-16T01:53:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23c838640 1 -- 172.21.15.107:0/3906658844 reap_dead start 2023-12-16T01:53:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 shutdown_connections 2023-12-16T01:53:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 >> 172.21.15.107:0/3906658844 conn(0x7fd238061100 msgr2=0x7fd2380c7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 shutdown_connections 2023-12-16T01:53:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.371+0000 7fd23e29b640 1 -- 172.21.15.107:0/3906658844 wait complete. 2023-12-16T01:53:47.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-16T01:53:47.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.482+0000 7f3751953640 1 Processor -- start 2023-12-16T01:53:47.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.482+0000 7f3751953640 1 -- start start 2023-12-16T01:53:47.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.482+0000 7f3751953640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f374c15d950 0x7f374c15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.482+0000 7f3751953640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c15a700 con 0x7f374c153c70 2023-12-16T01:53:47.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.482+0000 7f3751953640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0ca870 con 0x7f374c153890 2023-12-16T01:53:47.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.482+0000 7f3751953640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c15dd60 con 0x7f374c15d950 2023-12-16T01:53:47.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.483+0000 7f374affd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f374c153890 0x7f374c0c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:51406/0 (socket says 172.21.15.107:51406) 2023-12-16T01:53:47.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.483+0000 7f374affd640 1 -- 172.21.15.107:0/2091196441 learned_addr learned my addr 172.21.15.107:0/2091196441 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:47.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.483+0000 7f374b7fe640 1 --2- 172.21.15.107:0/2091196441 >> v2:172.21.15.107:3300/0 conn(0x7f374c15d950 0x7f374c15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.486+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753570801 0 0) 0x7f374c0ca870 con 0x7f374c153890 2023-12-16T01:53:47.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.486+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3738003520 con 0x7f374c153890 2023-12-16T01:53:47.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.487+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093494253 0 0) 0x7f374c15a700 con 0x7f374c153c70 2023-12-16T01:53:47.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.487+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f374c0ca870 con 0x7f374c153c70 2023-12-16T01:53:47.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.488+0000 7f374b7fe640 1 -- 172.21.15.107:0/2091196441 >> v1:172.21.15.157:6789/0 conn(0x7f374c153890 legacy=0x7f374c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.488+0000 7f374b7fe640 1 -- 172.21.15.107:0/2091196441 >> v1:172.21.15.107:6789/0 conn(0x7f374c153c70 legacy=0x7f374c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.488+0000 7f374b7fe640 1 -- 172.21.15.107:0/2091196441 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c159af0 con 0x7f374c15d950 2023-12-16T01:53:47.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.491+0000 7f374b7fe640 1 --2- 172.21.15.107:0/2091196441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c15d950 0x7f374c15aed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d90 tx=0x7f374402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c201075c9b1e515 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.497+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374402cd80 con 0x7f374c15d950 2023-12-16T01:53:47.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.497+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744034440 con 0x7f374c15d950 2023-12-16T01:53:47.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.497+0000 7f374a7fc640 1 -- 172.21.15.107:0/2091196441 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440347d0 con 0x7f374c15d950 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 -- 172.21.15.107:0/2091196441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c15d950 msgr2=0x7f374c15aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 --2- 172.21.15.107:0/2091196441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c15d950 0x7f374c15aed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d90 tx=0x7f374402bfd0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 -- 172.21.15.107:0/2091196441 shutdown_connections 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 --2- 172.21.15.107:0/2091196441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c15d950 0x7f374c15aed0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 -- 172.21.15.107:0/2091196441 >> 172.21.15.107:0/2091196441 conn(0x7f374c06ba00 msgr2=0x7f374c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 -- 172.21.15.107:0/2091196441 shutdown_connections 2023-12-16T01:53:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.498+0000 7f3751953640 1 -- 172.21.15.107:0/2091196441 wait complete. 2023-12-16T01:53:47.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.499+0000 7f3751953640 1 Processor -- start 2023-12-16T01:53:47.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 -- start start 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 0x7f374c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f374c153c70 0x7f374c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f374c15d950 0x7f374c1f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c155120 con 0x7f374c153890 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c14f700 con 0x7f374c15d950 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.500+0000 7f3751953640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c14f270 con 0x7f374c153c70 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.501+0000 7f374affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 0x7f374c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.501+0000 7f374affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 0x7f374c155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52114/0 (socket says 172.21.15.107:52114) 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.501+0000 7f374affd640 1 -- 172.21.15.107:0/565332047 learned_addr learned my addr 172.21.15.107:0/565332047 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.501+0000 7f374b7fe640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f374c15d950 0x7f374c1f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.501+0000 7f37427fc640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f374c153c70 0x7f374c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.504+0000 7f374affd640 1 -- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f374c153c70 msgr2=0x7f374c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.504+0000 7f374affd640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f374c153c70 0x7f374c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.504+0000 7f374affd640 1 -- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f374c15d950 msgr2=0x7f374c1f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.504+0000 7f374affd640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f374c15d950 0x7f374c1f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.504+0000 7f374affd640 1 -- 172.21.15.107:0/565332047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009a70 con 0x7f374c153890 2023-12-16T01:53:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.506+0000 7f374affd640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 0x7f374c155f40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f373c00c440 tx=0x7f373c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.510+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c005ce0 con 0x7f374c153890 2023-12-16T01:53:47.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.510+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c005e40 con 0x7f374c153890 2023-12-16T01:53:47.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.510+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c007270 con 0x7f374c153890 2023-12-16T01:53:47.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.510+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c0b5280 con 0x7f374c153890 2023-12-16T01:53:47.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.510+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c0cec80 con 0x7f374c153890 2023-12-16T01:53:47.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.511+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c067500 con 0x7f374c153890 2023-12-16T01:53:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.753+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f373c0073d0 con 0x7f374c153890 2023-12-16T01:53:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.753+0000 7f3748ff9640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f372c06ae90 0x7f372c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.753+0000 7f37427fc640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f372c06ae90 0x7f372c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.754+0000 7f37427fc640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f372c06ae90 0x7f372c06d350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3734007fd0 tx=0x7f3734009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:47.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.767+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f373c057dd0 con 0x7f374c153890 2023-12-16T01:53:47.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.767+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f373c054110 con 0x7f374c153890 2023-12-16T01:53:47.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.956+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f374c15a390 con 0x7f372c06ae90 2023-12-16T01:53:47.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.957+0000 7f3748ff9640 1 -- 172.21.15.107:0/565332047 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3734001470 con 0x7f372c06ae90 2023-12-16T01:53:47.959 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 6 to deep-scrub 2023-12-16T01:53:47.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f372c06ae90 msgr2=0x7f372c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f372c06ae90 0x7f372c06d350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3734007fd0 tx=0x7f3734009040 comp rx=0 tx=0).stop 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 msgr2=0x7f374c155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 0x7f374c155f40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f373c00c440 tx=0x7f373c00c900 comp rx=0 tx=0).stop 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 shutdown_connections 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f372c06ae90 0x7f372c06d350 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f374c15d950 0x7f374c1f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f374c153c70 0x7f374c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 --2- 172.21.15.107:0/565332047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f374c153890 0x7f374c155f40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 >> 172.21.15.107:0/565332047 conn(0x7f374c06ba00 msgr2=0x7f374c15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 shutdown_connections 2023-12-16T01:53:47.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:47.959+0000 7f3751953640 1 -- 172.21.15.107:0/565332047 wait complete. 2023-12-16T01:53:47.972 INFO:tasks.ceph:Scrubbing osd.7 2023-12-16T01:53:47.972 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.073+0000 7f62b2023640 1 Processor -- start 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.073+0000 7f62b2023640 1 -- start start 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.074+0000 7f62b2023640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f62ac156810 0x7f62ac06f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.074+0000 7f62b2023640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac06f690 con 0x7f62ac14fab0 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.074+0000 7f62b2023640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0c8230 con 0x7f62ac070f50 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.074+0000 7f62b2023640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac0c0a50 con 0x7f62ac156810 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.074+0000 7f62abfff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f62ac070f50 0x7f62ac0c75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:51416/0 (socket says 172.21.15.107:51416) 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.074+0000 7f62abfff640 1 -- 172.21.15.107:0/2336464356 learned_addr learned my addr 172.21.15.107:0/2336464356 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:48.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.075+0000 7f62aaffd640 1 --2- 172.21.15.107:0/2336464356 >> v2:172.21.15.107:3300/0 conn(0x7f62ac156810 0x7f62ac06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.077+0000 7f62aa7fc640 1 -- 172.21.15.107:0/2336464356 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886380929 0 0) 0x7f62ac0c8230 con 0x7f62ac070f50 2023-12-16T01:53:48.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.077+0000 7f62aa7fc640 1 -- 172.21.15.107:0/2336464356 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6294003520 con 0x7f62ac070f50 2023-12-16T01:53:48.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.079+0000 7f62aaffd640 1 -- 172.21.15.107:0/2336464356 >> v1:172.21.15.157:6789/0 conn(0x7f62ac070f50 legacy=0x7f62ac0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.079+0000 7f62aaffd640 1 -- 172.21.15.107:0/2336464356 >> v1:172.21.15.107:6789/0 conn(0x7f62ac14fab0 legacy=0x7f62ac156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.079+0000 7f62aaffd640 1 -- 172.21.15.107:0/2336464356 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0c1380 con 0x7f62ac156810 2023-12-16T01:53:48.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.083+0000 7f62aaffd640 1 --2- 172.21.15.107:0/2336464356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 0x7f62ac06f150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f629c0097a0 tx=0x7f629c02ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3304770c09d73e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.086+0000 7f62aa7fc640 1 -- 172.21.15.107:0/2336464356 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c02e830 con 0x7f62ac156810 2023-12-16T01:53:48.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.086+0000 7f62aa7fc640 1 -- 172.21.15.107:0/2336464356 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c02e990 con 0x7f62ac156810 2023-12-16T01:53:48.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.086+0000 7f62aa7fc640 1 -- 172.21.15.107:0/2336464356 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c02ed20 con 0x7f62ac156810 2023-12-16T01:53:48.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 -- 172.21.15.107:0/2336464356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 msgr2=0x7f62ac06f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 --2- 172.21.15.107:0/2336464356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 0x7f62ac06f150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f629c0097a0 tx=0x7f629c02ca70 comp rx=0 tx=0).stop 2023-12-16T01:53:48.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 -- 172.21.15.107:0/2336464356 shutdown_connections 2023-12-16T01:53:48.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 --2- 172.21.15.107:0/2336464356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 0x7f62ac06f150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 -- 172.21.15.107:0/2336464356 >> 172.21.15.107:0/2336464356 conn(0x7f62ac06cd60 msgr2=0x7f62ac06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:48.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 -- 172.21.15.107:0/2336464356 shutdown_connections 2023-12-16T01:53:48.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.087+0000 7f62b2023640 1 -- 172.21.15.107:0/2336464356 wait complete. 2023-12-16T01:53:48.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.088+0000 7f62b2023640 1 Processor -- start 2023-12-16T01:53:48.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 -- start start 2023-12-16T01:53:48.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac070f50 0x7f62ac0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac14fab0 0x7f62ac1ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 0x7f62ac142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac155ce0 con 0x7f62ac156810 2023-12-16T01:53:48.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac1ee9b0 con 0x7f62ac14fab0 2023-12-16T01:53:48.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.089+0000 7f62b2023640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac1de610 con 0x7f62ac070f50 2023-12-16T01:53:48.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.090+0000 7f62aaffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac14fab0 0x7f62ac1ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.090+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac070f50 0x7f62ac0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.090+0000 7f62abfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 0x7f62ac142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.090+0000 7f62aaffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac14fab0 0x7f62ac1ea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:44956/0 (socket says 172.21.15.107:44956) 2023-12-16T01:53:48.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.090+0000 7f62aaffd640 1 -- 172.21.15.107:0/383349425 learned_addr learned my addr 172.21.15.107:0/383349425 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:48.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.094+0000 7f62aaffd640 1 -- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac070f50 msgr2=0x7f62ac0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.094+0000 7f62aaffd640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac070f50 0x7f62ac0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.094+0000 7f62aaffd640 1 -- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 msgr2=0x7f62ac142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.094+0000 7f62aaffd640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62ac156810 0x7f62ac142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.094+0000 7f62aaffd640 1 -- 172.21.15.107:0/383349425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009400 con 0x7f62ac14fab0 2023-12-16T01:53:48.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.096+0000 7f62aaffd640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac14fab0 0x7f62ac1ea9e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f629c02d080 tx=0x7f629c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.100+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c03c040 con 0x7f62ac14fab0 2023-12-16T01:53:48.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.100+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c038a00 con 0x7f62ac14fab0 2023-12-16T01:53:48.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.100+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac1e0660 con 0x7f62ac14fab0 2023-12-16T01:53:48.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.100+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c038db0 con 0x7f62ac14fab0 2023-12-16T01:53:48.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.100+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac1de330 con 0x7f62ac14fab0 2023-12-16T01:53:48.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.101+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62ac0c1be0 con 0x7f62ac14fab0 2023-12-16T01:53:48.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.120+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f629c04a450 con 0x7f62ac14fab0 2023-12-16T01:53:48.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.121+0000 7f6293fff640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f629806ae90 0x7f629806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.121+0000 7f62ab7fe640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f629806ae90 0x7f629806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.121+0000 7f62ab7fe640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f629806ae90 0x7f629806d350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001780 tx=0x7f62a0009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.124+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f629c07ca20 con 0x7f62ac14fab0 2023-12-16T01:53:48.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.124+0000 7f6293fff640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7f62980744f0 0x7f6298076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.124+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 --> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6298077060 con 0x7f62980744f0 2023-12-16T01:53:48.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.124+0000 7f62abfff640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7f62980744f0 0x7f6298076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.124+0000 7f62abfff640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7f62980744f0 0x7f6298076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.125+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f629c078d60 con 0x7f62ac14fab0 2023-12-16T01:53:48.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.125+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== osd.7 v2:172.21.15.157:6810/1425748971 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6298077060 con 0x7f62980744f0 2023-12-16T01:53:48.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 --> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62ac0c1900 con 0x7f62980744f0 2023-12-16T01:53:48.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f6293fff640 1 -- 172.21.15.107:0/383349425 <== osd.7 v2:172.21.15.157:6810/1425748971 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f62a4002010 con 0x7f62980744f0 2023-12-16T01:53:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-12-16T01:53:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T01:53:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-12-16T01:53:48.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7f62980744f0 msgr2=0x7f6298076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:6810/1425748971,v1:172.21.15.157:6812/1425748971] conn(0x7f62980744f0 0x7f6298076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f629806ae90 msgr2=0x7f629806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f629806ae90 0x7f629806d350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001780 tx=0x7f62a0009040 comp rx=0 tx=0).stop 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac14fab0 msgr2=0x7f62ac1ea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 --2- 172.21.15.107:0/383349425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac14fab0 0x7f62ac1ea9e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f629c02d080 tx=0x7f629c0046c0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62abfff640 1 -- 172.21.15.107:0/383349425 reap_dead start 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 shutdown_connections 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.138+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 >> 172.21.15.107:0/383349425 conn(0x7f62ac06cd60 msgr2=0x7f62ac144850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.139+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 shutdown_connections 2023-12-16T01:53:48.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.139+0000 7f62b2023640 1 -- 172.21.15.107:0/383349425 wait complete. 2023-12-16T01:53:48.151 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-16T01:53:48.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.250+0000 7efc4f790640 1 Processor -- start 2023-12-16T01:53:48.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.250+0000 7efc4f790640 1 -- start start 2023-12-16T01:53:48.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.251+0000 7efc4f790640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efc4814cc60 0x7efc480bff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.251+0000 7efc4f790640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc48072490 0x7efc480c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.251+0000 7efc4f790640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480caed0 con 0x7efc480c58e0 2023-12-16T01:53:48.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.251+0000 7efc4f790640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc48156770 con 0x7efc48072490 2023-12-16T01:53:48.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.251+0000 7efc4f790640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc480c0ee0 con 0x7efc4814cc60 2023-12-16T01:53:48.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.252+0000 7efc4cd2b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efc480c58e0 0x7efc48156b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55382/0 (socket says 172.21.15.107:55382) 2023-12-16T01:53:48.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.252+0000 7efc4cd2b640 1 -- 172.21.15.107:0/1062938408 learned_addr learned my addr 172.21.15.107:0/1062938408 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:48.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.252+0000 7efc4dd2d640 1 --2- 172.21.15.107:0/1062938408 >> v2:172.21.15.107:3300/0 conn(0x7efc48072490 0x7efc480c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.252+0000 7efc4d52c640 1 --2- 172.21.15.107:0/1062938408 >> v2:172.21.15.157:3300/0 conn(0x7efc4814cc60 0x7efc480bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.255+0000 7efc4d52c640 1 -- 172.21.15.107:0/1062938408 >> v2:172.21.15.107:3300/0 conn(0x7efc48072490 msgr2=0x7efc480c17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:48.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.255+0000 7efc4d52c640 1 --2- 172.21.15.107:0/1062938408 >> v2:172.21.15.107:3300/0 conn(0x7efc48072490 0x7efc480c17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.255+0000 7efc4d52c640 1 -- 172.21.15.107:0/1062938408 >> v1:172.21.15.107:6789/0 conn(0x7efc480c58e0 legacy=0x7efc48156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.255+0000 7efc4d52c640 1 -- 172.21.15.107:0/1062938408 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc480cb170 con 0x7efc4814cc60 2023-12-16T01:53:48.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.257+0000 7efc4d52c640 1 --2- 172.21.15.107:0/1062938408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc480bff00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc4806da50 tx=0x7efc4402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cfbddd68353a55b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc3ffff640 1 -- 172.21.15.107:0/1062938408 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4402cc80 con 0x7efc4814cc60 2023-12-16T01:53:48.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc3ffff640 1 -- 172.21.15.107:0/1062938408 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4402cde0 con 0x7efc4814cc60 2023-12-16T01:53:48.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc3ffff640 1 -- 172.21.15.107:0/1062938408 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44034660 con 0x7efc4814cc60 2023-12-16T01:53:48.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc4f790640 1 -- 172.21.15.107:0/1062938408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 msgr2=0x7efc480bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc4f790640 1 --2- 172.21.15.107:0/1062938408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc480bff00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc4806da50 tx=0x7efc4402bed0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc4f790640 1 -- 172.21.15.107:0/1062938408 shutdown_connections 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc4f790640 1 --2- 172.21.15.107:0/1062938408 >> v2:172.21.15.107:3300/0 conn(0x7efc48072490 0x7efc480c17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc4f790640 1 --2- 172.21.15.107:0/1062938408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc480bff00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.261+0000 7efc4f790640 1 -- 172.21.15.107:0/1062938408 >> 172.21.15.107:0/1062938408 conn(0x7efc4806cd60 msgr2=0x7efc4806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.262+0000 7efc4f790640 1 -- 172.21.15.107:0/1062938408 shutdown_connections 2023-12-16T01:53:48.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.262+0000 7efc4f790640 1 -- 172.21.15.107:0/1062938408 wait complete. 2023-12-16T01:53:48.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 Processor -- start 2023-12-16T01:53:48.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 -- start start 2023-12-16T01:53:48.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48072490 0x7efc481dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480c58e0 0x7efc481ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc48148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48155650 con 0x7efc48072490 2023-12-16T01:53:48.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481ed2b0 con 0x7efc4814cc60 2023-12-16T01:53:48.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.263+0000 7efc4f790640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc481df6d0 con 0x7efc480c58e0 2023-12-16T01:53:48.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.264+0000 7efc4d52c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48072490 0x7efc481dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.264+0000 7efc4d52c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48072490 0x7efc481dffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52152/0 (socket says 172.21.15.107:52152) 2023-12-16T01:53:48.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.264+0000 7efc4d52c640 1 -- 172.21.15.107:0/2063900219 learned_addr learned my addr 172.21.15.107:0/2063900219 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:48.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.264+0000 7efc4cd2b640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480c58e0 0x7efc481ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.264+0000 7efc4dd2d640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc48148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.268+0000 7efc4dd2d640 1 -- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480c58e0 msgr2=0x7efc481ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.268+0000 7efc4dd2d640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480c58e0 0x7efc481ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.268+0000 7efc4dd2d640 1 -- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48072490 msgr2=0x7efc481dffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.268+0000 7efc4dd2d640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48072490 0x7efc481dffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.268+0000 7efc4dd2d640 1 -- 172.21.15.107:0/2063900219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44009a70 con 0x7efc4814cc60 2023-12-16T01:53:48.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.270+0000 7efc4dd2d640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc48148830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc4000e820 tx=0x7efc4000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.274+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000c730 con 0x7efc4814cc60 2023-12-16T01:53:48.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.274+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4000c8b0 con 0x7efc4814cc60 2023-12-16T01:53:48.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.274+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000cc60 con 0x7efc4814cc60 2023-12-16T01:53:48.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.274+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc481ecf60 con 0x7efc4814cc60 2023-12-16T01:53:48.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.275+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc480c8ce0 con 0x7efc4814cc60 2023-12-16T01:53:48.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.276+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc481ed420 con 0x7efc4814cc60 2023-12-16T01:53:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.524+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7efc40004020 con 0x7efc4814cc60 2023-12-16T01:53:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.525+0000 7efc3dffb640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efc2c06ae90 0x7efc2c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.525+0000 7efc4d52c640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efc2c06ae90 0x7efc2c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.525+0000 7efc4d52c640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efc2c06ae90 0x7efc2c06d350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc44000f80 tx=0x7efc44030000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.527+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efc40058370 con 0x7efc4814cc60 2023-12-16T01:53:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.540+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7efc400546b0 con 0x7efc4814cc60 2023-12-16T01:53:48.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.707+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7efc48156390 con 0x7efc2c06ae90 2023-12-16T01:53:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.708+0000 7efc3dffb640 1 -- 172.21.15.107:0/2063900219 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efc44043070 con 0x7efc2c06ae90 2023-12-16T01:53:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 7 to deep-scrub 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efc2c06ae90 msgr2=0x7efc2c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efc2c06ae90 0x7efc2c06d350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc44000f80 tx=0x7efc44030000 comp rx=0 tx=0).stop 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 msgr2=0x7efc48148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc48148830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc4000e820 tx=0x7efc4000ece0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 shutdown_connections 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7efc2c06ae90 0x7efc2c06d350 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4814cc60 0x7efc48148830 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480c58e0 0x7efc481ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 --2- 172.21.15.107:0/2063900219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48072490 0x7efc481dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.709+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 >> 172.21.15.107:0/2063900219 conn(0x7efc4806cd60 msgr2=0x7efc480c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:48.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.710+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 shutdown_connections 2023-12-16T01:53:48.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.710+0000 7efc4f790640 1 -- 172.21.15.107:0/2063900219 wait complete. 2023-12-16T01:53:48.722 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:53:48.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.820+0000 7ff18efa0640 1 Processor -- start 2023-12-16T01:53:48.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.820+0000 7ff18efa0640 1 -- start start 2023-12-16T01:53:48.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18efa0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1880c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18efa0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff18815d590 0x7ff188159390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18efa0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18815a2a0 con 0x7ff18806b330 2023-12-16T01:53:48.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18efa0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1880c6900 con 0x7ff18815d590 2023-12-16T01:53:48.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18efa0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff188153ae0 con 0x7ff188153700 2023-12-16T01:53:48.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18e79f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff18806b330 0x7ff1880c83d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55396/0 (socket says 172.21.15.107:55396) 2023-12-16T01:53:48.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.821+0000 7ff18e79f640 1 -- 172.21.15.107:0/263960109 learned_addr learned my addr 172.21.15.107:0/263960109 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:53:48.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.822+0000 7ff18d79d640 1 --2- 172.21.15.107:0/263960109 >> v2:172.21.15.157:3300/0 conn(0x7ff18815d590 0x7ff188159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.822+0000 7ff18df9e640 1 --2- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1880c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.824+0000 7ff18cf9c640 1 -- 172.21.15.107:0/263960109 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359343286 0 0) 0x7ff18815a2a0 con 0x7ff18806b330 2023-12-16T01:53:48.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.824+0000 7ff18cf9c640 1 -- 172.21.15.107:0/263960109 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff174003520 con 0x7ff18806b330 2023-12-16T01:53:48.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.824+0000 7ff18d79d640 1 -- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 msgr2=0x7ff1880c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:53:48.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.824+0000 7ff18d79d640 1 --2- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1880c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.824+0000 7ff18d79d640 1 -- 172.21.15.107:0/263960109 >> v1:172.21.15.107:6789/0 conn(0x7ff18806b330 legacy=0x7ff1880c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.824+0000 7ff18d79d640 1 -- 172.21.15.107:0/263960109 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188159d40 con 0x7ff18815d590 2023-12-16T01:53:48.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.827+0000 7ff18d79d640 1 --2- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18815d590 0x7ff188159390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cdb10e610fa4c63 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18cf9c640 1 -- 172.21.15.107:0/263960109 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17802e070 con 0x7ff18815d590 2023-12-16T01:53:48.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18cf9c640 1 -- 172.21.15.107:0/263960109 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780315a0 con 0x7ff18815d590 2023-12-16T01:53:48.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18cf9c640 1 -- 172.21.15.107:0/263960109 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178031930 con 0x7ff18815d590 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18efa0640 1 -- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18815d590 msgr2=0x7ff188159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18efa0640 1 --2- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18815d590 0x7ff188159390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802b840 comp rx=0 tx=0).stop 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18efa0640 1 -- 172.21.15.107:0/263960109 shutdown_connections 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18efa0640 1 --2- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18815d590 0x7ff188159390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18efa0640 1 --2- 172.21.15.107:0/263960109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1880c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.831+0000 7ff18efa0640 1 -- 172.21.15.107:0/263960109 >> 172.21.15.107:0/263960109 conn(0x7ff18806f370 msgr2=0x7ff18806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.832+0000 7ff18efa0640 1 -- 172.21.15.107:0/263960109 shutdown_connections 2023-12-16T01:53:48.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.832+0000 7ff18efa0640 1 -- 172.21.15.107:0/263960109 wait complete. 2023-12-16T01:53:48.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 Processor -- start 2023-12-16T01:53:48.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 -- start start 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18806b330 0x7ff18814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1881ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 0x7ff188148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881f3160 con 0x7ff18815d590 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881515f0 con 0x7ff18806b330 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.833+0000 7ff18efa0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881f3580 con 0x7ff188153700 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.834+0000 7ff18e79f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 0x7ff188148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.834+0000 7ff18e79f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 0x7ff188148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52156/0 (socket says 172.21.15.107:52156) 2023-12-16T01:53:48.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.834+0000 7ff18e79f640 1 -- 172.21.15.107:0/1447294807 learned_addr learned my addr 172.21.15.107:0/1447294807 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:53:48.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.836+0000 7ff18d79d640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1881ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.836+0000 7ff18df9e640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18806b330 0x7ff18814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:48.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.837+0000 7ff18e79f640 1 -- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 msgr2=0x7ff1881ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.837+0000 7ff18e79f640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1881ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.837+0000 7ff18e79f640 1 -- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18806b330 msgr2=0x7ff18814d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:48.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.837+0000 7ff18e79f640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18806b330 0x7ff18814d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:48.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.837+0000 7ff18e79f640 1 -- 172.21.15.107:0/1447294807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178009400 con 0x7ff18815d590 2023-12-16T01:53:48.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.841+0000 7ff18e79f640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 0x7ff188148dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c390 tx=0x7ff18000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:48.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.845+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180005ce0 con 0x7ff18815d590 2023-12-16T01:53:48.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.845+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180005e40 con 0x7ff18815d590 2023-12-16T01:53:48.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.845+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff188151310 con 0x7ff18815d590 2023-12-16T01:53:48.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.845+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180007310 con 0x7ff18815d590 2023-12-16T01:53:48.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.845+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1881f2aa0 con 0x7ff18815d590 2023-12-16T01:53:48.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:48.846+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff188061620 con 0x7ff18815d590 2023-12-16T01:53:49.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.153+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff180007470 con 0x7ff18815d590 2023-12-16T01:53:49.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.153+0000 7ff17e7fc640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff16c06aec0 0x7ff16c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:53:49.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.153+0000 7ff18df9e640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff16c06aec0 0x7ff16c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:53:49.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.153+0000 7ff18df9e640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff16c06aec0 0x7ff16c06d380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff184011340 tx=0x7ff18400b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:53:49.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.167+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff180057dc0 con 0x7ff18815d590 2023-12-16T01:53:49.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.167+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff180054100 con 0x7ff18815d590 2023-12-16T01:53:49.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.343+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1880c4750 con 0x7ff16c06aec0 2023-12-16T01:53:49.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.351+0000 7ff17e7fc640 1 -- 172.21.15.107:0/1447294807 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370221 (secure 0 0 0) 0x7ff1880c4750 con 0x7ff16c06aec0 2023-12-16T01:53:49.357 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:53:49.359 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:53:49.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff16c06aec0 msgr2=0x7ff16c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:49.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff16c06aec0 0x7ff16c06d380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff184011340 tx=0x7ff18400b040 comp rx=0 tx=0).stop 2023-12-16T01:53:49.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 msgr2=0x7ff188148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:53:49.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 0x7ff188148dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c390 tx=0x7ff18000c850 comp rx=0 tx=0).stop 2023-12-16T01:53:49.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 shutdown_connections 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff18815d590 0x7ff188148dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff188153700 0x7ff1881ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7ff16c06aec0 0x7ff16c06d380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 --2- 172.21.15.107:0/1447294807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff18806b330 0x7ff18814d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 >> 172.21.15.107:0/1447294807 conn(0x7ff18806f370 msgr2=0x7ff1880c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 shutdown_connections 2023-12-16T01:53:49.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:53:49.355+0000 7ff18efa0640 1 -- 172.21.15.107:0/1447294807 wait complete. 2023-12-16T01:53:49.368 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":867,"stamp":"2023-12-16T01:53:48.090908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15784,"ondisk_log_size":15784,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002750"},"pg_stats":[{"pgid":"2.1f","version":"28'621","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.736627+0000","last_change":"2023-12-16T01:25:47.894934+0000","last_active":"2023-12-16T01:53:19.736627+0000","last_peered":"2023-12-16T01:53:19.736627+0000","last_clean":"2023-12-16T01:53:19.736627+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:19.736627+0000","last_undegraded":"2023-12-16T01:53:19.736627+0000","last_fullsized":"2023-12-16T01:53:19.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052203+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:53:33.052203+0000","last_peered":"2023-12-16T01:53:33.052203+0000","last_clean":"2023-12-16T01:53:33.052203+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:53:33.052203+0000","last_undegraded":"2023-12-16T01:53:33.052203+0000","last_fullsized":"2023-12-16T01:53:33.052203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:19.881838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546299+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:53:04.546299+0000","last_peered":"2023-12-16T01:53:04.546299+0000","last_clean":"2023-12-16T01:53:04.546299+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:53:04.546299+0000","last_undegraded":"2023-12-16T01:53:04.546299+0000","last_fullsized":"2023-12-16T01:53:04.546299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:23.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'727","reported_seq":758,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642747+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:53:13.642747+0000","last_peered":"2023-12-16T01:53:13.642747+0000","last_clean":"2023-12-16T01:53:13.642747+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:53:13.642747+0000","last_undegraded":"2023-12-16T01:53:13.642747+0000","last_fullsized":"2023-12-16T01:53:13.642747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052578+0000","last_change":"2023-12-16T01:25:49.118492+0000","last_active":"2023-12-16T01:53:33.052578+0000","last_peered":"2023-12-16T01:53:33.052578+0000","last_clean":"2023-12-16T01:53:33.052578+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:33.052578+0000","last_undegraded":"2023-12-16T01:53:33.052578+0000","last_fullsized":"2023-12-16T01:53:33.052578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:27.398298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.950355+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:52:58.950355+0000","last_peered":"2023-12-16T01:52:58.950355+0000","last_clean":"2023-12-16T01:52:58.950355+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:52:58.950355+0000","last_undegraded":"2023-12-16T01:52:58.950355+0000","last_fullsized":"2023-12-16T01:52:58.950355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:59.994136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1394","reported_seq":1424,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.861300+0000","last_change":"2023-12-16T01:25:47.876055+0000","last_active":"2023-12-16T01:53:25.861300+0000","last_peered":"2023-12-16T01:53:25.861300+0000","last_clean":"2023-12-16T01:53:25.861300+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:25.861300+0000","last_undegraded":"2023-12-16T01:53:25.861300+0000","last_fullsized":"2023-12-16T01:53:25.861300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1394,"log_dups_size":0,"ondisk_log_size":1394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089082+0000","last_change":"2023-12-16T01:25:49.147944+0000","last_active":"2023-12-16T01:53:33.089082+0000","last_peered":"2023-12-16T01:53:33.089082+0000","last_clean":"2023-12-16T01:53:33.089082+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:33.089082+0000","last_undegraded":"2023-12-16T01:53:33.089082+0000","last_fullsized":"2023-12-16T01:53:33.089082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.523291+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:53:05.523291+0000","last_peered":"2023-12-16T01:53:05.523291+0000","last_clean":"2023-12-16T01:53:05.523291+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:53:05.523291+0000","last_undegraded":"2023-12-16T01:53:05.523291+0000","last_fullsized":"2023-12-16T01:53:05.523291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735934+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:53:19.735934+0000","last_peered":"2023-12-16T01:53:19.735934+0000","last_clean":"2023-12-16T01:53:19.735934+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:53:19.735934+0000","last_undegraded":"2023-12-16T01:53:19.735934+0000","last_fullsized":"2023-12-16T01:53:19.735934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003080+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003080+0000","last_peered":"2023-12-16T01:53:33.003080+0000","last_clean":"2023-12-16T01:53:33.003080+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003080+0000","last_undegraded":"2023-12-16T01:53:33.003080+0000","last_fullsized":"2023-12-16T01:53:33.003080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:29:57.092568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.513556+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:53:05.513556+0000","last_peered":"2023-12-16T01:53:05.513556+0000","last_clean":"2023-12-16T01:53:05.513556+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:53:05.513556+0000","last_undegraded":"2023-12-16T01:53:05.513556+0000","last_fullsized":"2023-12-16T01:53:05.513556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.011587+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:53:33.011587+0000","last_peered":"2023-12-16T01:53:33.011587+0000","last_clean":"2023-12-16T01:53:33.011587+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:53:33.011587+0000","last_undegraded":"2023-12-16T01:53:33.011587+0000","last_fullsized":"2023-12-16T01:53:33.011587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:00.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'637","reported_seq":667,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:21.784478+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:53:21.784478+0000","last_peered":"2023-12-16T01:53:21.784478+0000","last_clean":"2023-12-16T01:53:21.784478+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:53:21.784478+0000","last_undegraded":"2023-12-16T01:53:21.784478+0000","last_fullsized":"2023-12-16T01:53:21.784478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:54.556728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503323+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503323+0000","last_peered":"2023-12-16T01:53:05.503323+0000","last_clean":"2023-12-16T01:53:05.503323+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503323+0000","last_undegraded":"2023-12-16T01:53:05.503323+0000","last_fullsized":"2023-12-16T01:53:05.503323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:04.275774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.970424+0000","last_change":"2023-12-16T01:25:49.122853+0000","last_active":"2023-12-16T01:53:32.970424+0000","last_peered":"2023-12-16T01:53:32.970424+0000","last_clean":"2023-12-16T01:53:32.970424+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:53:32.970424+0000","last_undegraded":"2023-12-16T01:53:32.970424+0000","last_fullsized":"2023-12-16T01:53:32.970424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:13.642954+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:53:13.642954+0000","last_peered":"2023-12-16T01:53:13.642954+0000","last_clean":"2023-12-16T01:53:13.642954+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:53:13.642954+0000","last_undegraded":"2023-12-16T01:53:13.642954+0000","last_fullsized":"2023-12-16T01:53:13.642954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:23.288201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.550820+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:53:04.550820+0000","last_peered":"2023-12-16T01:53:04.550820+0000","last_clean":"2023-12-16T01:53:04.550820+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:53:04.550820+0000","last_undegraded":"2023-12-16T01:53:04.550820+0000","last_fullsized":"2023-12-16T01:53:04.550820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089208+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:53:33.089208+0000","last_peered":"2023-12-16T01:53:33.089208+0000","last_clean":"2023-12-16T01:53:33.089208+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:53:33.089208+0000","last_undegraded":"2023-12-16T01:53:33.089208+0000","last_fullsized":"2023-12-16T01:53:33.089208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:49:39.770859+0000","last_change":"2023-12-16T01:25:47.873824+0000","last_active":"2023-12-16T01:49:39.770859+0000","last_peered":"2023-12-16T01:49:39.770859+0000","last_clean":"2023-12-16T01:49:39.770859+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:49:39.770859+0000","last_undegraded":"2023-12-16T01:49:39.770859+0000","last_fullsized":"2023-12-16T01:49:39.770859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.402834+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:53:03.402834+0000","last_peered":"2023-12-16T01:53:03.402834+0000","last_clean":"2023-12-16T01:53:03.402834+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:53:03.402834+0000","last_undegraded":"2023-12-16T01:53:03.402834+0000","last_fullsized":"2023-12-16T01:53:03.402834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:01.680699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.576104+0000","last_change":"2023-12-16T01:25:49.153101+0000","last_active":"2023-12-16T01:53:02.576104+0000","last_peered":"2023-12-16T01:53:02.576104+0000","last_clean":"2023-12-16T01:53:02.576104+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:02.576104+0000","last_undegraded":"2023-12-16T01:53:02.576104+0000","last_fullsized":"2023-12-16T01:53:02.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:26.771272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.752797+0000","last_change":"2023-12-16T01:25:47.874660+0000","last_active":"2023-12-16T01:53:20.752797+0000","last_peered":"2023-12-16T01:53:20.752797+0000","last_clean":"2023-12-16T01:53:20.752797+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:20.752797+0000","last_undegraded":"2023-12-16T01:53:20.752797+0000","last_fullsized":"2023-12-16T01:53:20.752797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":150,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.511655+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:53:05.511655+0000","last_peered":"2023-12-16T01:53:05.511655+0000","last_clean":"2023-12-16T01:53:05.511655+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:53:05.511655+0000","last_undegraded":"2023-12-16T01:53:05.511655+0000","last_fullsized":"2023-12-16T01:53:05.511655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089117+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:53:33.089117+0000","last_peered":"2023-12-16T01:53:33.089117+0000","last_clean":"2023-12-16T01:53:33.089117+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:53:33.089117+0000","last_undegraded":"2023-12-16T01:53:33.089117+0000","last_fullsized":"2023-12-16T01:53:33.089117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'11","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.858325+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:53:25.858325+0000","last_peered":"2023-12-16T01:53:25.858325+0000","last_clean":"2023-12-16T01:53:25.858325+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:53:25.858325+0000","last_undegraded":"2023-12-16T01:53:25.858325+0000","last_fullsized":"2023-12-16T01:53:25.858325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:12.603559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.894062+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:53:03.894062+0000","last_peered":"2023-12-16T01:53:03.894062+0000","last_clean":"2023-12-16T01:53:03.894062+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:53:03.894062+0000","last_undegraded":"2023-12-16T01:53:03.894062+0000","last_fullsized":"2023-12-16T01:53:03.894062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:36.855987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089363+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:53:33.089363+0000","last_peered":"2023-12-16T01:53:33.089363+0000","last_clean":"2023-12-16T01:53:33.089363+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:53:33.089363+0000","last_undegraded":"2023-12-16T01:53:33.089363+0000","last_fullsized":"2023-12-16T01:53:33.089363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'310","reported_seq":341,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:29.053543+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:53:29.053543+0000","last_peered":"2023-12-16T01:53:29.053543+0000","last_clean":"2023-12-16T01:53:29.053543+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:53:29.053543+0000","last_undegraded":"2023-12-16T01:53:29.053543+0000","last_fullsized":"2023-12-16T01:53:29.053543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.545783+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:53:04.545783+0000","last_peered":"2023-12-16T01:53:04.545783+0000","last_clean":"2023-12-16T01:53:04.545783+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:53:04.545783+0000","last_undegraded":"2023-12-16T01:53:04.545783+0000","last_fullsized":"2023-12-16T01:53:04.545783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.984623+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:53:32.984623+0000","last_peered":"2023-12-16T01:53:32.984623+0000","last_clean":"2023-12-16T01:53:32.984623+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:53:32.984623+0000","last_undegraded":"2023-12-16T01:53:32.984623+0000","last_fullsized":"2023-12-16T01:53:32.984623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:16.660057+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:53:16.660057+0000","last_peered":"2023-12-16T01:53:16.660057+0000","last_clean":"2023-12-16T01:53:16.660057+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:53:16.660057+0000","last_undegraded":"2023-12-16T01:53:16.660057+0000","last_fullsized":"2023-12-16T01:53:16.660057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:52.870166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.562047+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:53:04.562047+0000","last_peered":"2023-12-16T01:53:04.562047+0000","last_clean":"2023-12-16T01:53:04.562047+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:53:04.562047+0000","last_undegraded":"2023-12-16T01:53:04.562047+0000","last_fullsized":"2023-12-16T01:53:04.562047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:28.355755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013234+0000","last_change":"2023-12-16T01:25:49.116236+0000","last_active":"2023-12-16T01:53:33.013234+0000","last_peered":"2023-12-16T01:53:33.013234+0000","last_clean":"2023-12-16T01:53:33.013234+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:33.013234+0000","last_undegraded":"2023-12-16T01:53:33.013234+0000","last_fullsized":"2023-12-16T01:53:33.013234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:09.553576+0000","last_change":"2023-12-16T01:25:47.899854+0000","last_active":"2023-12-16T01:53:09.553576+0000","last_peered":"2023-12-16T01:53:09.553576+0000","last_clean":"2023-12-16T01:53:09.553576+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:09.553576+0000","last_undegraded":"2023-12-16T01:53:09.553576+0000","last_fullsized":"2023-12-16T01:53:09.553576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:59.749941+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:52:59.749941+0000","last_peered":"2023-12-16T01:52:59.749941+0000","last_clean":"2023-12-16T01:52:59.749941+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:52:59.749941+0000","last_undegraded":"2023-12-16T01:52:59.749941+0000","last_fullsized":"2023-12-16T01:52:59.749941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:58.421091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051932+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:53:33.051932+0000","last_peered":"2023-12-16T01:53:33.051932+0000","last_clean":"2023-12-16T01:53:33.051932+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:53:33.051932+0000","last_undegraded":"2023-12-16T01:53:33.051932+0000","last_fullsized":"2023-12-16T01:53:33.051932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.733213+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:53:19.733213+0000","last_peered":"2023-12-16T01:53:19.733213+0000","last_clean":"2023-12-16T01:53:19.733213+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:53:19.733213+0000","last_undegraded":"2023-12-16T01:53:19.733213+0000","last_fullsized":"2023-12-16T01:53:19.733213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:40.352422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.525881+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:53:05.525881+0000","last_peered":"2023-12-16T01:53:05.525881+0000","last_clean":"2023-12-16T01:53:05.525881+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:53:05.525881+0000","last_undegraded":"2023-12-16T01:53:05.525881+0000","last_fullsized":"2023-12-16T01:53:05.525881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:47.476392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048436+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:53:33.048436+0000","last_peered":"2023-12-16T01:53:33.048436+0000","last_clean":"2023-12-16T01:53:33.048436+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:53:33.048436+0000","last_undegraded":"2023-12-16T01:53:33.048436+0000","last_fullsized":"2023-12-16T01:53:33.048436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:49.249430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:30.852212+0000","last_change":"2023-12-16T01:25:47.899620+0000","last_active":"2023-12-16T01:53:30.852212+0000","last_peered":"2023-12-16T01:53:30.852212+0000","last_clean":"2023-12-16T01:53:30.852212+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:30.852212+0000","last_undegraded":"2023-12-16T01:53:30.852212+0000","last_fullsized":"2023-12-16T01:53:30.852212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:12.302089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394771+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:53:03.394771+0000","last_peered":"2023-12-16T01:53:03.394771+0000","last_clean":"2023-12-16T01:53:03.394771+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:53:03.394771+0000","last_undegraded":"2023-12-16T01:53:03.394771+0000","last_fullsized":"2023-12-16T01:53:03.394771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985745+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:53:32.985745+0000","last_peered":"2023-12-16T01:53:32.985745+0000","last_clean":"2023-12-16T01:53:32.985745+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:53:32.985745+0000","last_undegraded":"2023-12-16T01:53:32.985745+0000","last_fullsized":"2023-12-16T01:53:32.985745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'555","reported_seq":586,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859131+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:53:25.859131+0000","last_peered":"2023-12-16T01:53:25.859131+0000","last_clean":"2023-12-16T01:53:25.859131+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:53:25.859131+0000","last_undegraded":"2023-12-16T01:53:25.859131+0000","last_fullsized":"2023-12-16T01:53:25.859131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:52.132359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.498426+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:53:05.498426+0000","last_peered":"2023-12-16T01:53:05.498426+0000","last_clean":"2023-12-16T01:53:05.498426+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:53:05.498426+0000","last_undegraded":"2023-12-16T01:53:05.498426+0000","last_fullsized":"2023-12-16T01:53:05.498426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.499223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092052+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:53:33.092052+0000","last_peered":"2023-12-16T01:53:33.092052+0000","last_clean":"2023-12-16T01:53:33.092052+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:53:33.092052+0000","last_undegraded":"2023-12-16T01:53:33.092052+0000","last_fullsized":"2023-12-16T01:53:33.092052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:53.958970+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:52:53.958970+0000","last_peered":"2023-12-16T01:52:53.958970+0000","last_clean":"2023-12-16T01:52:53.958970+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:52:53.958970+0000","last_undegraded":"2023-12-16T01:52:53.958970+0000","last_fullsized":"2023-12-16T01:52:53.958970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:16.504143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:51:43.847578+0000","last_change":"2023-12-16T01:25:36.522370+0000","last_active":"2023-12-16T01:51:43.847578+0000","last_peered":"2023-12-16T01:51:43.847578+0000","last_clean":"2023-12-16T01:51:43.847578+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:51:43.847578+0000","last_undegraded":"2023-12-16T01:51:43.847578+0000","last_fullsized":"2023-12-16T01:51:43.847578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:34.458308+0000","last_clean_scrub_stamp":"2023-12-16T01:25:34.458308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:23.514786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394625+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:53:03.394625+0000","last_peered":"2023-12-16T01:53:03.394625+0000","last_clean":"2023-12-16T01:53:03.394625+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:53:03.394625+0000","last_undegraded":"2023-12-16T01:53:03.394625+0000","last_fullsized":"2023-12-16T01:53:03.394625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:13:30.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003140+0000","last_change":"2023-12-16T01:25:49.152595+0000","last_active":"2023-12-16T01:53:33.003140+0000","last_peered":"2023-12-16T01:53:33.003140+0000","last_clean":"2023-12-16T01:53:33.003140+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:33.003140+0000","last_undegraded":"2023-12-16T01:53:33.003140+0000","last_fullsized":"2023-12-16T01:53:33.003140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:34.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.701145+0000","last_change":"2023-12-16T01:25:47.876577+0000","last_active":"2023-12-16T01:53:17.701145+0000","last_peered":"2023-12-16T01:53:17.701145+0000","last_clean":"2023-12-16T01:53:17.701145+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:17.701145+0000","last_undegraded":"2023-12-16T01:53:17.701145+0000","last_fullsized":"2023-12-16T01:53:17.701145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:36.996779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.614282+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:53:02.614282+0000","last_peered":"2023-12-16T01:53:02.614282+0000","last_clean":"2023-12-16T01:53:02.614282+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:53:02.614282+0000","last_undegraded":"2023-12-16T01:53:02.614282+0000","last_fullsized":"2023-12-16T01:53:02.614282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:33.428925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.072588+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:53:33.072588+0000","last_peered":"2023-12-16T01:53:33.072588+0000","last_clean":"2023-12-16T01:53:33.072588+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:53:33.072588+0000","last_undegraded":"2023-12-16T01:53:33.072588+0000","last_fullsized":"2023-12-16T01:53:33.072588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.702497+0000","last_change":"2023-12-16T01:25:47.899897+0000","last_active":"2023-12-16T01:53:17.702497+0000","last_peered":"2023-12-16T01:53:17.702497+0000","last_clean":"2023-12-16T01:53:17.702497+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:17.702497+0000","last_undegraded":"2023-12-16T01:53:17.702497+0000","last_fullsized":"2023-12-16T01:53:17.702497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:15.927235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399892+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:53:03.399892+0000","last_peered":"2023-12-16T01:53:03.399892+0000","last_clean":"2023-12-16T01:53:03.399892+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:53:03.399892+0000","last_undegraded":"2023-12-16T01:53:03.399892+0000","last_fullsized":"2023-12-16T01:53:03.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:40.856490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075656+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:53:33.075656+0000","last_peered":"2023-12-16T01:53:33.075656+0000","last_clean":"2023-12-16T01:53:33.075656+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:53:33.075656+0000","last_undegraded":"2023-12-16T01:53:33.075656+0000","last_fullsized":"2023-12-16T01:53:33.075656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735726+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:53:19.735726+0000","last_peered":"2023-12-16T01:53:19.735726+0000","last_clean":"2023-12-16T01:53:19.735726+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:53:19.735726+0000","last_undegraded":"2023-12-16T01:53:19.735726+0000","last_fullsized":"2023-12-16T01:53:19.735726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:10.879538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.758398+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:53:01.758398+0000","last_peered":"2023-12-16T01:53:01.758398+0000","last_clean":"2023-12-16T01:53:01.758398+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:53:01.758398+0000","last_undegraded":"2023-12-16T01:53:01.758398+0000","last_fullsized":"2023-12-16T01:53:01.758398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:28.521734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002598+0000","last_change":"2023-12-16T01:25:49.146700+0000","last_active":"2023-12-16T01:53:33.002598+0000","last_peered":"2023-12-16T01:53:33.002598+0000","last_clean":"2023-12-16T01:53:33.002598+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:33.002598+0000","last_undegraded":"2023-12-16T01:53:33.002598+0000","last_fullsized":"2023-12-16T01:53:33.002598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:49.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:07.543526+0000","last_change":"2023-12-16T01:25:47.899706+0000","last_active":"2023-12-16T01:53:07.543526+0000","last_peered":"2023-12-16T01:53:07.543526+0000","last_clean":"2023-12-16T01:53:07.543526+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:53:07.543526+0000","last_undegraded":"2023-12-16T01:53:07.543526+0000","last_fullsized":"2023-12-16T01:53:07.543526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.588615+0000","last_change":"2023-12-16T01:25:54.982303+0000","last_active":"2023-12-16T01:53:02.588615+0000","last_peered":"2023-12-16T01:53:02.588615+0000","last_clean":"2023-12-16T01:53:02.588615+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:53:02.588615+0000","last_undegraded":"2023-12-16T01:53:02.588615+0000","last_fullsized":"2023-12-16T01:53:02.588615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:51.449250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.998352+0000","last_change":"2023-12-16T01:25:49.153357+0000","last_active":"2023-12-16T01:53:32.998352+0000","last_peered":"2023-12-16T01:53:32.998352+0000","last_clean":"2023-12-16T01:53:32.998352+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:32.998352+0000","last_undegraded":"2023-12-16T01:53:32.998352+0000","last_fullsized":"2023-12-16T01:53:32.998352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.906156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:51:29.781913+0000","last_change":"2023-12-16T01:25:47.873972+0000","last_active":"2023-12-16T01:51:29.781913+0000","last_peered":"2023-12-16T01:51:29.781913+0000","last_clean":"2023-12-16T01:51:29.781913+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:51:29.781913+0000","last_undegraded":"2023-12-16T01:51:29.781913+0000","last_fullsized":"2023-12-16T01:51:29.781913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:18.237551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.394238+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:53:03.394238+0000","last_peered":"2023-12-16T01:53:03.394238+0000","last_clean":"2023-12-16T01:53:03.394238+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:53:03.394238+0000","last_undegraded":"2023-12-16T01:53:03.394238+0000","last_fullsized":"2023-12-16T01:53:03.394238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:07.174697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.082967+0000","last_change":"2023-12-16T01:25:49.117031+0000","last_active":"2023-12-16T01:53:33.082967+0000","last_peered":"2023-12-16T01:53:33.082967+0000","last_clean":"2023-12-16T01:53:33.082967+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:33.082967+0000","last_undegraded":"2023-12-16T01:53:33.082967+0000","last_fullsized":"2023-12-16T01:53:33.082967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:23.831661+0000","last_change":"2023-12-16T01:25:47.894277+0000","last_active":"2023-12-16T01:53:23.831661+0000","last_peered":"2023-12-16T01:53:23.831661+0000","last_clean":"2023-12-16T01:53:23.831661+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:53:23.831661+0000","last_undegraded":"2023-12-16T01:53:23.831661+0000","last_fullsized":"2023-12-16T01:53:23.831661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.024631+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:52:58.024631+0000","last_peered":"2023-12-16T01:52:58.024631+0000","last_clean":"2023-12-16T01:52:58.024631+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:52:58.024631+0000","last_undegraded":"2023-12-16T01:52:58.024631+0000","last_fullsized":"2023-12-16T01:52:58.024631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.898722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.005175+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:53:33.005175+0000","last_peered":"2023-12-16T01:53:33.005175+0000","last_clean":"2023-12-16T01:53:33.005175+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:53:33.005175+0000","last_undegraded":"2023-12-16T01:53:33.005175+0000","last_fullsized":"2023-12-16T01:53:33.005175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:58:34.243292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.859130+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:53:25.859130+0000","last_peered":"2023-12-16T01:53:25.859130+0000","last_clean":"2023-12-16T01:53:25.859130+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:53:25.859130+0000","last_undegraded":"2023-12-16T01:53:25.859130+0000","last_fullsized":"2023-12-16T01:53:25.859130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:18.788494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":146,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.755626+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:53:01.755626+0000","last_peered":"2023-12-16T01:53:01.755626+0000","last_clean":"2023-12-16T01:53:01.755626+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:53:01.755626+0000","last_undegraded":"2023-12-16T01:53:01.755626+0000","last_fullsized":"2023-12-16T01:53:01.755626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.991774+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:53:32.991774+0000","last_peered":"2023-12-16T01:53:32.991774+0000","last_clean":"2023-12-16T01:53:32.991774+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:53:32.991774+0000","last_undegraded":"2023-12-16T01:53:32.991774+0000","last_fullsized":"2023-12-16T01:53:32.991774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'303","reported_seq":333,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.800001+0000","last_change":"2023-12-16T01:25:47.876395+0000","last_active":"2023-12-16T01:53:32.800001+0000","last_peered":"2023-12-16T01:53:32.800001+0000","last_clean":"2023-12-16T01:53:32.800001+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:32.800001+0000","last_undegraded":"2023-12-16T01:53:32.800001+0000","last_fullsized":"2023-12-16T01:53:32.800001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:00.568175+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:00.568175+0000","last_peered":"2023-12-16T01:53:00.568175+0000","last_clean":"2023-12-16T01:53:00.568175+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:00.568175+0000","last_undegraded":"2023-12-16T01:53:00.568175+0000","last_fullsized":"2023-12-16T01:53:00.568175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:33.979531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.053821+0000","last_change":"2023-12-16T01:25:49.147168+0000","last_active":"2023-12-16T01:53:33.053821+0000","last_peered":"2023-12-16T01:53:33.053821+0000","last_clean":"2023-12-16T01:53:33.053821+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:33.053821+0000","last_undegraded":"2023-12-16T01:53:33.053821+0000","last_fullsized":"2023-12-16T01:53:33.053821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'859","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.771475+0000","last_change":"2023-12-16T01:25:47.852760+0000","last_active":"2023-12-16T01:53:22.771475+0000","last_peered":"2023-12-16T01:53:22.771475+0000","last_clean":"2023-12-16T01:53:22.771475+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:22.771475+0000","last_undegraded":"2023-12-16T01:53:22.771475+0000","last_fullsized":"2023-12-16T01:53:22.771475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546516+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:53:04.546516+0000","last_peered":"2023-12-16T01:53:04.546516+0000","last_clean":"2023-12-16T01:53:04.546516+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:53:04.546516+0000","last_undegraded":"2023-12-16T01:53:04.546516+0000","last_fullsized":"2023-12-16T01:53:04.546516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:35.697471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013492+0000","last_change":"2023-12-16T01:25:49.153188+0000","last_active":"2023-12-16T01:53:33.013492+0000","last_peered":"2023-12-16T01:53:33.013492+0000","last_clean":"2023-12-16T01:53:33.013492+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:33.013492+0000","last_undegraded":"2023-12-16T01:53:33.013492+0000","last_fullsized":"2023-12-16T01:53:33.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:24.468597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'732","reported_seq":762,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:26.858591+0000","last_change":"2023-12-16T01:25:47.875261+0000","last_active":"2023-12-16T01:53:26.858591+0000","last_peered":"2023-12-16T01:53:26.858591+0000","last_clean":"2023-12-16T01:53:26.858591+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:26.858591+0000","last_undegraded":"2023-12-16T01:53:26.858591+0000","last_fullsized":"2023-12-16T01:53:26.858591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:54.084788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:02.620159+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:53:02.620159+0000","last_peered":"2023-12-16T01:53:02.620159+0000","last_clean":"2023-12-16T01:53:02.620159+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:53:02.620159+0000","last_undegraded":"2023-12-16T01:53:02.620159+0000","last_fullsized":"2023-12-16T01:53:02.620159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.912465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051987+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:53:33.051987+0000","last_peered":"2023-12-16T01:53:33.051987+0000","last_clean":"2023-12-16T01:53:33.051987+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:53:33.051987+0000","last_undegraded":"2023-12-16T01:53:33.051987+0000","last_fullsized":"2023-12-16T01:53:33.051987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:23.819649+0000","last_change":"2023-12-16T01:25:47.874657+0000","last_active":"2023-12-16T01:53:23.819649+0000","last_peered":"2023-12-16T01:53:23.819649+0000","last_clean":"2023-12-16T01:53:23.819649+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:23.819649+0000","last_undegraded":"2023-12-16T01:53:23.819649+0000","last_fullsized":"2023-12-16T01:53:23.819649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551096+0000","last_change":"2023-12-16T01:25:54.984455+0000","last_active":"2023-12-16T01:53:04.551096+0000","last_peered":"2023-12-16T01:53:04.551096+0000","last_clean":"2023-12-16T01:53:04.551096+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:53:04.551096+0000","last_undegraded":"2023-12-16T01:53:04.551096+0000","last_fullsized":"2023-12-16T01:53:04.551096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:19.727530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.014454+0000","last_change":"2023-12-16T01:25:49.154104+0000","last_active":"2023-12-16T01:53:33.014454+0000","last_peered":"2023-12-16T01:53:33.014454+0000","last_clean":"2023-12-16T01:53:33.014454+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:53:33.014454+0000","last_undegraded":"2023-12-16T01:53:33.014454+0000","last_fullsized":"2023-12-16T01:53:33.014454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:17.703191+0000","last_change":"2023-12-16T01:25:47.874663+0000","last_active":"2023-12-16T01:53:17.703191+0000","last_peered":"2023-12-16T01:53:17.703191+0000","last_clean":"2023-12-16T01:53:17.703191+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:17.703191+0000","last_undegraded":"2023-12-16T01:53:17.703191+0000","last_fullsized":"2023-12-16T01:53:17.703191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:42.843113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":188,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.546309+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:53:04.546309+0000","last_peered":"2023-12-16T01:53:04.546309+0000","last_clean":"2023-12-16T01:53:04.546309+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:53:04.546309+0000","last_undegraded":"2023-12-16T01:53:04.546309+0000","last_fullsized":"2023-12-16T01:53:04.546309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:06.232453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.399829+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:53:03.399829+0000","last_peered":"2023-12-16T01:53:03.399829+0000","last_clean":"2023-12-16T01:53:03.399829+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:53:03.399829+0000","last_undegraded":"2023-12-16T01:53:03.399829+0000","last_fullsized":"2023-12-16T01:53:03.399829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:18.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.091709+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:53:33.091709+0000","last_peered":"2023-12-16T01:53:33.091709+0000","last_clean":"2023-12-16T01:53:33.091709+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:53:33.091709+0000","last_undegraded":"2023-12-16T01:53:33.091709+0000","last_fullsized":"2023-12-16T01:53:33.091709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:41:55.650072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.782204+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:53:22.782204+0000","last_peered":"2023-12-16T01:53:22.782204+0000","last_clean":"2023-12-16T01:53:22.782204+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:53:22.782204+0000","last_undegraded":"2023-12-16T01:53:22.782204+0000","last_fullsized":"2023-12-16T01:53:22.782204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:34:48.156085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:38.989803+0000","last_change":"2023-12-16T01:26:31.583645+0000","last_active":"2023-12-16T01:53:38.989803+0000","last_peered":"2023-12-16T01:53:38.989803+0000","last_clean":"2023-12-16T01:53:38.989803+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:53:38.989803+0000","last_undegraded":"2023-12-16T01:53:38.989803+0000","last_fullsized":"2023-12-16T01:53:38.989803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.050878+0000","last_change":"2023-12-16T01:25:49.114723+0000","last_active":"2023-12-16T01:53:33.050878+0000","last_peered":"2023-12-16T01:53:33.050878+0000","last_clean":"2023-12-16T01:53:33.050878+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:33.050878+0000","last_undegraded":"2023-12-16T01:53:33.050878+0000","last_fullsized":"2023-12-16T01:53:33.050878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.225703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.713624+0000","last_change":"2023-12-16T01:25:47.876454+0000","last_active":"2023-12-16T01:53:15.713624+0000","last_peered":"2023-12-16T01:53:15.713624+0000","last_clean":"2023-12-16T01:53:15.713624+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:15.713624+0000","last_undegraded":"2023-12-16T01:53:15.713624+0000","last_fullsized":"2023-12-16T01:53:15.713624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:44.567460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'706","reported_seq":735,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.727664+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:53:15.727664+0000","last_peered":"2023-12-16T01:53:15.727664+0000","last_clean":"2023-12-16T01:53:15.727664+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:53:15.727664+0000","last_undegraded":"2023-12-16T01:53:15.727664+0000","last_fullsized":"2023-12-16T01:53:15.727664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:03:26.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092144+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:53:33.092144+0000","last_peered":"2023-12-16T01:53:33.092144+0000","last_clean":"2023-12-16T01:53:33.092144+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:53:33.092144+0000","last_undegraded":"2023-12-16T01:53:33.092144+0000","last_fullsized":"2023-12-16T01:53:33.092144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.397888+0000","last_change":"2023-12-16T01:26:31.583485+0000","last_active":"2023-12-16T01:53:03.397888+0000","last_peered":"2023-12-16T01:53:03.397888+0000","last_clean":"2023-12-16T01:53:03.397888+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:53:03.397888+0000","last_undegraded":"2023-12-16T01:53:03.397888+0000","last_fullsized":"2023-12-16T01:53:03.397888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:51.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'707","reported_seq":736,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:20.746082+0000","last_change":"2023-12-16T01:25:47.899479+0000","last_active":"2023-12-16T01:53:20.746082+0000","last_peered":"2023-12-16T01:53:20.746082+0000","last_clean":"2023-12-16T01:53:20.746082+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:53:20.746082+0000","last_undegraded":"2023-12-16T01:53:20.746082+0000","last_fullsized":"2023-12-16T01:53:20.746082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:48.374015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088690+0000","last_change":"2023-12-16T01:25:49.117064+0000","last_active":"2023-12-16T01:53:33.088690+0000","last_peered":"2023-12-16T01:53:33.088690+0000","last_clean":"2023-12-16T01:53:33.088690+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:33.088690+0000","last_undegraded":"2023-12-16T01:53:33.088690+0000","last_fullsized":"2023-12-16T01:53:33.088690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.526023+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:53:05.526023+0000","last_peered":"2023-12-16T01:53:05.526023+0000","last_clean":"2023-12-16T01:53:05.526023+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:53:05.526023+0000","last_undegraded":"2023-12-16T01:53:05.526023+0000","last_fullsized":"2023-12-16T01:53:05.526023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:28.228760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013111+0000","last_change":"2023-12-16T01:25:49.116245+0000","last_active":"2023-12-16T01:53:33.013111+0000","last_peered":"2023-12-16T01:53:33.013111+0000","last_clean":"2023-12-16T01:53:33.013111+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:33.013111+0000","last_undegraded":"2023-12-16T01:53:33.013111+0000","last_fullsized":"2023-12-16T01:53:33.013111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:19.330896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.974726+0000","last_change":"2023-12-16T01:25:49.124369+0000","last_active":"2023-12-16T01:53:32.974726+0000","last_peered":"2023-12-16T01:53:32.974726+0000","last_clean":"2023-12-16T01:53:32.974726+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:32.974726+0000","last_undegraded":"2023-12-16T01:53:32.974726+0000","last_fullsized":"2023-12-16T01:53:32.974726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:13:45.660804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.996419+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:53:32.996419+0000","last_peered":"2023-12-16T01:53:32.996419+0000","last_clean":"2023-12-16T01:53:32.996419+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:53:32.996419+0000","last_undegraded":"2023-12-16T01:53:32.996419+0000","last_fullsized":"2023-12-16T01:53:32.996419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:38.595498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.048222+0000","last_change":"2023-12-16T01:25:49.120914+0000","last_active":"2023-12-16T01:53:33.048222+0000","last_peered":"2023-12-16T01:53:33.048222+0000","last_clean":"2023-12-16T01:53:33.048222+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:33.048222+0000","last_undegraded":"2023-12-16T01:53:33.048222+0000","last_fullsized":"2023-12-16T01:53:33.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:53.963510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988764+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:53:32.988764+0000","last_peered":"2023-12-16T01:53:32.988764+0000","last_clean":"2023-12-16T01:53:32.988764+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:53:32.988764+0000","last_undegraded":"2023-12-16T01:53:32.988764+0000","last_fullsized":"2023-12-16T01:53:32.988764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:22.198134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.983477+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:53:32.983477+0000","last_peered":"2023-12-16T01:53:32.983477+0000","last_clean":"2023-12-16T01:53:32.983477+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:53:32.983477+0000","last_undegraded":"2023-12-16T01:53:32.983477+0000","last_fullsized":"2023-12-16T01:53:32.983477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013189+0000","last_change":"2023-12-16T01:25:49.154043+0000","last_active":"2023-12-16T01:53:33.013189+0000","last_peered":"2023-12-16T01:53:33.013189+0000","last_clean":"2023-12-16T01:53:33.013189+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:53:33.013189+0000","last_undegraded":"2023-12-16T01:53:33.013189+0000","last_fullsized":"2023-12-16T01:53:33.013189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:38.090123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052390+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:53:33.052390+0000","last_peered":"2023-12-16T01:53:33.052390+0000","last_clean":"2023-12-16T01:53:33.052390+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:53:33.052390+0000","last_undegraded":"2023-12-16T01:53:33.052390+0000","last_fullsized":"2023-12-16T01:53:33.052390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:52.390465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002679+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:53:33.002679+0000","last_peered":"2023-12-16T01:53:33.002679+0000","last_clean":"2023-12-16T01:53:33.002679+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:53:33.002679+0000","last_undegraded":"2023-12-16T01:53:33.002679+0000","last_fullsized":"2023-12-16T01:53:33.002679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:29.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052472+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:53:33.052472+0000","last_peered":"2023-12-16T01:53:33.052472+0000","last_clean":"2023-12-16T01:53:33.052472+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:53:33.052472+0000","last_undegraded":"2023-12-16T01:53:33.052472+0000","last_fullsized":"2023-12-16T01:53:33.052472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.089039+0000","last_change":"2023-12-16T01:25:49.148115+0000","last_active":"2023-12-16T01:53:33.089039+0000","last_peered":"2023-12-16T01:53:33.089039+0000","last_clean":"2023-12-16T01:53:33.089039+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:33.089039+0000","last_undegraded":"2023-12-16T01:53:33.089039+0000","last_fullsized":"2023-12-16T01:53:33.089039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.093269+0000","last_change":"2023-12-16T01:25:49.117241+0000","last_active":"2023-12-16T01:53:33.093269+0000","last_peered":"2023-12-16T01:53:33.093269+0000","last_clean":"2023-12-16T01:53:33.093269+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:33.093269+0000","last_undegraded":"2023-12-16T01:53:33.093269+0000","last_fullsized":"2023-12-16T01:53:33.093269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:43:17.597487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075811+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:53:33.075811+0000","last_peered":"2023-12-16T01:53:33.075811+0000","last_clean":"2023-12-16T01:53:33.075811+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:53:33.075811+0000","last_undegraded":"2023-12-16T01:53:33.075811+0000","last_fullsized":"2023-12-16T01:53:33.075811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.997000+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:53:32.997000+0000","last_peered":"2023-12-16T01:53:32.997000+0000","last_clean":"2023-12-16T01:53:32.997000+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:53:32.997000+0000","last_undegraded":"2023-12-16T01:53:32.997000+0000","last_fullsized":"2023-12-16T01:53:32.997000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:01.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.975471+0000","last_change":"2023-12-16T01:25:49.124270+0000","last_active":"2023-12-16T01:53:32.975471+0000","last_peered":"2023-12-16T01:53:32.975471+0000","last_clean":"2023-12-16T01:53:32.975471+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:32.975471+0000","last_undegraded":"2023-12-16T01:53:32.975471+0000","last_fullsized":"2023-12-16T01:53:32.975471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002376+0000","last_change":"2023-12-16T01:25:49.155365+0000","last_active":"2023-12-16T01:53:33.002376+0000","last_peered":"2023-12-16T01:53:33.002376+0000","last_clean":"2023-12-16T01:53:33.002376+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:33.002376+0000","last_undegraded":"2023-12-16T01:53:33.002376+0000","last_fullsized":"2023-12-16T01:53:33.002376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:32.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.002747+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:53:33.002747+0000","last_peered":"2023-12-16T01:53:33.002747+0000","last_clean":"2023-12-16T01:53:33.002747+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:53:33.002747+0000","last_undegraded":"2023-12-16T01:53:33.002747+0000","last_fullsized":"2023-12-16T01:53:33.002747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:22.325129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052466+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:53:33.052466+0000","last_peered":"2023-12-16T01:53:33.052466+0000","last_clean":"2023-12-16T01:53:33.052466+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:53:33.052466+0000","last_undegraded":"2023-12-16T01:53:33.052466+0000","last_fullsized":"2023-12-16T01:53:33.052466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:50:13.696903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.985017+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:53:32.985017+0000","last_peered":"2023-12-16T01:53:32.985017+0000","last_clean":"2023-12-16T01:53:32.985017+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:53:32.985017+0000","last_undegraded":"2023-12-16T01:53:32.985017+0000","last_fullsized":"2023-12-16T01:53:32.985017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:28:17.020579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988929+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:53:32.988929+0000","last_peered":"2023-12-16T01:53:32.988929+0000","last_clean":"2023-12-16T01:53:32.988929+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:53:32.988929+0000","last_undegraded":"2023-12-16T01:53:32.988929+0000","last_fullsized":"2023-12-16T01:53:32.988929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:45.418624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075941+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:53:33.075941+0000","last_peered":"2023-12-16T01:53:33.075941+0000","last_clean":"2023-12-16T01:53:33.075941+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:53:33.075941+0000","last_undegraded":"2023-12-16T01:53:33.075941+0000","last_fullsized":"2023-12-16T01:53:33.075941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.074648+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:53:33.074648+0000","last_peered":"2023-12-16T01:53:33.074648+0000","last_clean":"2023-12-16T01:53:33.074648+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:53:33.074648+0000","last_undegraded":"2023-12-16T01:53:33.074648+0000","last_fullsized":"2023-12-16T01:53:33.074648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075568+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:53:33.075568+0000","last_peered":"2023-12-16T01:53:33.075568+0000","last_clean":"2023-12-16T01:53:33.075568+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:53:33.075568+0000","last_undegraded":"2023-12-16T01:53:33.075568+0000","last_fullsized":"2023-12-16T01:53:33.075568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.088834+0000","last_change":"2023-12-16T01:25:49.153424+0000","last_active":"2023-12-16T01:53:33.088834+0000","last_peered":"2023-12-16T01:53:33.088834+0000","last_clean":"2023-12-16T01:53:33.088834+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:53:33.088834+0000","last_undegraded":"2023-12-16T01:53:33.088834+0000","last_fullsized":"2023-12-16T01:53:33.088834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:10:31.794681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.054078+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:53:33.054078+0000","last_peered":"2023-12-16T01:53:33.054078+0000","last_clean":"2023-12-16T01:53:33.054078+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:53:33.054078+0000","last_undegraded":"2023-12-16T01:53:33.054078+0000","last_fullsized":"2023-12-16T01:53:33.054078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:31:41.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.053744+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:53:33.053744+0000","last_peered":"2023-12-16T01:53:33.053744+0000","last_clean":"2023-12-16T01:53:33.053744+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:53:33.053744+0000","last_undegraded":"2023-12-16T01:53:33.053744+0000","last_fullsized":"2023-12-16T01:53:33.053744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.007767+0000","last_change":"2023-12-16T01:25:49.116873+0000","last_active":"2023-12-16T01:53:33.007767+0000","last_peered":"2023-12-16T01:53:33.007767+0000","last_clean":"2023-12-16T01:53:33.007767+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:53:33.007767+0000","last_undegraded":"2023-12-16T01:53:33.007767+0000","last_fullsized":"2023-12-16T01:53:33.007767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:24.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.072438+0000","last_change":"2023-12-16T01:25:49.146445+0000","last_active":"2023-12-16T01:53:33.072438+0000","last_peered":"2023-12-16T01:53:33.072438+0000","last_clean":"2023-12-16T01:53:33.072438+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:33.072438+0000","last_undegraded":"2023-12-16T01:53:33.072438+0000","last_fullsized":"2023-12-16T01:53:33.072438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.013429+0000","last_change":"2023-12-16T01:25:49.112318+0000","last_active":"2023-12-16T01:53:33.013429+0000","last_peered":"2023-12-16T01:53:33.013429+0000","last_clean":"2023-12-16T01:53:33.013429+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:33.013429+0000","last_undegraded":"2023-12-16T01:53:33.013429+0000","last_fullsized":"2023-12-16T01:53:33.013429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:12:15.019471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.047865+0000","last_change":"2023-12-16T01:25:49.033404+0000","last_active":"2023-12-16T01:53:33.047865+0000","last_peered":"2023-12-16T01:53:33.047865+0000","last_clean":"2023-12-16T01:53:33.047865+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:33.047865+0000","last_undegraded":"2023-12-16T01:53:33.047865+0000","last_fullsized":"2023-12-16T01:53:33.047865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:44.693029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.046823+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:53:33.046823+0000","last_peered":"2023-12-16T01:53:33.046823+0000","last_clean":"2023-12-16T01:53:33.046823+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:53:33.046823+0000","last_undegraded":"2023-12-16T01:53:33.046823+0000","last_fullsized":"2023-12-16T01:53:33.046823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:30.825360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051726+0000","last_change":"2023-12-16T01:25:49.153312+0000","last_active":"2023-12-16T01:53:33.051726+0000","last_peered":"2023-12-16T01:53:33.051726+0000","last_clean":"2023-12-16T01:53:33.051726+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:33.051726+0000","last_undegraded":"2023-12-16T01:53:33.051726+0000","last_fullsized":"2023-12-16T01:53:33.051726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8651,"ondisk_log_size":8651,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542486,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.41099999999999998},"min":{"1min":0.34899999999999998,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42399999999999999,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.64800000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.435,"15min":0.437},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.72799999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.65800000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.66300000000000003},"last":0.502},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.28899999999999998},"max":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.66400000000000003},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.224},"max":{"1min":0.501,"5min":0.61799999999999999,"15min":0.69699999999999995},"last":0.623},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.60299999999999998,"5min":0.627,"15min":0.67900000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.503,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.315,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.66700000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":0.77700000000000002},"last":0.69099999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542484,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.27100000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.63,"5min":0.63,"15min":0.69399999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.45700000000000002,"15min":0.43099999999999999},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.25600000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.86599999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.26100000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67600000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.499}]},{"osd":3,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.92300000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.47999999999999998,"15min":0.46700000000000003},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"min":{"1min":0.28999999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.627}]},{"osd":5,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.254},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.33200000000000002,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.61399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542485,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.438,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.78700000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.26000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.63},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.71699999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":0.54300000000000004,"5min":0.56499999999999995,"15min":0.67400000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.70799999999999996},"last":0.38700000000000001}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.69799999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542486,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.625,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66300000000000003},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.68100000000000005},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.434,"15min":0.42699999999999999},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.443,"15min":0.442},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42099999999999999}]},{"osd":5,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.40000000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.504}]},{"osd":6,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":0.628,"15min":0.68300000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.252},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.72099999999999997},"last":0.433},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60499999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46800000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542485,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.28699999999999998},"min":{"1min":0.22,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29999999999999999},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.215}]},{"osd":1,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.312,"15min":0.30499999999999999},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.45200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.52400000000000002},"last":0.254}]},{"osd":2,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.497,"5min":0.51300000000000001,"15min":0.63400000000000001},"last":0.28699999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.69799999999999995,"15min":0.79300000000000004},"last":0.503}]},{"osd":5,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.64700000000000002},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.55900000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.441},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.314},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.70099999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542485,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.29099999999999998,"15min":0.29399999999999998},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.60499999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.309,"15min":0.30599999999999999},"min":{"1min":0.218,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.54600000000000004},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.56599999999999995},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.315,"15min":0.317},"min":{"1min":0.24199999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.55000000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.67800000000000005},"last":0.374}]},{"osd":4,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.438},"min":{"1min":0.317,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.65000000000000002,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.67900000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.34999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.82899999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.74299999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.69599999999999995,"15min":0.76000000000000001},"last":0.621},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71099999999999997},"last":0.56200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542485,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.314,"15min":0.29899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.253}]},{"osd":2,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30399999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.33400000000000002},"min":{"1min":0.23200000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.20200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.222},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.51500000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.77700000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.76200000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.627,"5min":0.747,"15min":0.96699999999999997},"last":0.498}]},{"osd":7,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.74099999999999999,"15min":0.80700000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.748,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542485,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.216,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54900000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.247}]},{"osd":3,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.312}]},{"osd":4,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.67700000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.40000000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.70399999999999996,"15min":0.753},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.73099999999999998},"last":0.38900000000000001}]},{"osd":7,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:53:49.382 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.383 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.383 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.383 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.384 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.384 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.384 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.384 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.384 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.385 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.385 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.385 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.385 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.386 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.386 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.386 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.386 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.387 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.387 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.387 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.387 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.387 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.388 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.388 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.388 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.388 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.389 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.389 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.389 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.389 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.389 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.389 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.390 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.390 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.390 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.390 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.390 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.391 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.391 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.391 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.391 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.391 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.391 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.392 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.392 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.392 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.392 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.392 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-16T01:25:34.458308+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.393 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.393 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.393 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.393 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.393 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.393 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.394 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.394 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.394 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.394 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.394 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.395 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.396 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.397 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.398 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.399 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.400 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.401 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.402 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.403 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.403 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.403 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:53:49.403 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T01:54:06.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:54:06.194 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:54:09.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:54:09.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.504+0000 7f6035f68640 1 Processor -- start 2023-12-16T01:54:09.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.504+0000 7f6035f68640 1 -- start start 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.504+0000 7f6035f68640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6030153c70 0x7f603015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.504+0000 7f6035f68640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603015a700 con 0x7f60300ceef0 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.504+0000 7f6035f68640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60300ca870 con 0x7f6030153890 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.504+0000 7f6035f68640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6030159af0 con 0x7f6030153c70 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.505+0000 7f602ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f60300ceef0 0x7f603015aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33228/0 (socket says 172.21.15.107:33228) 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.505+0000 7f602ffff640 1 -- 172.21.15.107:0/2407594670 learned_addr learned my addr 172.21.15.107:0/2407594670 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:54:09.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.505+0000 7f602effd640 1 --2- 172.21.15.107:0/2407594670 >> v2:172.21.15.157:3300/0 conn(0x7f6030153c70 0x7f603015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:09.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.507+0000 7f602e7fc640 1 -- 172.21.15.107:0/2407594670 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153216588 0 0) 0x7f603015a700 con 0x7f60300ceef0 2023-12-16T01:54:09.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.508+0000 7f602e7fc640 1 -- 172.21.15.107:0/2407594670 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6018003520 con 0x7f60300ceef0 2023-12-16T01:54:09.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.509+0000 7f602effd640 1 -- 172.21.15.107:0/2407594670 >> v1:172.21.15.157:6789/0 conn(0x7f6030153890 legacy=0x7f60300c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.509+0000 7f602effd640 1 -- 172.21.15.107:0/2407594670 >> v1:172.21.15.107:6789/0 conn(0x7f60300ceef0 legacy=0x7f603015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.509+0000 7f602effd640 1 -- 172.21.15.107:0/2407594670 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030159dd0 con 0x7f6030153c70 2023-12-16T01:54:09.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.515+0000 7f602effd640 1 --2- 172.21.15.107:0/2407594670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153c70 0x7f603015d950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f60240097a0 tx=0x7f602402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76449bc7cb8e215f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:09.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f602e7fc640 1 -- 172.21.15.107:0/2407594670 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602402f810 con 0x7f6030153c70 2023-12-16T01:54:09.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f602e7fc640 1 -- 172.21.15.107:0/2407594670 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602402f970 con 0x7f6030153c70 2023-12-16T01:54:09.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f602e7fc640 1 -- 172.21.15.107:0/2407594670 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602402fd00 con 0x7f6030153c70 2023-12-16T01:54:09.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 -- 172.21.15.107:0/2407594670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153c70 msgr2=0x7f603015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 --2- 172.21.15.107:0/2407594670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153c70 0x7f603015d950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f60240097a0 tx=0x7f602402b9f0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 -- 172.21.15.107:0/2407594670 shutdown_connections 2023-12-16T01:54:09.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 --2- 172.21.15.107:0/2407594670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153c70 0x7f603015d950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 -- 172.21.15.107:0/2407594670 >> 172.21.15.107:0/2407594670 conn(0x7f603006ba00 msgr2=0x7f603006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:54:09.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 -- 172.21.15.107:0/2407594670 shutdown_connections 2023-12-16T01:54:09.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.519+0000 7f6035f68640 1 -- 172.21.15.107:0/2407594670 wait complete. 2023-12-16T01:54:09.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.520+0000 7f6035f68640 1 Processor -- start 2023-12-16T01:54:09.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 -- start start 2023-12-16T01:54:09.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60300ceef0 0x7f60301561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:09.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153890 0x7f60301f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:09.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 0x7f6030154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:09.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030155db0 con 0x7f6030153c70 2023-12-16T01:54:09.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030156eb0 con 0x7f6030153890 2023-12-16T01:54:09.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.521+0000 7f6035f68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60301527e0 con 0x7f60300ceef0 2023-12-16T01:54:09.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.522+0000 7f602ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 0x7f6030154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:09.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.522+0000 7f602effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153890 0x7f60301f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:09.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.522+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60300ceef0 0x7f60301561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:09.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.522+0000 7f602ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 0x7f6030154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56022/0 (socket says 172.21.15.107:56022) 2023-12-16T01:54:09.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.522+0000 7f602ffff640 1 -- 172.21.15.107:0/109859785 learned_addr learned my addr 172.21.15.107:0/109859785 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:54:09.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.525+0000 7f602ffff640 1 -- 172.21.15.107:0/109859785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60300ceef0 msgr2=0x7f60301561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.525+0000 7f602ffff640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60300ceef0 0x7f60301561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.525+0000 7f602ffff640 1 -- 172.21.15.107:0/109859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153890 msgr2=0x7f60301f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.525+0000 7f602ffff640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153890 0x7f60301f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.525+0000 7f602ffff640 1 -- 172.21.15.107:0/109859785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009400 con 0x7f6030153c70 2023-12-16T01:54:09.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.528+0000 7f602ffff640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 0x7f6030154090 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f602800cb40 tx=0x7f602800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:09.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.531+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800aca0 con 0x7f6030153c70 2023-12-16T01:54:09.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.531+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800ae00 con 0x7f6030153c70 2023-12-16T01:54:09.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.531+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028012620 con 0x7f6030153c70 2023-12-16T01:54:09.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.531+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6030152ac0 con 0x7f6030153c70 2023-12-16T01:54:09.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.531+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6030153080 con 0x7f6030153c70 2023-12-16T01:54:09.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.532+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030155ef0 con 0x7f6030153c70 2023-12-16T01:54:09.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.774+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f6028007070 con 0x7f6030153c70 2023-12-16T01:54:09.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.774+0000 7f6017fff640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f601c06ae90 0x7f601c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:09.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.775+0000 7f602f7fe640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f601c06ae90 0x7f601c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:09.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.775+0000 7f602f7fe640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f601c06ae90 0x7f601c06d350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6020001780 tx=0x7f6020009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:09.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.789+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f60280586d0 con 0x7f6030153c70 2023-12-16T01:54:09.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.789+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f6028054a10 con 0x7f6030153c70 2023-12-16T01:54:09.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.964+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6030157c90 con 0x7f601c06ae90 2023-12-16T01:54:09.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.973+0000 7f6017fff640 1 -- 172.21.15.107:0/109859785 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369102 (secure 0 0 0) 0x7f6030157c90 con 0x7f601c06ae90 2023-12-16T01:54:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:54:09.981 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:54:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f601c06ae90 msgr2=0x7f601c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f601c06ae90 0x7f601c06d350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6020001780 tx=0x7f6020009040 comp rx=0 tx=0).stop 2023-12-16T01:54:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 msgr2=0x7f6030154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 0x7f6030154090 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f602800cb40 tx=0x7f602800a060 comp rx=0 tx=0).stop 2023-12-16T01:54:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 shutdown_connections 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6030153c70 0x7f6030154090 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f601c06ae90 0x7f601c06d350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6030153890 0x7f60301f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 --2- 172.21.15.107:0/109859785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60300ceef0 0x7f60301561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 >> 172.21.15.107:0/109859785 conn(0x7f603006ba00 msgr2=0x7f6030073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 shutdown_connections 2023-12-16T01:54:09.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:09.976+0000 7f6035f68640 1 -- 172.21.15.107:0/109859785 wait complete. 2023-12-16T01:54:09.989 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":877,"stamp":"2023-12-16T01:54:08.095951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15805,"ondisk_log_size":15805,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002944"},"pg_stats":[{"pgid":"2.1f","version":"28'624","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.712481+0000","last_change":"2023-12-16T01:53:53.712506+0000","last_active":"2023-12-16T01:53:53.712481+0000","last_peered":"2023-12-16T01:53:53.712481+0000","last_clean":"2023-12-16T01:53:53.712481+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:53.712481+0000","last_undegraded":"2023-12-16T01:53:53.712481+0000","last_fullsized":"2023-12-16T01:53:53.712481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'624","last_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_deep_scrub":"28'624","last_deep_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.712422+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:46.624054+0000","scrub_duration":0.013433865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.195522+0000","last_change":"2023-12-16T01:25:49.117101+0000","last_active":"2023-12-16T01:53:47.195522+0000","last_peered":"2023-12-16T01:53:47.195522+0000","last_clean":"2023-12-16T01:53:47.195522+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:53:47.195522+0000","last_undegraded":"2023-12-16T01:53:47.195522+0000","last_fullsized":"2023-12-16T01:53:47.195522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.522960+0000","last_change":"2023-12-16T01:25:54.978897+0000","last_active":"2023-12-16T01:53:05.522960+0000","last_peered":"2023-12-16T01:53:05.522960+0000","last_clean":"2023-12-16T01:53:05.522960+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:53:05.522960+0000","last_undegraded":"2023-12-16T01:53:05.522960+0000","last_fullsized":"2023-12-16T01:53:05.522960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'727","reported_seq":760,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.195423+0000","last_change":"2023-12-16T01:25:47.900584+0000","last_active":"2023-12-16T01:53:47.195423+0000","last_peered":"2023-12-16T01:53:47.195423+0000","last_clean":"2023-12-16T01:53:47.195423+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:53:47.195423+0000","last_undegraded":"2023-12-16T01:53:47.195423+0000","last_fullsized":"2023-12-16T01:53:47.195423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.140515+0000","last_change":"2023-12-16T01:53:48.140533+0000","last_active":"2023-12-16T01:53:48.140515+0000","last_peered":"2023-12-16T01:53:48.140515+0000","last_clean":"2023-12-16T01:53:48.140515+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:48.140515+0000","last_undegraded":"2023-12-16T01:53:48.140515+0000","last_fullsized":"2023-12-16T01:53:48.140515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.140450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:41.931150+0000","scrub_duration":0.0013849089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":156,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.950759+0000","last_change":"2023-12-16T01:25:54.975888+0000","last_active":"2023-12-16T01:52:58.950759+0000","last_peered":"2023-12-16T01:52:58.950759+0000","last_clean":"2023-12-16T01:52:58.950759+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:52:58.950759+0000","last_undegraded":"2023-12-16T01:52:58.950759+0000","last_fullsized":"2023-12-16T01:52:58.950759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1397","reported_seq":1435,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.109371+0000","last_change":"2023-12-16T01:53:59.109396+0000","last_active":"2023-12-16T01:53:59.109371+0000","last_peered":"2023-12-16T01:53:59.109371+0000","last_clean":"2023-12-16T01:53:59.109371+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:59.109371+0000","last_undegraded":"2023-12-16T01:53:59.109371+0000","last_fullsized":"2023-12-16T01:53:59.109371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1397","last_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_deep_scrub":"28'1397","last_deep_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.109317+0000","objects_scrubbed":3,"log_size":1397,"log_dups_size":0,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:26.537787+0000","scrub_duration":0.0258877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.858232+0000","last_change":"2023-12-16T01:53:51.858251+0000","last_active":"2023-12-16T01:53:51.858232+0000","last_peered":"2023-12-16T01:53:51.858232+0000","last_clean":"2023-12-16T01:53:51.858232+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:51.858232+0000","last_undegraded":"2023-12-16T01:53:51.858232+0000","last_fullsized":"2023-12-16T01:53:51.858232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.858159+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:58:51.979244+0000","scrub_duration":0.00087977699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:28.896253+0000","last_change":"2023-12-16T01:25:54.986447+0000","last_active":"2023-12-16T01:53:28.896253+0000","last_peered":"2023-12-16T01:53:28.896253+0000","last_clean":"2023-12-16T01:53:28.896253+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:53:28.896253+0000","last_undegraded":"2023-12-16T01:53:28.896253+0000","last_fullsized":"2023-12-16T01:53:28.896253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:19.735934+0000","last_change":"2023-12-16T01:25:47.876302+0000","last_active":"2023-12-16T01:53:19.735934+0000","last_peered":"2023-12-16T01:53:19.735934+0000","last_clean":"2023-12-16T01:53:19.735934+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:53:19.735934+0000","last_undegraded":"2023-12-16T01:53:19.735934+0000","last_fullsized":"2023-12-16T01:53:19.735934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003266+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003266+0000","last_peered":"2023-12-16T01:53:33.003266+0000","last_clean":"2023-12-16T01:53:33.003266+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003266+0000","last_undegraded":"2023-12-16T01:53:33.003266+0000","last_fullsized":"2023-12-16T01:53:33.003266+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:28.896221+0000","last_change":"2023-12-16T01:25:54.980988+0000","last_active":"2023-12-16T01:53:28.896221+0000","last_peered":"2023-12-16T01:53:28.896221+0000","last_clean":"2023-12-16T01:53:28.896221+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:53:28.896221+0000","last_undegraded":"2023-12-16T01:53:28.896221+0000","last_fullsized":"2023-12-16T01:53:28.896221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649750+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:53:45.649750+0000","last_peered":"2023-12-16T01:53:45.649750+0000","last_clean":"2023-12-16T01:53:45.649750+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:53:45.649750+0000","last_undegraded":"2023-12-16T01:53:45.649750+0000","last_fullsized":"2023-12-16T01:53:45.649750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'637","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.844023+0000","last_change":"2023-12-16T01:25:47.895581+0000","last_active":"2023-12-16T01:53:25.844023+0000","last_peered":"2023-12-16T01:53:25.844023+0000","last_clean":"2023-12-16T01:53:25.844023+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:53:25.844023+0000","last_undegraded":"2023-12-16T01:53:25.844023+0000","last_fullsized":"2023-12-16T01:53:25.844023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":139,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503440+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503440+0000","last_peered":"2023-12-16T01:53:05.503440+0000","last_clean":"2023-12-16T01:53:05.503440+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503440+0000","last_undegraded":"2023-12-16T01:53:05.503440+0000","last_fullsized":"2023-12-16T01:53:05.503440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.376779+0000","last_change":"2023-12-16T01:54:00.376828+0000","last_active":"2023-12-16T01:54:00.376779+0000","last_peered":"2023-12-16T01:54:00.376779+0000","last_clean":"2023-12-16T01:54:00.376779+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:54:00.376779+0000","last_undegraded":"2023-12-16T01:54:00.376779+0000","last_fullsized":"2023-12-16T01:54:00.376779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.376682+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:29.025843+0000","scrub_duration":0.0016058649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958438+0000","last_change":"2023-12-16T01:25:47.900789+0000","last_active":"2023-12-16T01:53:47.958438+0000","last_peered":"2023-12-16T01:53:47.958438+0000","last_clean":"2023-12-16T01:53:47.958438+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:53:47.958438+0000","last_undegraded":"2023-12-16T01:53:47.958438+0000","last_fullsized":"2023-12-16T01:53:47.958438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.550820+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:53:04.550820+0000","last_peered":"2023-12-16T01:53:04.550820+0000","last_clean":"2023-12-16T01:53:04.550820+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:53:04.550820+0000","last_undegraded":"2023-12-16T01:53:04.550820+0000","last_fullsized":"2023-12-16T01:53:04.550820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413263+0000","last_change":"2023-12-16T01:25:49.121947+0000","last_active":"2023-12-16T01:53:46.413263+0000","last_peered":"2023-12-16T01:53:46.413263+0000","last_clean":"2023-12-16T01:53:46.413263+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:53:46.413263+0000","last_undegraded":"2023-12-16T01:53:46.413263+0000","last_fullsized":"2023-12-16T01:53:46.413263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.669327+0000","last_change":"2023-12-16T01:53:54.669327+0000","last_active":"2023-12-16T01:53:54.669327+0000","last_peered":"2023-12-16T01:53:54.669327+0000","last_clean":"2023-12-16T01:53:54.669327+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:53:54.669327+0000","last_undegraded":"2023-12-16T01:53:54.669327+0000","last_fullsized":"2023-12-16T01:53:54.669327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.669197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.939886+0000","scrub_duration":0.0011923369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.403003+0000","last_change":"2023-12-16T01:25:54.985958+0000","last_active":"2023-12-16T01:53:03.403003+0000","last_peered":"2023-12-16T01:53:03.403003+0000","last_clean":"2023-12-16T01:53:03.403003+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:53:03.403003+0000","last_undegraded":"2023-12-16T01:53:03.403003+0000","last_fullsized":"2023-12-16T01:53:03.403003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.122613+0000","last_change":"2023-12-16T01:53:59.122633+0000","last_active":"2023-12-16T01:53:59.122613+0000","last_peered":"2023-12-16T01:53:59.122613+0000","last_clean":"2023-12-16T01:53:59.122613+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:59.122613+0000","last_undegraded":"2023-12-16T01:53:59.122613+0000","last_fullsized":"2023-12-16T01:53:59.122613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.122554+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:09:35.015552+0000","scrub_duration":0.0010611500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.086079+0000","last_change":"2023-12-16T01:53:57.086079+0000","last_active":"2023-12-16T01:53:57.086079+0000","last_peered":"2023-12-16T01:53:57.086079+0000","last_clean":"2023-12-16T01:53:57.086079+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:57.086079+0000","last_undegraded":"2023-12-16T01:53:57.086079+0000","last_fullsized":"2023-12-16T01:53:57.086079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.085993+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:03.237603+0000","scrub_duration":0.0009980989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":151,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.511939+0000","last_change":"2023-12-16T01:25:54.982279+0000","last_active":"2023-12-16T01:53:05.511939+0000","last_peered":"2023-12-16T01:53:05.511939+0000","last_clean":"2023-12-16T01:53:05.511939+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:53:05.511939+0000","last_undegraded":"2023-12-16T01:53:05.511939+0000","last_fullsized":"2023-12-16T01:53:05.511939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413129+0000","last_change":"2023-12-16T01:25:49.120660+0000","last_active":"2023-12-16T01:53:46.413129+0000","last_peered":"2023-12-16T01:53:46.413129+0000","last_clean":"2023-12-16T01:53:46.413129+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:53:46.413129+0000","last_undegraded":"2023-12-16T01:53:46.413129+0000","last_fullsized":"2023-12-16T01:53:46.413129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649616+0000","last_change":"2023-12-16T01:25:47.895809+0000","last_active":"2023-12-16T01:53:45.649616+0000","last_peered":"2023-12-16T01:53:45.649616+0000","last_clean":"2023-12-16T01:53:45.649616+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:53:45.649616+0000","last_undegraded":"2023-12-16T01:53:45.649616+0000","last_fullsized":"2023-12-16T01:53:45.649616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553808+0000","last_change":"2023-12-16T01:25:54.984275+0000","last_active":"2023-12-16T01:53:04.553808+0000","last_peered":"2023-12-16T01:53:04.553808+0000","last_clean":"2023-12-16T01:53:04.553808+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:53:04.553808+0000","last_undegraded":"2023-12-16T01:53:04.553808+0000","last_fullsized":"2023-12-16T01:53:04.553808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413150+0000","last_change":"2023-12-16T01:25:49.113438+0000","last_active":"2023-12-16T01:53:46.413150+0000","last_peered":"2023-12-16T01:53:46.413150+0000","last_clean":"2023-12-16T01:53:46.413150+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:53:46.413150+0000","last_undegraded":"2023-12-16T01:53:46.413150+0000","last_fullsized":"2023-12-16T01:53:46.413150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'310","reported_seq":343,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413053+0000","last_change":"2023-12-16T01:25:47.873686+0000","last_active":"2023-12-16T01:53:46.413053+0000","last_peered":"2023-12-16T01:53:46.413053+0000","last_clean":"2023-12-16T01:53:46.413053+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:53:46.413053+0000","last_undegraded":"2023-12-16T01:53:46.413053+0000","last_fullsized":"2023-12-16T01:53:46.413053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413283+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:53:46.413283+0000","last_peered":"2023-12-16T01:53:46.413283+0000","last_clean":"2023-12-16T01:53:46.413283+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:53:46.413283+0000","last_undegraded":"2023-12-16T01:53:46.413283+0000","last_fullsized":"2023-12-16T01:53:46.413283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.984742+0000","last_change":"2023-12-16T01:25:49.114208+0000","last_active":"2023-12-16T01:53:32.984742+0000","last_peered":"2023-12-16T01:53:32.984742+0000","last_clean":"2023-12-16T01:53:32.984742+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:53:32.984742+0000","last_undegraded":"2023-12-16T01:53:32.984742+0000","last_fullsized":"2023-12-16T01:53:32.984742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:21.783929+0000","last_change":"2023-12-16T01:25:47.897518+0000","last_active":"2023-12-16T01:53:21.783929+0000","last_peered":"2023-12-16T01:53:21.783929+0000","last_clean":"2023-12-16T01:53:21.783929+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:53:21.783929+0000","last_undegraded":"2023-12-16T01:53:21.783929+0000","last_fullsized":"2023-12-16T01:53:21.783929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.520259+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:53:05.520259+0000","last_peered":"2023-12-16T01:53:05.520259+0000","last_clean":"2023-12-16T01:53:05.520259+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:53:05.520259+0000","last_undegraded":"2023-12-16T01:53:05.520259+0000","last_fullsized":"2023-12-16T01:53:05.520259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.810864+0000","last_change":"2023-12-16T01:53:53.810913+0000","last_active":"2023-12-16T01:53:53.810864+0000","last_peered":"2023-12-16T01:53:53.810864+0000","last_clean":"2023-12-16T01:53:53.810864+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:53.810864+0000","last_undegraded":"2023-12-16T01:53:53.810864+0000","last_fullsized":"2023-12-16T01:53:53.810864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.810791+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:09.911252+0000","scrub_duration":0.001403133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.013004+0000","last_change":"2023-12-16T01:53:59.013024+0000","last_active":"2023-12-16T01:53:59.013004+0000","last_peered":"2023-12-16T01:53:59.013004+0000","last_clean":"2023-12-16T01:53:59.013004+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:59.013004+0000","last_undegraded":"2023-12-16T01:53:59.013004+0000","last_fullsized":"2023-12-16T01:53:59.013004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.012926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:06.476212+0000","scrub_duration":0.001035209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":220,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.819194+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:53:03.819194+0000","last_peered":"2023-12-16T01:53:03.819194+0000","last_clean":"2023-12-16T01:53:03.819194+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:53:03.819194+0000","last_undegraded":"2023-12-16T01:53:03.819194+0000","last_fullsized":"2023-12-16T01:53:03.819194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.051932+0000","last_change":"2023-12-16T01:25:49.146880+0000","last_active":"2023-12-16T01:53:33.051932+0000","last_peered":"2023-12-16T01:53:33.051932+0000","last_clean":"2023-12-16T01:53:33.051932+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:53:33.051932+0000","last_undegraded":"2023-12-16T01:53:33.051932+0000","last_fullsized":"2023-12-16T01:53:33.051932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.782227+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:53:22.782227+0000","last_peered":"2023-12-16T01:53:22.782227+0000","last_clean":"2023-12-16T01:53:22.782227+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:53:22.782227+0000","last_undegraded":"2023-12-16T01:53:22.782227+0000","last_fullsized":"2023-12-16T01:53:22.782227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.526066+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:53:05.526066+0000","last_peered":"2023-12-16T01:53:05.526066+0000","last_clean":"2023-12-16T01:53:05.526066+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:53:05.526066+0000","last_undegraded":"2023-12-16T01:53:05.526066+0000","last_fullsized":"2023-12-16T01:53:05.526066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.195445+0000","last_change":"2023-12-16T01:25:49.123371+0000","last_active":"2023-12-16T01:53:47.195445+0000","last_peered":"2023-12-16T01:53:47.195445+0000","last_clean":"2023-12-16T01:53:47.195445+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:53:47.195445+0000","last_undegraded":"2023-12-16T01:53:47.195445+0000","last_fullsized":"2023-12-16T01:53:47.195445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2056,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.230907+0000","last_change":"2023-12-16T01:53:49.230942+0000","last_active":"2023-12-16T01:53:49.230907+0000","last_peered":"2023-12-16T01:53:49.230907+0000","last_clean":"2023-12-16T01:53:49.230907+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:49.230907+0000","last_undegraded":"2023-12-16T01:53:49.230907+0000","last_fullsized":"2023-12-16T01:53:49.230907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1009","last_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_deep_scrub":"28'1009","last_deep_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.230821+0000","objects_scrubbed":1,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:23.521655+0000","scrub_duration":0.0014598370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":175,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.483067+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:53:05.483067+0000","last_peered":"2023-12-16T01:53:05.483067+0000","last_clean":"2023-12-16T01:53:05.483067+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:53:05.483067+0000","last_undegraded":"2023-12-16T01:53:05.483067+0000","last_fullsized":"2023-12-16T01:53:05.483067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.988258+0000","last_change":"2023-12-16T01:25:49.117752+0000","last_active":"2023-12-16T01:53:32.988258+0000","last_peered":"2023-12-16T01:53:32.988258+0000","last_clean":"2023-12-16T01:53:32.988258+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:53:32.988258+0000","last_undegraded":"2023-12-16T01:53:32.988258+0000","last_fullsized":"2023-12-16T01:53:32.988258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'555","reported_seq":588,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649585+0000","last_change":"2023-12-16T01:25:47.899990+0000","last_active":"2023-12-16T01:53:45.649585+0000","last_peered":"2023-12-16T01:53:45.649585+0000","last_clean":"2023-12-16T01:53:45.649585+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:53:45.649585+0000","last_undegraded":"2023-12-16T01:53:45.649585+0000","last_fullsized":"2023-12-16T01:53:45.649585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.500510+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:53:05.500510+0000","last_peered":"2023-12-16T01:53:05.500510+0000","last_clean":"2023-12-16T01:53:05.500510+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:53:05.500510+0000","last_undegraded":"2023-12-16T01:53:05.500510+0000","last_fullsized":"2023-12-16T01:53:05.500510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092108+0000","last_change":"2023-12-16T01:25:49.117770+0000","last_active":"2023-12-16T01:53:33.092108+0000","last_peered":"2023-12-16T01:53:33.092108+0000","last_clean":"2023-12-16T01:53:33.092108+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:53:33.092108+0000","last_undegraded":"2023-12-16T01:53:33.092108+0000","last_fullsized":"2023-12-16T01:53:33.092108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:15.716886+0000","last_change":"2023-12-16T01:25:47.895541+0000","last_active":"2023-12-16T01:53:15.716886+0000","last_peered":"2023-12-16T01:53:15.716886+0000","last_clean":"2023-12-16T01:53:15.716886+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:53:15.716886+0000","last_undegraded":"2023-12-16T01:53:15.716886+0000","last_fullsized":"2023-12-16T01:53:15.716886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:44.814945+0000","last_change":"2023-12-16T01:53:44.814970+0000","last_active":"2023-12-16T01:53:44.814945+0000","last_peered":"2023-12-16T01:53:44.814945+0000","last_clean":"2023-12-16T01:53:44.814945+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:53:44.814945+0000","last_undegraded":"2023-12-16T01:53:44.814945+0000","last_fullsized":"2023-12-16T01:53:44.814945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_clean_scrub_stamp":"2023-12-16T01:53:44.814880+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:43.334912+0000","scrub_duration":0.0039548450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:08.960638+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:53:08.960638+0000","last_peered":"2023-12-16T01:53:08.960638+0000","last_clean":"2023-12-16T01:53:08.960638+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:53:08.960638+0000","last_undegraded":"2023-12-16T01:53:08.960638+0000","last_fullsized":"2023-12-16T01:53:08.960638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.144912+0000","last_change":"2023-12-16T01:53:55.144935+0000","last_active":"2023-12-16T01:53:55.144912+0000","last_peered":"2023-12-16T01:53:55.144912+0000","last_clean":"2023-12-16T01:53:55.144912+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:55.144912+0000","last_undegraded":"2023-12-16T01:53:55.144912+0000","last_fullsized":"2023-12-16T01:53:55.144912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.144831+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:38.126196+0000","scrub_duration":0.001096376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.254172+0000","last_change":"2023-12-16T01:53:59.254191+0000","last_active":"2023-12-16T01:53:59.254172+0000","last_peered":"2023-12-16T01:53:59.254172+0000","last_clean":"2023-12-16T01:53:59.254172+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:59.254172+0000","last_undegraded":"2023-12-16T01:53:59.254172+0000","last_fullsized":"2023-12-16T01:53:59.254172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.254108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:27.903270+0000","scrub_duration":0.0011951380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.523040+0000","last_change":"2023-12-16T01:25:54.985096+0000","last_active":"2023-12-16T01:53:05.523040+0000","last_peered":"2023-12-16T01:53:05.523040+0000","last_clean":"2023-12-16T01:53:05.523040+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:53:05.523040+0000","last_undegraded":"2023-12-16T01:53:05.523040+0000","last_fullsized":"2023-12-16T01:53:05.523040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.072588+0000","last_change":"2023-12-16T01:25:49.147379+0000","last_active":"2023-12-16T01:53:33.072588+0000","last_peered":"2023-12-16T01:53:33.072588+0000","last_clean":"2023-12-16T01:53:33.072588+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:53:33.072588+0000","last_undegraded":"2023-12-16T01:53:33.072588+0000","last_fullsized":"2023-12-16T01:53:33.072588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.017317+0000","last_change":"2023-12-16T01:53:58.017355+0000","last_active":"2023-12-16T01:53:58.017317+0000","last_peered":"2023-12-16T01:53:58.017317+0000","last_clean":"2023-12-16T01:53:58.017317+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:58.017317+0000","last_undegraded":"2023-12-16T01:53:58.017317+0000","last_fullsized":"2023-12-16T01:53:58.017317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.017183+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:25.445654+0000","scrub_duration":0.0031128100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":218,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553983+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:53:04.553983+0000","last_peered":"2023-12-16T01:53:04.553983+0000","last_clean":"2023-12-16T01:53:04.553983+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:53:04.553983+0000","last_undegraded":"2023-12-16T01:53:04.553983+0000","last_fullsized":"2023-12-16T01:53:04.553983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075656+0000","last_change":"2023-12-16T01:25:49.140756+0000","last_active":"2023-12-16T01:53:33.075656+0000","last_peered":"2023-12-16T01:53:33.075656+0000","last_clean":"2023-12-16T01:53:33.075656+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:53:33.075656+0000","last_undegraded":"2023-12-16T01:53:33.075656+0000","last_fullsized":"2023-12-16T01:53:33.075656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:25.854952+0000","last_change":"2023-12-16T01:25:47.899885+0000","last_active":"2023-12-16T01:53:25.854952+0000","last_peered":"2023-12-16T01:53:25.854952+0000","last_clean":"2023-12-16T01:53:25.854952+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:53:25.854952+0000","last_undegraded":"2023-12-16T01:53:25.854952+0000","last_fullsized":"2023-12-16T01:53:25.854952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:01.760176+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:53:01.760176+0000","last_peered":"2023-12-16T01:53:01.760176+0000","last_clean":"2023-12-16T01:53:01.760176+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:53:01.760176+0000","last_undegraded":"2023-12-16T01:53:01.760176+0000","last_fullsized":"2023-12-16T01:53:01.760176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.720677+0000","last_change":"2023-12-16T01:53:56.720697+0000","last_active":"2023-12-16T01:53:56.720677+0000","last_peered":"2023-12-16T01:53:56.720677+0000","last_clean":"2023-12-16T01:53:56.720677+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:56.720677+0000","last_undegraded":"2023-12-16T01:53:56.720677+0000","last_fullsized":"2023-12-16T01:53:56.720677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.720597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:33.671876+0000","scrub_duration":0.0010248239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.064394+0000","last_change":"2023-12-16T01:53:56.064453+0000","last_active":"2023-12-16T01:53:56.064394+0000","last_peered":"2023-12-16T01:53:56.064394+0000","last_clean":"2023-12-16T01:53:56.064394+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:53:56.064394+0000","last_undegraded":"2023-12-16T01:53:56.064394+0000","last_fullsized":"2023-12-16T01:53:56.064394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.064317+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:54.927425+0000","scrub_duration":0.0028072420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.827322+0000","last_change":"2023-12-16T01:54:03.827344+0000","last_active":"2023-12-16T01:54:03.827322+0000","last_peered":"2023-12-16T01:54:03.827322+0000","last_clean":"2023-12-16T01:54:03.827322+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:54:03.827322+0000","last_undegraded":"2023-12-16T01:54:03.827322+0000","last_fullsized":"2023-12-16T01:54:03.827322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.827247+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:04.241218+0000","scrub_duration":0.001453356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.124361+0000","last_change":"2023-12-16T01:53:54.124381+0000","last_active":"2023-12-16T01:53:54.124361+0000","last_peered":"2023-12-16T01:53:54.124361+0000","last_clean":"2023-12-16T01:53:54.124361+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:54.124361+0000","last_undegraded":"2023-12-16T01:53:54.124361+0000","last_fullsized":"2023-12-16T01:53:54.124361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.124293+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:11.195283+0000","scrub_duration":0.00092168199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.759978+0000","last_change":"2023-12-16T01:53:57.760032+0000","last_active":"2023-12-16T01:53:57.759978+0000","last_peered":"2023-12-16T01:53:57.759978+0000","last_clean":"2023-12-16T01:53:57.759978+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:53:57.759978+0000","last_undegraded":"2023-12-16T01:53:57.759978+0000","last_fullsized":"2023-12-16T01:53:57.759978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.759893+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:51.550594+0000","scrub_duration":0.0035525439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553957+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:53:04.553957+0000","last_peered":"2023-12-16T01:53:04.553957+0000","last_clean":"2023-12-16T01:53:04.553957+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:53:04.553957+0000","last_undegraded":"2023-12-16T01:53:04.553957+0000","last_fullsized":"2023-12-16T01:53:04.553957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.762139+0000","last_change":"2023-12-16T01:53:46.762139+0000","last_active":"2023-12-16T01:53:46.762139+0000","last_peered":"2023-12-16T01:53:46.762139+0000","last_clean":"2023-12-16T01:53:46.762139+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:46.762139+0000","last_undegraded":"2023-12-16T01:53:46.762139+0000","last_fullsized":"2023-12-16T01:53:46.762139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_clean_scrub_stamp":"2023-12-16T01:53:46.762050+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:14:34.070815+0000","scrub_duration":0.00115817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.074927+0000","last_change":"2023-12-16T01:54:00.074946+0000","last_active":"2023-12-16T01:54:00.074927+0000","last_peered":"2023-12-16T01:54:00.074927+0000","last_clean":"2023-12-16T01:54:00.074927+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:54:00.074927+0000","last_undegraded":"2023-12-16T01:54:00.074927+0000","last_fullsized":"2023-12-16T01:54:00.074927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.074849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:07.538136+0000","scrub_duration":0.0010289749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":167,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.942318+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:52:58.942318+0000","last_peered":"2023-12-16T01:52:58.942318+0000","last_clean":"2023-12-16T01:52:58.942318+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:52:58.942318+0000","last_undegraded":"2023-12-16T01:52:58.942318+0000","last_fullsized":"2023-12-16T01:52:58.942318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649821+0000","last_change":"2023-12-16T01:25:49.155371+0000","last_active":"2023-12-16T01:53:45.649821+0000","last_peered":"2023-12-16T01:53:45.649821+0000","last_clean":"2023-12-16T01:53:45.649821+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:53:45.649821+0000","last_undegraded":"2023-12-16T01:53:45.649821+0000","last_fullsized":"2023-12-16T01:53:45.649821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649700+0000","last_change":"2023-12-16T01:25:47.896450+0000","last_active":"2023-12-16T01:53:45.649700+0000","last_peered":"2023-12-16T01:53:45.649700+0000","last_clean":"2023-12-16T01:53:45.649700+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:53:45.649700+0000","last_undegraded":"2023-12-16T01:53:45.649700+0000","last_fullsized":"2023-12-16T01:53:45.649700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958609+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:53:47.958609+0000","last_peered":"2023-12-16T01:53:47.958609+0000","last_clean":"2023-12-16T01:53:47.958609+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:53:47.958609+0000","last_undegraded":"2023-12-16T01:53:47.958609+0000","last_fullsized":"2023-12-16T01:53:47.958609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958482+0000","last_change":"2023-12-16T01:25:49.154328+0000","last_active":"2023-12-16T01:53:47.958482+0000","last_peered":"2023-12-16T01:53:47.958482+0000","last_clean":"2023-12-16T01:53:47.958482+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:53:47.958482+0000","last_undegraded":"2023-12-16T01:53:47.958482+0000","last_fullsized":"2023-12-16T01:53:47.958482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'305","reported_seq":345,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.287784+0000","last_change":"2023-12-16T01:53:54.287821+0000","last_active":"2023-12-16T01:53:54.287784+0000","last_peered":"2023-12-16T01:53:54.287784+0000","last_clean":"2023-12-16T01:53:54.287784+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:54.287784+0000","last_undegraded":"2023-12-16T01:53:54.287784+0000","last_fullsized":"2023-12-16T01:53:54.287784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'305","last_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_deep_scrub":"28'305","last_deep_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.287730+0000","objects_scrubbed":3,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:54.985981+0000","scrub_duration":0.0098894640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551382+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:04.551382+0000","last_peered":"2023-12-16T01:53:04.551382+0000","last_clean":"2023-12-16T01:53:04.551382+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:04.551382+0000","last_undegraded":"2023-12-16T01:53:04.551382+0000","last_fullsized":"2023-12-16T01:53:04.551382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.122651+0000","last_change":"2023-12-16T01:53:53.122671+0000","last_active":"2023-12-16T01:53:53.122651+0000","last_peered":"2023-12-16T01:53:53.122651+0000","last_clean":"2023-12-16T01:53:53.122651+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:53.122651+0000","last_undegraded":"2023-12-16T01:53:53.122651+0000","last_fullsized":"2023-12-16T01:53:53.122651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.122566+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:09.183578+0000","scrub_duration":0.0013206579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'862","reported_seq":902,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.890311+0000","last_change":"2023-12-16T01:53:48.890311+0000","last_active":"2023-12-16T01:53:48.890311+0000","last_peered":"2023-12-16T01:53:48.890311+0000","last_clean":"2023-12-16T01:53:48.890311+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:48.890311+0000","last_undegraded":"2023-12-16T01:53:48.890311+0000","last_fullsized":"2023-12-16T01:53:48.890311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'862","last_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_deep_scrub":"28'862","last_deep_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.890224+0000","objects_scrubbed":4,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:27.964886+0000","scrub_duration":0.017688373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413315+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:53:46.413315+0000","last_peered":"2023-12-16T01:53:46.413315+0000","last_clean":"2023-12-16T01:53:46.413315+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:53:46.413315+0000","last_undegraded":"2023-12-16T01:53:46.413315+0000","last_fullsized":"2023-12-16T01:53:46.413315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.035555+0000","last_change":"2023-12-16T01:53:50.035555+0000","last_active":"2023-12-16T01:53:50.035555+0000","last_peered":"2023-12-16T01:53:50.035555+0000","last_clean":"2023-12-16T01:53:50.035555+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:50.035555+0000","last_undegraded":"2023-12-16T01:53:50.035555+0000","last_fullsized":"2023-12-16T01:53:50.035555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.035441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:24:50.625126+0000","scrub_duration":0.000932255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'733","reported_seq":772,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.268484+0000","last_change":"2023-12-16T01:53:55.268530+0000","last_active":"2023-12-16T01:53:55.268484+0000","last_peered":"2023-12-16T01:53:55.268484+0000","last_clean":"2023-12-16T01:53:55.268484+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:55.268484+0000","last_undegraded":"2023-12-16T01:53:55.268484+0000","last_fullsized":"2023-12-16T01:53:55.268484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'733","last_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_deep_scrub":"28'733","last_deep_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.268403+0000","objects_scrubbed":2,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:47.666935+0000","scrub_duration":0.0025599799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:44.901866+0000","last_change":"2023-12-16T01:25:54.983257+0000","last_active":"2023-12-16T01:53:44.901866+0000","last_peered":"2023-12-16T01:53:44.901866+0000","last_clean":"2023-12-16T01:53:44.901866+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:53:44.901866+0000","last_undegraded":"2023-12-16T01:53:44.901866+0000","last_fullsized":"2023-12-16T01:53:44.901866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.052771+0000","last_change":"2023-12-16T01:25:49.153787+0000","last_active":"2023-12-16T01:53:33.052771+0000","last_peered":"2023-12-16T01:53:33.052771+0000","last_clean":"2023-12-16T01:53:33.052771+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:53:33.052771+0000","last_undegraded":"2023-12-16T01:53:33.052771+0000","last_fullsized":"2023-12-16T01:53:33.052771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.107511+0000","last_change":"2023-12-16T01:53:54.107532+0000","last_active":"2023-12-16T01:53:54.107511+0000","last_peered":"2023-12-16T01:53:54.107511+0000","last_clean":"2023-12-16T01:53:54.107511+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:54.107511+0000","last_undegraded":"2023-12-16T01:53:54.107511+0000","last_fullsized":"2023-12-16T01:53:54.107511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.107444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:13.177048+0000","scrub_duration":0.0010581900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.351537+0000","last_change":"2023-12-16T01:54:02.351560+0000","last_active":"2023-12-16T01:54:02.351537+0000","last_peered":"2023-12-16T01:54:02.351537+0000","last_clean":"2023-12-16T01:54:02.351537+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:54:02.351537+0000","last_undegraded":"2023-12-16T01:54:02.351537+0000","last_fullsized":"2023-12-16T01:54:02.351537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.351459+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:39.889377+0000","scrub_duration":0.0017115850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.737412+0000","last_change":"2023-12-16T01:54:00.737430+0000","last_active":"2023-12-16T01:54:00.737412+0000","last_peered":"2023-12-16T01:54:00.737412+0000","last_clean":"2023-12-16T01:54:00.737412+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:54:00.737412+0000","last_undegraded":"2023-12-16T01:54:00.737412+0000","last_fullsized":"2023-12-16T01:54:00.737412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.737350+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:56.008039+0000","scrub_duration":0.000879626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.810899+0000","last_change":"2023-12-16T01:53:45.810944+0000","last_active":"2023-12-16T01:53:45.810899+0000","last_peered":"2023-12-16T01:53:45.810899+0000","last_clean":"2023-12-16T01:53:45.810899+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:45.810899+0000","last_undegraded":"2023-12-16T01:53:45.810899+0000","last_fullsized":"2023-12-16T01:53:45.810899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_clean_scrub_stamp":"2023-12-16T01:53:45.810796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:43:50.027324+0000","scrub_duration":0.0012633939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413309+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:53:46.413309+0000","last_peered":"2023-12-16T01:53:46.413309+0000","last_clean":"2023-12-16T01:53:46.413309+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:53:46.413309+0000","last_undegraded":"2023-12-16T01:53:46.413309+0000","last_fullsized":"2023-12-16T01:53:46.413309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":167,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413397+0000","last_change":"2023-12-16T01:25:54.979928+0000","last_active":"2023-12-16T01:53:46.413397+0000","last_peered":"2023-12-16T01:53:46.413397+0000","last_clean":"2023-12-16T01:53:46.413397+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:53:46.413397+0000","last_undegraded":"2023-12-16T01:53:46.413397+0000","last_fullsized":"2023-12-16T01:53:46.413397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.091819+0000","last_change":"2023-12-16T01:25:49.117762+0000","last_active":"2023-12-16T01:53:33.091819+0000","last_peered":"2023-12-16T01:53:33.091819+0000","last_clean":"2023-12-16T01:53:33.091819+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:53:33.091819+0000","last_undegraded":"2023-12-16T01:53:33.091819+0000","last_fullsized":"2023-12-16T01:53:33.091819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:23.831672+0000","last_change":"2023-12-16T01:25:47.894593+0000","last_active":"2023-12-16T01:53:23.831672+0000","last_peered":"2023-12-16T01:53:23.831672+0000","last_clean":"2023-12-16T01:53:23.831672+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:53:23.831672+0000","last_undegraded":"2023-12-16T01:53:23.831672+0000","last_fullsized":"2023-12-16T01:53:23.831672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:38.989803+0000","last_change":"2023-12-16T01:26:31.583645+0000","last_active":"2023-12-16T01:53:38.989803+0000","last_peered":"2023-12-16T01:53:38.989803+0000","last_clean":"2023-12-16T01:53:38.989803+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:53:38.989803+0000","last_undegraded":"2023-12-16T01:53:38.989803+0000","last_fullsized":"2023-12-16T01:53:38.989803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.029996+0000","last_change":"2023-12-16T01:53:54.030017+0000","last_active":"2023-12-16T01:53:54.029996+0000","last_peered":"2023-12-16T01:53:54.029996+0000","last_clean":"2023-12-16T01:53:54.029996+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:54.029996+0000","last_undegraded":"2023-12-16T01:53:54.029996+0000","last_fullsized":"2023-12-16T01:53:54.029996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.029929+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:00.181539+0000","scrub_duration":0.0010094170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.153531+0000","last_change":"2023-12-16T01:53:56.153566+0000","last_active":"2023-12-16T01:53:56.153531+0000","last_peered":"2023-12-16T01:53:56.153531+0000","last_clean":"2023-12-16T01:53:56.153531+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:56.153531+0000","last_undegraded":"2023-12-16T01:53:56.153531+0000","last_fullsized":"2023-12-16T01:53:56.153531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.153447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:39.166123+0000","scrub_duration":0.0013686760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'706","reported_seq":736,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:18.961637+0000","last_change":"2023-12-16T01:25:47.897466+0000","last_active":"2023-12-16T01:53:18.961637+0000","last_peered":"2023-12-16T01:53:18.961637+0000","last_clean":"2023-12-16T01:53:18.961637+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:53:18.961637+0000","last_undegraded":"2023-12-16T01:53:18.961637+0000","last_fullsized":"2023-12-16T01:53:18.961637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.092271+0000","last_change":"2023-12-16T01:25:49.146545+0000","last_active":"2023-12-16T01:53:33.092271+0000","last_peered":"2023-12-16T01:53:33.092271+0000","last_clean":"2023-12-16T01:53:33.092271+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:53:33.092271+0000","last_undegraded":"2023-12-16T01:53:33.092271+0000","last_fullsized":"2023-12-16T01:53:33.092271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:24.793109+0000","last_change":"2023-12-16T01:26:31.583485+0000","last_active":"2023-12-16T01:53:24.793109+0000","last_peered":"2023-12-16T01:53:24.793109+0000","last_clean":"2023-12-16T01:53:24.793109+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:53:24.793109+0000","last_undegraded":"2023-12-16T01:53:24.793109+0000","last_fullsized":"2023-12-16T01:53:24.793109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'708","reported_seq":746,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.044464+0000","last_change":"2023-12-16T01:54:00.044489+0000","last_active":"2023-12-16T01:54:00.044464+0000","last_peered":"2023-12-16T01:54:00.044464+0000","last_clean":"2023-12-16T01:54:00.044464+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:54:00.044464+0000","last_undegraded":"2023-12-16T01:54:00.044464+0000","last_fullsized":"2023-12-16T01:54:00.044464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'708","last_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_deep_scrub":"28'708","last_deep_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.044392+0000","objects_scrubbed":1,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:00.634076+0000","scrub_duration":0.015574605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.819424+0000","last_change":"2023-12-16T01:53:50.819445+0000","last_active":"2023-12-16T01:53:50.819424+0000","last_peered":"2023-12-16T01:53:50.819424+0000","last_clean":"2023-12-16T01:53:50.819424+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:50.819424+0000","last_undegraded":"2023-12-16T01:53:50.819424+0000","last_fullsized":"2023-12-16T01:53:50.819424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'31","last_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_deep_scrub":"28'31","last_deep_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.819349+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:25.110184+0000","scrub_duration":0.0014030030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:28.912040+0000","last_change":"2023-12-16T01:25:54.988121+0000","last_active":"2023-12-16T01:53:28.912040+0000","last_peered":"2023-12-16T01:53:28.912040+0000","last_clean":"2023-12-16T01:53:28.912040+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:53:28.912040+0000","last_undegraded":"2023-12-16T01:53:28.912040+0000","last_fullsized":"2023-12-16T01:53:28.912040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.853642+0000","last_change":"2023-12-16T01:53:49.853662+0000","last_active":"2023-12-16T01:53:49.853642+0000","last_peered":"2023-12-16T01:53:49.853642+0000","last_clean":"2023-12-16T01:53:49.853642+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:49.853642+0000","last_undegraded":"2023-12-16T01:53:49.853642+0000","last_fullsized":"2023-12-16T01:53:49.853642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.853560+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:47.856024+0000","scrub_duration":0.001387723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.335969+0000","last_change":"2023-12-16T01:53:58.335995+0000","last_active":"2023-12-16T01:53:58.335969+0000","last_peered":"2023-12-16T01:53:58.335969+0000","last_clean":"2023-12-16T01:53:58.335969+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:58.335969+0000","last_undegraded":"2023-12-16T01:53:58.335969+0000","last_fullsized":"2023-12-16T01:53:58.335969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'50","last_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_deep_scrub":"28'50","last_deep_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.335879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:56.338342+0000","scrub_duration":0.001381522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003207+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:53:33.003207+0000","last_peered":"2023-12-16T01:53:33.003207+0000","last_clean":"2023-12-16T01:53:33.003207+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:53:33.003207+0000","last_undegraded":"2023-12-16T01:53:33.003207+0000","last_fullsized":"2023-12-16T01:53:33.003207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.044332+0000","last_change":"2023-12-16T01:53:50.044369+0000","last_active":"2023-12-16T01:53:50.044332+0000","last_peered":"2023-12-16T01:53:50.044332+0000","last_clean":"2023-12-16T01:53:50.044332+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:50.044332+0000","last_undegraded":"2023-12-16T01:53:50.044332+0000","last_fullsized":"2023-12-16T01:53:50.044332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.044262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:27.808420+0000","scrub_duration":0.0011708160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958518+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:53:47.958518+0000","last_peered":"2023-12-16T01:53:47.958518+0000","last_clean":"2023-12-16T01:53:47.958518+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:53:47.958518+0000","last_undegraded":"2023-12-16T01:53:47.958518+0000","last_fullsized":"2023-12-16T01:53:47.958518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958507+0000","last_change":"2023-12-16T01:25:49.120742+0000","last_active":"2023-12-16T01:53:47.958507+0000","last_peered":"2023-12-16T01:53:47.958507+0000","last_clean":"2023-12-16T01:53:47.958507+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:53:47.958507+0000","last_undegraded":"2023-12-16T01:53:47.958507+0000","last_fullsized":"2023-12-16T01:53:47.958507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.620368+0000","last_change":"2023-12-16T01:54:03.620408+0000","last_active":"2023-12-16T01:54:03.620368+0000","last_peered":"2023-12-16T01:54:03.620368+0000","last_clean":"2023-12-16T01:54:03.620368+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:54:03.620368+0000","last_undegraded":"2023-12-16T01:54:03.620368+0000","last_fullsized":"2023-12-16T01:54:03.620368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.620291+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:41.384448+0000","scrub_duration":0.001035563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.195549+0000","last_change":"2023-12-16T01:25:49.117594+0000","last_active":"2023-12-16T01:53:47.195549+0000","last_peered":"2023-12-16T01:53:47.195549+0000","last_clean":"2023-12-16T01:53:47.195549+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:53:47.195549+0000","last_undegraded":"2023-12-16T01:53:47.195549+0000","last_fullsized":"2023-12-16T01:53:47.195549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649928+0000","last_change":"2023-12-16T01:25:49.152623+0000","last_active":"2023-12-16T01:53:45.649928+0000","last_peered":"2023-12-16T01:53:45.649928+0000","last_clean":"2023-12-16T01:53:45.649928+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:53:45.649928+0000","last_undegraded":"2023-12-16T01:53:45.649928+0000","last_fullsized":"2023-12-16T01:53:45.649928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.053900+0000","last_change":"2023-12-16T01:25:49.117967+0000","last_active":"2023-12-16T01:53:33.053900+0000","last_peered":"2023-12-16T01:53:33.053900+0000","last_clean":"2023-12-16T01:53:33.053900+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:53:33.053900+0000","last_undegraded":"2023-12-16T01:53:33.053900+0000","last_fullsized":"2023-12-16T01:53:33.053900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.710495+0000","last_change":"2023-12-16T01:53:59.710514+0000","last_active":"2023-12-16T01:53:59.710495+0000","last_peered":"2023-12-16T01:53:59.710495+0000","last_clean":"2023-12-16T01:53:59.710495+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:59.710495+0000","last_undegraded":"2023-12-16T01:53:59.710495+0000","last_fullsized":"2023-12-16T01:53:59.710495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.710431+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:52.108963+0000","scrub_duration":0.00086866999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.807870+0000","last_change":"2023-12-16T01:53:47.807889+0000","last_active":"2023-12-16T01:53:47.807870+0000","last_peered":"2023-12-16T01:53:47.807870+0000","last_clean":"2023-12-16T01:53:47.807870+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:47.807870+0000","last_undegraded":"2023-12-16T01:53:47.807870+0000","last_fullsized":"2023-12-16T01:53:47.807870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.807786+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:03.908247+0000","scrub_duration":0.0012442099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075811+0000","last_change":"2023-12-16T01:25:49.146702+0000","last_active":"2023-12-16T01:53:33.075811+0000","last_peered":"2023-12-16T01:53:33.075811+0000","last_clean":"2023-12-16T01:53:33.075811+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:53:33.075811+0000","last_undegraded":"2023-12-16T01:53:33.075811+0000","last_fullsized":"2023-12-16T01:53:33.075811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003201+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:53:33.003201+0000","last_peered":"2023-12-16T01:53:33.003201+0000","last_clean":"2023-12-16T01:53:33.003201+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:53:33.003201+0000","last_undegraded":"2023-12-16T01:53:33.003201+0000","last_fullsized":"2023-12-16T01:53:33.003201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.372063+0000","last_change":"2023-12-16T01:53:59.372084+0000","last_active":"2023-12-16T01:53:59.372063+0000","last_peered":"2023-12-16T01:53:59.372063+0000","last_clean":"2023-12-16T01:53:59.372063+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:59.372063+0000","last_undegraded":"2023-12-16T01:53:59.372063+0000","last_fullsized":"2023-12-16T01:53:59.372063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.371983+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:57:27.780046+0000","scrub_duration":0.0014106590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.101807+0000","last_change":"2023-12-16T01:53:53.101827+0000","last_active":"2023-12-16T01:53:53.101807+0000","last_peered":"2023-12-16T01:53:53.101807+0000","last_clean":"2023-12-16T01:53:53.101807+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:53.101807+0000","last_undegraded":"2023-12-16T01:53:53.101807+0000","last_fullsized":"2023-12-16T01:53:53.101807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.101731+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:41.523580+0000","scrub_duration":0.001408493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649939+0000","last_change":"2023-12-16T01:25:49.155213+0000","last_active":"2023-12-16T01:53:45.649939+0000","last_peered":"2023-12-16T01:53:45.649939+0000","last_clean":"2023-12-16T01:53:45.649939+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:53:45.649939+0000","last_undegraded":"2023-12-16T01:53:45.649939+0000","last_fullsized":"2023-12-16T01:53:45.649939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.195584+0000","last_change":"2023-12-16T01:25:49.147808+0000","last_active":"2023-12-16T01:53:47.195584+0000","last_peered":"2023-12-16T01:53:47.195584+0000","last_clean":"2023-12-16T01:53:47.195584+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:53:47.195584+0000","last_undegraded":"2023-12-16T01:53:47.195584+0000","last_fullsized":"2023-12-16T01:53:47.195584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958512+0000","last_change":"2023-12-16T01:25:49.122101+0000","last_active":"2023-12-16T01:53:47.958512+0000","last_peered":"2023-12-16T01:53:47.958512+0000","last_clean":"2023-12-16T01:53:47.958512+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:53:47.958512+0000","last_undegraded":"2023-12-16T01:53:47.958512+0000","last_fullsized":"2023-12-16T01:53:47.958512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:32.989052+0000","last_change":"2023-12-16T01:25:49.147866+0000","last_active":"2023-12-16T01:53:32.989052+0000","last_peered":"2023-12-16T01:53:32.989052+0000","last_clean":"2023-12-16T01:53:32.989052+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:53:32.989052+0000","last_undegraded":"2023-12-16T01:53:32.989052+0000","last_fullsized":"2023-12-16T01:53:32.989052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075941+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:53:33.075941+0000","last_peered":"2023-12-16T01:53:33.075941+0000","last_clean":"2023-12-16T01:53:33.075941+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:53:33.075941+0000","last_undegraded":"2023-12-16T01:53:33.075941+0000","last_fullsized":"2023-12-16T01:53:33.075941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.074648+0000","last_change":"2023-12-16T01:25:49.154446+0000","last_active":"2023-12-16T01:53:33.074648+0000","last_peered":"2023-12-16T01:53:33.074648+0000","last_clean":"2023-12-16T01:53:33.074648+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:53:33.074648+0000","last_undegraded":"2023-12-16T01:53:33.074648+0000","last_fullsized":"2023-12-16T01:53:33.074648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075568+0000","last_change":"2023-12-16T01:25:49.146451+0000","last_active":"2023-12-16T01:53:33.075568+0000","last_peered":"2023-12-16T01:53:33.075568+0000","last_clean":"2023-12-16T01:53:33.075568+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:53:33.075568+0000","last_undegraded":"2023-12-16T01:53:33.075568+0000","last_fullsized":"2023-12-16T01:53:33.075568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.781093+0000","last_change":"2023-12-16T01:54:02.781112+0000","last_active":"2023-12-16T01:54:02.781093+0000","last_peered":"2023-12-16T01:54:02.781093+0000","last_clean":"2023-12-16T01:54:02.781093+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:54:02.781093+0000","last_undegraded":"2023-12-16T01:54:02.781093+0000","last_fullsized":"2023-12-16T01:54:02.781093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.781026+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:00.783489+0000","scrub_duration":0.0010688659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.054150+0000","last_change":"2023-12-16T01:25:49.147907+0000","last_active":"2023-12-16T01:53:33.054150+0000","last_peered":"2023-12-16T01:53:33.054150+0000","last_clean":"2023-12-16T01:53:33.054150+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:53:33.054150+0000","last_undegraded":"2023-12-16T01:53:33.054150+0000","last_fullsized":"2023-12-16T01:53:33.054150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.053744+0000","last_change":"2023-12-16T01:25:49.147054+0000","last_active":"2023-12-16T01:53:33.053744+0000","last_peered":"2023-12-16T01:53:33.053744+0000","last_clean":"2023-12-16T01:53:33.053744+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:53:33.053744+0000","last_undegraded":"2023-12-16T01:53:33.053744+0000","last_fullsized":"2023-12-16T01:53:33.053744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.646330+0000","last_change":"2023-12-16T01:54:02.646365+0000","last_active":"2023-12-16T01:54:02.646330+0000","last_peered":"2023-12-16T01:54:02.646330+0000","last_clean":"2023-12-16T01:54:02.646330+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:54:02.646330+0000","last_undegraded":"2023-12-16T01:54:02.646330+0000","last_fullsized":"2023-12-16T01:54:02.646330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.646262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:36.193892+0000","scrub_duration":0.0012008120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.063353+0000","last_change":"2023-12-16T01:53:50.063370+0000","last_active":"2023-12-16T01:53:50.063353+0000","last_peered":"2023-12-16T01:53:50.063353+0000","last_clean":"2023-12-16T01:53:50.063353+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:50.063353+0000","last_undegraded":"2023-12-16T01:53:50.063353+0000","last_fullsized":"2023-12-16T01:53:50.063353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.063280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:56:51.897233+0000","scrub_duration":0.0012023349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.792454+0000","last_change":"2023-12-16T01:53:51.792454+0000","last_active":"2023-12-16T01:53:51.792454+0000","last_peered":"2023-12-16T01:53:51.792454+0000","last_clean":"2023-12-16T01:53:51.792454+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:51.792454+0000","last_undegraded":"2023-12-16T01:53:51.792454+0000","last_fullsized":"2023-12-16T01:53:51.792454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.792374+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:52.206345+0000","scrub_duration":0.00118464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:52.065928+0000","last_change":"2023-12-16T01:53:52.065951+0000","last_active":"2023-12-16T01:53:52.065928+0000","last_peered":"2023-12-16T01:53:52.065928+0000","last_clean":"2023-12-16T01:53:52.065928+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:52.065928+0000","last_undegraded":"2023-12-16T01:53:52.065928+0000","last_fullsized":"2023-12-16T01:53:52.065928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_clean_scrub_stamp":"2023-12-16T01:53:52.065855+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:50.928964+0000","scrub_duration":0.0010821439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.047861+0000","last_change":"2023-12-16T01:25:49.113466+0000","last_active":"2023-12-16T01:53:33.047861+0000","last_peered":"2023-12-16T01:53:33.047861+0000","last_clean":"2023-12-16T01:53:33.047861+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:53:33.047861+0000","last_undegraded":"2023-12-16T01:53:33.047861+0000","last_fullsized":"2023-12-16T01:53:33.047861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.103565+0000","last_change":"2023-12-16T01:53:47.103599+0000","last_active":"2023-12-16T01:53:47.103565+0000","last_peered":"2023-12-16T01:53:47.103565+0000","last_clean":"2023-12-16T01:53:47.103565+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:47.103565+0000","last_undegraded":"2023-12-16T01:53:47.103565+0000","last_fullsized":"2023-12-16T01:53:47.103565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.103490+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:40.015122+0000","scrub_duration":0.001277678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8670,"ondisk_log_size":8670,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542490,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.41099999999999998},"min":{"1min":0.34899999999999998,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42399999999999999,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.64800000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.435,"15min":0.437},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.72799999999999998},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.65800000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.54400000000000004}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.66300000000000003},"last":0.441},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.28899999999999998},"max":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.66400000000000003},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.224},"max":{"1min":0.501,"5min":0.61799999999999999,"15min":0.69699999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.60299999999999998,"5min":0.627,"15min":0.67900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.503,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.63}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.315,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.66700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":0.77700000000000002},"last":0.60299999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542488,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.27100000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.63,"5min":0.63,"15min":0.69399999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.45700000000000002,"15min":0.43099999999999999},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.25600000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.86599999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.26100000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67600000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.92300000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.47999999999999998,"15min":0.46700000000000003},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63800000000000001}]},{"osd":4,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"min":{"1min":0.28999999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.254},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.33200000000000002,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73199999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.68100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542489,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.438,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.78700000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.26000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.71699999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.442}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":0.54300000000000004,"5min":0.56499999999999995,"15min":0.67400000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.70799999999999996},"last":0.36399999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.34699999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.69799999999999995},"last":0.317},{"interface":"front","average":{"1min":0.436,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38600000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542490,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.625,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66300000000000003},"last":0.502}]},{"osd":2,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.68100000000000005},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.434,"15min":0.42699999999999999},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.443,"15min":0.442},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38300000000000001,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.379,"5min":0.40000000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":0.628,"15min":0.68300000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.433,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.252},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.72099999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60499999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.628}]}]},{"osd":3,"up_from":14,"seq":60129542489,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.28699999999999998},"min":{"1min":0.22,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.25},{"interface":"front","average":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29999999999999999},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.311}]},{"osd":1,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.312,"15min":0.30499999999999999},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.45200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.52400000000000002},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.497,"5min":0.51300000000000001,"15min":0.63400000000000001},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.69799999999999995,"15min":0.79300000000000004},"last":0.57799999999999996}]},{"osd":5,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.64700000000000002},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.55900000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.504},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.314},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.70099999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542489,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.29099999999999998,"15min":0.29399999999999998},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.60499999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.309,"15min":0.30599999999999999},"min":{"1min":0.218,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.54600000000000004},"last":0.378}]},{"osd":1,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.56599999999999995},"last":0.439}]},{"osd":3,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.315,"15min":0.317},"min":{"1min":0.24199999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.55000000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.67800000000000005},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.438},"min":{"1min":0.317,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.65000000000000002,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.67900000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.34999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.82899999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.74299999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.69599999999999995,"15min":0.76000000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71099999999999997},"last":0.48599999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542489,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.314,"15min":0.29899999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.438},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30399999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.33400000000000002},"min":{"1min":0.23200000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.20200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.51500000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.61699999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.77700000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.57999999999999996}]},{"osd":6,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.76200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.627,"5min":0.747,"15min":0.96699999999999997},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.74099999999999999,"15min":0.80700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.748,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67000000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542489,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.216,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54900000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.622},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.67700000000000005},"last":0.71599999999999997}]},{"osd":5,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.65100000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.70399999999999996,"15min":0.753},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.73099999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.75},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:54:09.996 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.996 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.996 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.996 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.997 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.998 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:09.999 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.000 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.001 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.001 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.002 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.002 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.002 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.002 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.002 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.003 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.004 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.005 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.006 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.007 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.007 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.007 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.007 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.007 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:10.007 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T01:54:30.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:54:30.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.119+0000 7fbf07fa9640 1 Processor -- start 2023-12-16T01:54:30.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.119+0000 7fbf07fa9640 1 -- start start 2023-12-16T01:54:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.120+0000 7fbf07fa9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbf000bff00 0x7fbf00159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.120+0000 7fbf07fa9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf00072b60 con 0x7fbf001501c0 2023-12-16T01:54:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.120+0000 7fbf07fa9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000c1a90 con 0x7fbf00156e60 2023-12-16T01:54:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.120+0000 7fbf07fa9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf001572d0 con 0x7fbf000bff00 2023-12-16T01:54:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.121+0000 7fbf06546640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbf00156e60 0x7fbf00071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:49878/0 (socket says 172.21.15.107:49878) 2023-12-16T01:54:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.121+0000 7fbf06546640 1 -- 172.21.15.107:0/2073371996 learned_addr learned my addr 172.21.15.107:0/2073371996 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:54:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.121+0000 7fbf05544640 1 --2- 172.21.15.107:0/2073371996 >> v2:172.21.15.107:3300/0 conn(0x7fbf000bff00 0x7fbf00159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.123+0000 7fbf04d43640 1 -- 172.21.15.107:0/2073371996 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762168533 0 0) 0x7fbf000c1a90 con 0x7fbf00156e60 2023-12-16T01:54:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.123+0000 7fbf04d43640 1 -- 172.21.15.107:0/2073371996 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeec005730 con 0x7fbf00156e60 2023-12-16T01:54:30.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.125+0000 7fbf05544640 1 -- 172.21.15.107:0/2073371996 >> v1:172.21.15.157:6789/0 conn(0x7fbf00156e60 legacy=0x7fbf00071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.125+0000 7fbf05544640 1 -- 172.21.15.107:0/2073371996 >> v1:172.21.15.107:6789/0 conn(0x7fbf001501c0 legacy=0x7fbf00072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.125+0000 7fbf05544640 1 -- 172.21.15.107:0/2073371996 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000c1d30 con 0x7fbf000bff00 2023-12-16T01:54:30.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.129+0000 7fbf05544640 1 --2- 172.21.15.107:0/2073371996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf00159860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbef00097a0 tx=0x7fbef002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5aa8cf32970d4f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:30.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.132+0000 7fbf04d43640 1 -- 172.21.15.107:0/2073371996 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef002f810 con 0x7fbf000bff00 2023-12-16T01:54:30.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.132+0000 7fbf04d43640 1 -- 172.21.15.107:0/2073371996 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef002f970 con 0x7fbf000bff00 2023-12-16T01:54:30.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.132+0000 7fbf04d43640 1 -- 172.21.15.107:0/2073371996 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef002fd00 con 0x7fbf000bff00 2023-12-16T01:54:30.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 -- 172.21.15.107:0/2073371996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 msgr2=0x7fbf00159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/2073371996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf00159860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbef00097a0 tx=0x7fbef002b9f0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 -- 172.21.15.107:0/2073371996 shutdown_connections 2023-12-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/2073371996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf00159860 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 -- 172.21.15.107:0/2073371996 >> 172.21.15.107:0/2073371996 conn(0x7fbf0006cd60 msgr2=0x7fbf0006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 -- 172.21.15.107:0/2073371996 shutdown_connections 2023-12-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.133+0000 7fbf07fa9640 1 -- 172.21.15.107:0/2073371996 wait complete. 2023-12-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.134+0000 7fbf07fa9640 1 Processor -- start 2023-12-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 -- start start 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf000710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf001501c0 0x7fbf001edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf00156e60 0x7fbf001ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf001581f0 con 0x7fbf000bff00 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf001558d0 con 0x7fbf001501c0 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.135+0000 7fbf07fa9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00157c30 con 0x7fbf00156e60 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.136+0000 7fbf05d45640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf000710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.136+0000 7fbf05d45640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf000710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50614/0 (socket says 172.21.15.107:50614) 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.136+0000 7fbf05d45640 1 -- 172.21.15.107:0/3819303735 learned_addr learned my addr 172.21.15.107:0/3819303735 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.136+0000 7fbf05544640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf001501c0 0x7fbf001edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.136+0000 7fbf06546640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf00156e60 0x7fbf001ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:30.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.139+0000 7fbf05d45640 1 -- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf00156e60 msgr2=0x7fbf001ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.139+0000 7fbf05d45640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf00156e60 0x7fbf001ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.139+0000 7fbf05d45640 1 -- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf001501c0 msgr2=0x7fbf001edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.139+0000 7fbf05d45640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf001501c0 0x7fbf001edfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.139+0000 7fbf05d45640 1 -- 172.21.15.107:0/3819303735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009400 con 0x7fbf000bff00 2023-12-16T01:54:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.141+0000 7fbf05d45640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf000710a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c430 tx=0x7fbefc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:30.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.143+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0052d0 con 0x7fbf000bff00 2023-12-16T01:54:30.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.143+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf001e05f0 con 0x7fbf000bff00 2023-12-16T01:54:30.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.143+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf00155e00 con 0x7fbf000bff00 2023-12-16T01:54:30.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.144+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf000c77e0 con 0x7fbf000bff00 2023-12-16T01:54:30.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.145+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc005430 con 0x7fbf000bff00 2023-12-16T01:54:30.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.145+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc007250 con 0x7fbf000bff00 2023-12-16T01:54:30.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.391+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fbefc0073b0 con 0x7fbf000bff00 2023-12-16T01:54:30.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.391+0000 7fbef67fc640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbee406ae40 0x7fbee406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:30.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.391+0000 7fbf05544640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbee406ae40 0x7fbee406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:30.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.392+0000 7fbf05544640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbee406ae40 0x7fbee406d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbef0036000 tx=0x7fbef0008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:30.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.405+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbefc007660 con 0x7fbf000bff00 2023-12-16T01:54:30.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.405+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fbefc054060 con 0x7fbf000bff00 2023-12-16T01:54:30.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.577+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf00156660 con 0x7fbee406ae40 2023-12-16T01:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.586+0000 7fbef67fc640 1 -- 172.21.15.107:0/3819303735 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372289 (secure 0 0 0) 0x7fbef0046090 con 0x7fbee406ae40 2023-12-16T01:54:30.592 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:54:30.594 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbee406ae40 msgr2=0x7fbee406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbee406ae40 0x7fbee406d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbef0036000 tx=0x7fbef0008030 comp rx=0 tx=0).stop 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 msgr2=0x7fbf000710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf000710a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c430 tx=0x7fbefc00c8f0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 shutdown_connections 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf00156e60 0x7fbf001ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fbee406ae40 0x7fbee406d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf001501c0 0x7fbf001edfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 --2- 172.21.15.107:0/3819303735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf000bff00 0x7fbf000710a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:30.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 >> 172.21.15.107:0/3819303735 conn(0x7fbf0006cd60 msgr2=0x7fbf00072450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:54:30.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 shutdown_connections 2023-12-16T01:54:30.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:30.589+0000 7fbf07fa9640 1 -- 172.21.15.107:0/3819303735 wait complete. 2023-12-16T01:54:30.602 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":888,"stamp":"2023-12-16T01:54:30.100964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15814,"ondisk_log_size":15814,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002751"},"pg_stats":[{"pgid":"2.1f","version":"28'624","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.712481+0000","last_change":"2023-12-16T01:53:53.712506+0000","last_active":"2023-12-16T01:53:53.712481+0000","last_peered":"2023-12-16T01:53:53.712481+0000","last_clean":"2023-12-16T01:53:53.712481+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:53.712481+0000","last_undegraded":"2023-12-16T01:53:53.712481+0000","last_fullsized":"2023-12-16T01:53:53.712481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'624","last_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_deep_scrub":"28'624","last_deep_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.712422+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:46.624054+0000","scrub_duration":0.013433865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:18.081704+0000","last_change":"2023-12-16T01:54:18.081724+0000","last_active":"2023-12-16T01:54:18.081704+0000","last_peered":"2023-12-16T01:54:18.081704+0000","last_clean":"2023-12-16T01:54:18.081704+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:54:18.081704+0000","last_undegraded":"2023-12-16T01:54:18.081704+0000","last_fullsized":"2023-12-16T01:54:18.081704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2023-12-16T01:54:18.081625+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2023-12-16T01:54:18.081625+0000","last_clean_scrub_stamp":"2023-12-16T01:54:18.081625+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:26.347108+0000","scrub_duration":0.0012030560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:06.405931+0000","last_change":"2023-12-16T01:54:06.405952+0000","last_active":"2023-12-16T01:54:06.405931+0000","last_peered":"2023-12-16T01:54:06.405931+0000","last_clean":"2023-12-16T01:54:06.405931+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:54:06.405931+0000","last_undegraded":"2023-12-16T01:54:06.405931+0000","last_fullsized":"2023-12-16T01:54:06.405931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'160","last_scrub_stamp":"2023-12-16T01:54:06.405857+0000","last_deep_scrub":"28'160","last_deep_scrub_stamp":"2023-12-16T01:54:06.405857+0000","last_clean_scrub_stamp":"2023-12-16T01:54:06.405857+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:09.887576+0000","scrub_duration":0.001779709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'728","reported_seq":769,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.949340+0000","last_change":"2023-12-16T01:54:04.949379+0000","last_active":"2023-12-16T01:54:04.949340+0000","last_peered":"2023-12-16T01:54:04.949340+0000","last_clean":"2023-12-16T01:54:04.949340+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:54:04.949340+0000","last_undegraded":"2023-12-16T01:54:04.949340+0000","last_fullsized":"2023-12-16T01:54:04.949340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'728","last_scrub_stamp":"2023-12-16T01:54:04.949267+0000","last_deep_scrub":"28'728","last_deep_scrub_stamp":"2023-12-16T01:54:04.949267+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.949267+0000","objects_scrubbed":1,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:33.947014+0000","scrub_duration":0.011806354999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.140515+0000","last_change":"2023-12-16T01:53:48.140533+0000","last_active":"2023-12-16T01:53:48.140515+0000","last_peered":"2023-12-16T01:53:48.140515+0000","last_clean":"2023-12-16T01:53:48.140515+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:48.140515+0000","last_undegraded":"2023-12-16T01:53:48.140515+0000","last_fullsized":"2023-12-16T01:53:48.140515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.140450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:41.931150+0000","scrub_duration":0.0013849089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.587783+0000","last_change":"2023-12-16T01:54:04.587804+0000","last_active":"2023-12-16T01:54:04.587783+0000","last_peered":"2023-12-16T01:54:04.587783+0000","last_clean":"2023-12-16T01:54:04.587783+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:54:04.587783+0000","last_undegraded":"2023-12-16T01:54:04.587783+0000","last_fullsized":"2023-12-16T01:54:04.587783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'129","last_scrub_stamp":"2023-12-16T01:54:04.587715+0000","last_deep_scrub":"28'129","last_deep_scrub_stamp":"2023-12-16T01:54:04.587715+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.587715+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:13:07.957493+0000","scrub_duration":0.0016608619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1397","reported_seq":1435,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.109371+0000","last_change":"2023-12-16T01:53:59.109396+0000","last_active":"2023-12-16T01:53:59.109371+0000","last_peered":"2023-12-16T01:53:59.109371+0000","last_clean":"2023-12-16T01:53:59.109371+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:59.109371+0000","last_undegraded":"2023-12-16T01:53:59.109371+0000","last_fullsized":"2023-12-16T01:53:59.109371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1397","last_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_deep_scrub":"28'1397","last_deep_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.109317+0000","objects_scrubbed":3,"log_size":1397,"log_dups_size":0,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:26.537787+0000","scrub_duration":0.0258877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.858232+0000","last_change":"2023-12-16T01:53:51.858251+0000","last_active":"2023-12-16T01:53:51.858232+0000","last_peered":"2023-12-16T01:53:51.858232+0000","last_clean":"2023-12-16T01:53:51.858232+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:51.858232+0000","last_undegraded":"2023-12-16T01:53:51.858232+0000","last_fullsized":"2023-12-16T01:53:51.858232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.858159+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:58:51.979244+0000","scrub_duration":0.00087977699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.651479+0000","last_change":"2023-12-16T01:54:20.651501+0000","last_active":"2023-12-16T01:54:20.651479+0000","last_peered":"2023-12-16T01:54:20.651479+0000","last_clean":"2023-12-16T01:54:20.651479+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:54:20.651479+0000","last_undegraded":"2023-12-16T01:54:20.651479+0000","last_fullsized":"2023-12-16T01:54:20.651479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:20.651399+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:20.651399+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.651399+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:26.060571+0000","scrub_duration":0.001840382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.083732+0000","last_change":"2023-12-16T01:54:08.083754+0000","last_active":"2023-12-16T01:54:08.083732+0000","last_peered":"2023-12-16T01:54:08.083732+0000","last_clean":"2023-12-16T01:54:08.083732+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:54:08.083732+0000","last_undegraded":"2023-12-16T01:54:08.083732+0000","last_fullsized":"2023-12-16T01:54:08.083732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:54:08.083672+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:54:08.083672+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.083672+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:25.913138+0000","scrub_duration":0.0019540069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003266+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003266+0000","last_peered":"2023-12-16T01:53:33.003266+0000","last_clean":"2023-12-16T01:53:33.003266+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003266+0000","last_undegraded":"2023-12-16T01:53:33.003266+0000","last_fullsized":"2023-12-16T01:53:33.003266+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":157,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.661739+0000","last_change":"2023-12-16T01:54:13.661759+0000","last_active":"2023-12-16T01:54:13.661739+0000","last_peered":"2023-12-16T01:54:13.661739+0000","last_clean":"2023-12-16T01:54:13.661739+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:54:13.661739+0000","last_undegraded":"2023-12-16T01:54:13.661739+0000","last_fullsized":"2023-12-16T01:54:13.661739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'122","last_scrub_stamp":"2023-12-16T01:54:13.661672+0000","last_deep_scrub":"28'122","last_deep_scrub_stamp":"2023-12-16T01:54:13.661672+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.661672+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:35.068765+0000","scrub_duration":0.0017602150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649750+0000","last_change":"2023-12-16T01:25:49.157721+0000","last_active":"2023-12-16T01:53:45.649750+0000","last_peered":"2023-12-16T01:53:45.649750+0000","last_clean":"2023-12-16T01:53:45.649750+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:53:45.649750+0000","last_undegraded":"2023-12-16T01:53:45.649750+0000","last_fullsized":"2023-12-16T01:53:45.649750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'639","reported_seq":678,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.231826+0000","last_change":"2023-12-16T01:54:26.231867+0000","last_active":"2023-12-16T01:54:26.231826+0000","last_peered":"2023-12-16T01:54:26.231826+0000","last_clean":"2023-12-16T01:54:26.231826+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:54:26.231826+0000","last_undegraded":"2023-12-16T01:54:26.231826+0000","last_fullsized":"2023-12-16T01:54:26.231826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'639","last_scrub_stamp":"2023-12-16T01:54:26.231737+0000","last_deep_scrub":"28'639","last_deep_scrub_stamp":"2023-12-16T01:54:26.231737+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.231737+0000","objects_scrubbed":2,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:39:24.800131+0000","scrub_duration":0.018664725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":139,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503440+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503440+0000","last_peered":"2023-12-16T01:53:05.503440+0000","last_clean":"2023-12-16T01:53:05.503440+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503440+0000","last_undegraded":"2023-12-16T01:53:05.503440+0000","last_fullsized":"2023-12-16T01:53:05.503440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.376779+0000","last_change":"2023-12-16T01:54:00.376828+0000","last_active":"2023-12-16T01:54:00.376779+0000","last_peered":"2023-12-16T01:54:00.376779+0000","last_clean":"2023-12-16T01:54:00.376779+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:54:00.376779+0000","last_undegraded":"2023-12-16T01:54:00.376779+0000","last_fullsized":"2023-12-16T01:54:00.376779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.376682+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:29.025843+0000","scrub_duration":0.0016058649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:07.165165+0000","last_change":"2023-12-16T01:54:07.165187+0000","last_active":"2023-12-16T01:54:07.165165+0000","last_peered":"2023-12-16T01:54:07.165165+0000","last_clean":"2023-12-16T01:54:07.165165+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:54:07.165165+0000","last_undegraded":"2023-12-16T01:54:07.165165+0000","last_fullsized":"2023-12-16T01:54:07.165165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:54:07.165084+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:54:07.165084+0000","last_clean_scrub_stamp":"2023-12-16T01:54:07.165084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:55:00.076716+0000","scrub_duration":0.0010529879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.550820+0000","last_change":"2023-12-16T01:25:54.988221+0000","last_active":"2023-12-16T01:53:04.550820+0000","last_peered":"2023-12-16T01:53:04.550820+0000","last_clean":"2023-12-16T01:53:04.550820+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:53:04.550820+0000","last_undegraded":"2023-12-16T01:53:04.550820+0000","last_fullsized":"2023-12-16T01:53:04.550820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.818668+0000","last_change":"2023-12-16T01:54:12.818687+0000","last_active":"2023-12-16T01:54:12.818668+0000","last_peered":"2023-12-16T01:54:12.818668+0000","last_clean":"2023-12-16T01:54:12.818668+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:54:12.818668+0000","last_undegraded":"2023-12-16T01:54:12.818668+0000","last_fullsized":"2023-12-16T01:54:12.818668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:12.818595+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:12.818595+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.818595+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:34.225689+0000","scrub_duration":0.00096157499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.669327+0000","last_change":"2023-12-16T01:53:54.669327+0000","last_active":"2023-12-16T01:53:54.669327+0000","last_peered":"2023-12-16T01:53:54.669327+0000","last_clean":"2023-12-16T01:53:54.669327+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:53:54.669327+0000","last_undegraded":"2023-12-16T01:53:54.669327+0000","last_fullsized":"2023-12-16T01:53:54.669327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.669197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.939886+0000","scrub_duration":0.0011923369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.485133+0000","last_change":"2023-12-16T01:54:13.485178+0000","last_active":"2023-12-16T01:54:13.485133+0000","last_peered":"2023-12-16T01:54:13.485133+0000","last_clean":"2023-12-16T01:54:13.485133+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:54:13.485133+0000","last_undegraded":"2023-12-16T01:54:13.485133+0000","last_fullsized":"2023-12-16T01:54:13.485133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:13.485033+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:13.485033+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.485033+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:32.554637+0000","scrub_duration":0.001406738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.122613+0000","last_change":"2023-12-16T01:53:59.122633+0000","last_active":"2023-12-16T01:53:59.122613+0000","last_peered":"2023-12-16T01:53:59.122613+0000","last_clean":"2023-12-16T01:53:59.122613+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:59.122613+0000","last_undegraded":"2023-12-16T01:53:59.122613+0000","last_fullsized":"2023-12-16T01:53:59.122613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.122554+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:09:35.015552+0000","scrub_duration":0.0010611500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.086079+0000","last_change":"2023-12-16T01:53:57.086079+0000","last_active":"2023-12-16T01:53:57.086079+0000","last_peered":"2023-12-16T01:53:57.086079+0000","last_clean":"2023-12-16T01:53:57.086079+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:57.086079+0000","last_undegraded":"2023-12-16T01:53:57.086079+0000","last_fullsized":"2023-12-16T01:53:57.086079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.085993+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:03.237603+0000","scrub_duration":0.0009980989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:24.750877+0000","last_change":"2023-12-16T01:54:24.750899+0000","last_active":"2023-12-16T01:54:24.750877+0000","last_peered":"2023-12-16T01:54:24.750877+0000","last_clean":"2023-12-16T01:54:24.750877+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:54:24.750877+0000","last_undegraded":"2023-12-16T01:54:24.750877+0000","last_fullsized":"2023-12-16T01:54:24.750877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'123","last_scrub_stamp":"2023-12-16T01:54:24.750798+0000","last_deep_scrub":"28'123","last_deep_scrub_stamp":"2023-12-16T01:54:24.750798+0000","last_clean_scrub_stamp":"2023-12-16T01:54:24.750798+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:42.994235+0000","scrub_duration":0.001693733,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.861610+0000","last_change":"2023-12-16T01:54:13.861630+0000","last_active":"2023-12-16T01:54:13.861610+0000","last_peered":"2023-12-16T01:54:13.861610+0000","last_clean":"2023-12-16T01:54:13.861610+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:54:13.861610+0000","last_undegraded":"2023-12-16T01:54:13.861610+0000","last_fullsized":"2023-12-16T01:54:13.861610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:54:13.861535+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:54:13.861535+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.861535+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:40.196046+0000","scrub_duration":0.00099201499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.221552+0000","last_change":"2023-12-16T01:54:23.221573+0000","last_active":"2023-12-16T01:54:23.221552+0000","last_peered":"2023-12-16T01:54:23.221552+0000","last_clean":"2023-12-16T01:54:23.221552+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:54:23.221552+0000","last_undegraded":"2023-12-16T01:54:23.221552+0000","last_fullsized":"2023-12-16T01:54:23.221552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-12-16T01:54:23.221494+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-12-16T01:54:23.221494+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.221494+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:27:27.499893+0000","scrub_duration":0.001892208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":188,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.682101+0000","last_change":"2023-12-16T01:54:11.682122+0000","last_active":"2023-12-16T01:54:11.682101+0000","last_peered":"2023-12-16T01:54:11.682101+0000","last_clean":"2023-12-16T01:54:11.682101+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:54:11.682101+0000","last_undegraded":"2023-12-16T01:54:11.682101+0000","last_fullsized":"2023-12-16T01:54:11.682101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'151","last_scrub_stamp":"2023-12-16T01:54:11.682026+0000","last_deep_scrub":"28'151","last_deep_scrub_stamp":"2023-12-16T01:54:11.682026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.682026+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:49.342638+0000","scrub_duration":0.0016144899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.947049+0000","last_change":"2023-12-16T01:54:20.947068+0000","last_active":"2023-12-16T01:54:20.947049+0000","last_peered":"2023-12-16T01:54:20.947049+0000","last_clean":"2023-12-16T01:54:20.947049+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:54:20.947049+0000","last_undegraded":"2023-12-16T01:54:20.947049+0000","last_fullsized":"2023-12-16T01:54:20.947049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:54:20.946986+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:54:20.946986+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.946986+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:22:09.368835+0000","scrub_duration":0.001206894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'311","reported_seq":352,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.757164+0000","last_change":"2023-12-16T01:54:08.757199+0000","last_active":"2023-12-16T01:54:08.757164+0000","last_peered":"2023-12-16T01:54:08.757164+0000","last_clean":"2023-12-16T01:54:08.757164+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:54:08.757164+0000","last_undegraded":"2023-12-16T01:54:08.757164+0000","last_fullsized":"2023-12-16T01:54:08.757164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'311","last_scrub_stamp":"2023-12-16T01:54:08.757077+0000","last_deep_scrub":"28'311","last_deep_scrub_stamp":"2023-12-16T01:54:08.757077+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.757077+0000","objects_scrubbed":1,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:56:34.272270+0000","scrub_duration":0.0033505319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413283+0000","last_change":"2023-12-16T01:25:54.984539+0000","last_active":"2023-12-16T01:53:46.413283+0000","last_peered":"2023-12-16T01:53:46.413283+0000","last_clean":"2023-12-16T01:53:46.413283+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:53:46.413283+0000","last_undegraded":"2023-12-16T01:53:46.413283+0000","last_fullsized":"2023-12-16T01:53:46.413283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:28.101960+0000","last_change":"2023-12-16T01:54:28.101981+0000","last_active":"2023-12-16T01:54:28.101960+0000","last_peered":"2023-12-16T01:54:28.101960+0000","last_clean":"2023-12-16T01:54:28.101960+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:54:28.101960+0000","last_undegraded":"2023-12-16T01:54:28.101960+0000","last_fullsized":"2023-12-16T01:54:28.101960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:28.101888+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:28.101888+0000","last_clean_scrub_stamp":"2023-12-16T01:54:28.101888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:35.565175+0000","scrub_duration":0.00093575400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:17.149995+0000","last_change":"2023-12-16T01:54:17.150031+0000","last_active":"2023-12-16T01:54:17.149995+0000","last_peered":"2023-12-16T01:54:17.149995+0000","last_clean":"2023-12-16T01:54:17.149995+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:54:17.149995+0000","last_undegraded":"2023-12-16T01:54:17.149995+0000","last_fullsized":"2023-12-16T01:54:17.149995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:17.149917+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:17.149917+0000","last_clean_scrub_stamp":"2023-12-16T01:54:17.149917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:13.375365+0000","scrub_duration":0.0013443159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.520259+0000","last_change":"2023-12-16T01:25:54.988462+0000","last_active":"2023-12-16T01:53:05.520259+0000","last_peered":"2023-12-16T01:53:05.520259+0000","last_clean":"2023-12-16T01:53:05.520259+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:53:05.520259+0000","last_undegraded":"2023-12-16T01:53:05.520259+0000","last_fullsized":"2023-12-16T01:53:05.520259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.810864+0000","last_change":"2023-12-16T01:53:53.810913+0000","last_active":"2023-12-16T01:53:53.810864+0000","last_peered":"2023-12-16T01:53:53.810864+0000","last_clean":"2023-12-16T01:53:53.810864+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:53.810864+0000","last_undegraded":"2023-12-16T01:53:53.810864+0000","last_fullsized":"2023-12-16T01:53:53.810864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.810791+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:09.911252+0000","scrub_duration":0.001403133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.013004+0000","last_change":"2023-12-16T01:53:59.013024+0000","last_active":"2023-12-16T01:53:59.013004+0000","last_peered":"2023-12-16T01:53:59.013004+0000","last_clean":"2023-12-16T01:53:59.013004+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:59.013004+0000","last_undegraded":"2023-12-16T01:53:59.013004+0000","last_fullsized":"2023-12-16T01:53:59.013004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.012926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:06.476212+0000","scrub_duration":0.001035209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":220,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:03.819194+0000","last_change":"2023-12-16T01:25:54.983280+0000","last_active":"2023-12-16T01:53:03.819194+0000","last_peered":"2023-12-16T01:53:03.819194+0000","last_clean":"2023-12-16T01:53:03.819194+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:53:03.819194+0000","last_undegraded":"2023-12-16T01:53:03.819194+0000","last_fullsized":"2023-12-16T01:53:03.819194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:28.061168+0000","last_change":"2023-12-16T01:54:28.061186+0000","last_active":"2023-12-16T01:54:28.061168+0000","last_peered":"2023-12-16T01:54:28.061168+0000","last_clean":"2023-12-16T01:54:28.061168+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:54:28.061168+0000","last_undegraded":"2023-12-16T01:54:28.061168+0000","last_fullsized":"2023-12-16T01:54:28.061168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:54:28.061099+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:54:28.061099+0000","last_clean_scrub_stamp":"2023-12-16T01:54:28.061099+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:23.756752+0000","scrub_duration":0.0010128380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:22.782227+0000","last_change":"2023-12-16T01:25:47.898037+0000","last_active":"2023-12-16T01:53:22.782227+0000","last_peered":"2023-12-16T01:53:22.782227+0000","last_clean":"2023-12-16T01:53:22.782227+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:53:22.782227+0000","last_undegraded":"2023-12-16T01:53:22.782227+0000","last_fullsized":"2023-12-16T01:53:22.782227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:46.612747+0000","last_clean_scrub_stamp":"2023-12-16T01:25:46.612747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.526066+0000","last_change":"2023-12-16T01:25:54.990402+0000","last_active":"2023-12-16T01:53:05.526066+0000","last_peered":"2023-12-16T01:53:05.526066+0000","last_clean":"2023-12-16T01:53:05.526066+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:53:05.526066+0000","last_undegraded":"2023-12-16T01:53:05.526066+0000","last_fullsized":"2023-12-16T01:53:05.526066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.903310+0000","last_change":"2023-12-16T01:54:08.903330+0000","last_active":"2023-12-16T01:54:08.903310+0000","last_peered":"2023-12-16T01:54:08.903310+0000","last_clean":"2023-12-16T01:54:08.903310+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:54:08.903310+0000","last_undegraded":"2023-12-16T01:54:08.903310+0000","last_fullsized":"2023-12-16T01:54:08.903310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:08.903246+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:08.903246+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.903246+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:25.974236+0000","scrub_duration":0.00090658899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2056,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.230907+0000","last_change":"2023-12-16T01:53:49.230942+0000","last_active":"2023-12-16T01:53:49.230907+0000","last_peered":"2023-12-16T01:53:49.230907+0000","last_clean":"2023-12-16T01:53:49.230907+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:49.230907+0000","last_undegraded":"2023-12-16T01:53:49.230907+0000","last_fullsized":"2023-12-16T01:53:49.230907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1009","last_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_deep_scrub":"28'1009","last_deep_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.230821+0000","objects_scrubbed":1,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:23.521655+0000","scrub_duration":0.0014598370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958615+0000","last_change":"2023-12-16T01:25:54.988115+0000","last_active":"2023-12-16T01:53:47.958615+0000","last_peered":"2023-12-16T01:53:47.958615+0000","last_clean":"2023-12-16T01:53:47.958615+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:53:47.958615+0000","last_undegraded":"2023-12-16T01:53:47.958615+0000","last_fullsized":"2023-12-16T01:53:47.958615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.206569+0000","last_change":"2023-12-16T01:54:11.206591+0000","last_active":"2023-12-16T01:54:11.206569+0000","last_peered":"2023-12-16T01:54:11.206569+0000","last_clean":"2023-12-16T01:54:11.206569+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:54:11.206569+0000","last_undegraded":"2023-12-16T01:54:11.206569+0000","last_fullsized":"2023-12-16T01:54:11.206569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2023-12-16T01:54:11.206504+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2023-12-16T01:54:11.206504+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.206504+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:44.754134+0000","scrub_duration":0.0012846170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'556","reported_seq":597,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:25.216109+0000","last_change":"2023-12-16T01:54:25.216151+0000","last_active":"2023-12-16T01:54:25.216109+0000","last_peered":"2023-12-16T01:54:25.216109+0000","last_clean":"2023-12-16T01:54:25.216109+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:54:25.216109+0000","last_undegraded":"2023-12-16T01:54:25.216109+0000","last_fullsized":"2023-12-16T01:54:25.216109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'556","last_scrub_stamp":"2023-12-16T01:54:25.216045+0000","last_deep_scrub":"28'556","last_deep_scrub_stamp":"2023-12-16T01:54:25.216045+0000","last_clean_scrub_stamp":"2023-12-16T01:54:25.216045+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:06.713469+0000","scrub_duration":0.012453327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.195630+0000","last_change":"2023-12-16T01:25:54.980385+0000","last_active":"2023-12-16T01:53:47.195630+0000","last_peered":"2023-12-16T01:53:47.195630+0000","last_clean":"2023-12-16T01:53:47.195630+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:53:47.195630+0000","last_undegraded":"2023-12-16T01:53:47.195630+0000","last_fullsized":"2023-12-16T01:53:47.195630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.859147+0000","last_change":"2023-12-16T01:54:16.859168+0000","last_active":"2023-12-16T01:54:16.859147+0000","last_peered":"2023-12-16T01:54:16.859147+0000","last_clean":"2023-12-16T01:54:16.859147+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:54:16.859147+0000","last_undegraded":"2023-12-16T01:54:16.859147+0000","last_fullsized":"2023-12-16T01:54:16.859147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:16.859078+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:16.859078+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.859078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:22.268251+0000","scrub_duration":0.0011505560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:18.119038+0000","last_change":"2023-12-16T01:54:18.119056+0000","last_active":"2023-12-16T01:54:18.119038+0000","last_peered":"2023-12-16T01:54:18.119038+0000","last_clean":"2023-12-16T01:54:18.119038+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:54:18.119038+0000","last_undegraded":"2023-12-16T01:54:18.119038+0000","last_fullsized":"2023-12-16T01:54:18.119038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2023-12-16T01:54:18.118973+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2023-12-16T01:54:18.118973+0000","last_clean_scrub_stamp":"2023-12-16T01:54:18.118973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:05.785396+0000","scrub_duration":0.001105857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:44.814945+0000","last_change":"2023-12-16T01:53:44.814970+0000","last_active":"2023-12-16T01:53:44.814945+0000","last_peered":"2023-12-16T01:53:44.814945+0000","last_clean":"2023-12-16T01:53:44.814945+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:53:44.814945+0000","last_undegraded":"2023-12-16T01:53:44.814945+0000","last_fullsized":"2023-12-16T01:53:44.814945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_clean_scrub_stamp":"2023-12-16T01:53:44.814880+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:43.334912+0000","scrub_duration":0.0039548450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:08.960638+0000","last_change":"2023-12-16T01:25:54.990891+0000","last_active":"2023-12-16T01:53:08.960638+0000","last_peered":"2023-12-16T01:53:08.960638+0000","last_clean":"2023-12-16T01:53:08.960638+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:53:08.960638+0000","last_undegraded":"2023-12-16T01:53:08.960638+0000","last_fullsized":"2023-12-16T01:53:08.960638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.144912+0000","last_change":"2023-12-16T01:53:55.144935+0000","last_active":"2023-12-16T01:53:55.144912+0000","last_peered":"2023-12-16T01:53:55.144912+0000","last_clean":"2023-12-16T01:53:55.144912+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:55.144912+0000","last_undegraded":"2023-12-16T01:53:55.144912+0000","last_fullsized":"2023-12-16T01:53:55.144912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.144831+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:38.126196+0000","scrub_duration":0.001096376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.254172+0000","last_change":"2023-12-16T01:53:59.254191+0000","last_active":"2023-12-16T01:53:59.254172+0000","last_peered":"2023-12-16T01:53:59.254172+0000","last_clean":"2023-12-16T01:53:59.254172+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:59.254172+0000","last_undegraded":"2023-12-16T01:53:59.254172+0000","last_fullsized":"2023-12-16T01:53:59.254172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.254108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:27.903270+0000","scrub_duration":0.0011951380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.635697+0000","last_change":"2023-12-16T01:54:14.635718+0000","last_active":"2023-12-16T01:54:14.635697+0000","last_peered":"2023-12-16T01:54:14.635697+0000","last_clean":"2023-12-16T01:54:14.635697+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:54:14.635697+0000","last_undegraded":"2023-12-16T01:54:14.635697+0000","last_fullsized":"2023-12-16T01:54:14.635697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:14.635626+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:14.635626+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.635626+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:40.970137+0000","scrub_duration":0.0014828199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.116003+0000","last_change":"2023-12-16T01:54:23.116021+0000","last_active":"2023-12-16T01:54:23.116003+0000","last_peered":"2023-12-16T01:54:23.116003+0000","last_clean":"2023-12-16T01:54:23.116003+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:54:23.116003+0000","last_undegraded":"2023-12-16T01:54:23.116003+0000","last_fullsized":"2023-12-16T01:54:23.116003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'40","last_scrub_stamp":"2023-12-16T01:54:23.115940+0000","last_deep_scrub":"28'40","last_deep_scrub_stamp":"2023-12-16T01:54:23.115940+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.115940+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:16.903903+0000","scrub_duration":0.0015752660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.017317+0000","last_change":"2023-12-16T01:53:58.017355+0000","last_active":"2023-12-16T01:53:58.017317+0000","last_peered":"2023-12-16T01:53:58.017317+0000","last_clean":"2023-12-16T01:53:58.017317+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:58.017317+0000","last_undegraded":"2023-12-16T01:53:58.017317+0000","last_fullsized":"2023-12-16T01:53:58.017317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.017183+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:25.445654+0000","scrub_duration":0.0031128100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":218,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553983+0000","last_change":"2023-12-16T01:25:54.981593+0000","last_active":"2023-12-16T01:53:04.553983+0000","last_peered":"2023-12-16T01:53:04.553983+0000","last_clean":"2023-12-16T01:53:04.553983+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:53:04.553983+0000","last_undegraded":"2023-12-16T01:53:04.553983+0000","last_fullsized":"2023-12-16T01:53:04.553983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.105095+0000","last_change":"2023-12-16T01:54:11.105131+0000","last_active":"2023-12-16T01:54:11.105095+0000","last_peered":"2023-12-16T01:54:11.105095+0000","last_clean":"2023-12-16T01:54:11.105095+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:54:11.105095+0000","last_undegraded":"2023-12-16T01:54:11.105095+0000","last_fullsized":"2023-12-16T01:54:11.105095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:11.105021+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:11.105021+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.105021+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:40.102768+0000","scrub_duration":0.001124416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.801680+0000","last_change":"2023-12-16T01:54:04.801704+0000","last_active":"2023-12-16T01:54:04.801680+0000","last_peered":"2023-12-16T01:54:04.801680+0000","last_clean":"2023-12-16T01:54:04.801680+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:54:04.801680+0000","last_undegraded":"2023-12-16T01:54:04.801680+0000","last_fullsized":"2023-12-16T01:54:04.801680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:04.801617+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:04.801617+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.801617+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:23.871220+0000","scrub_duration":0.0017376620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.649982+0000","last_change":"2023-12-16T01:25:54.985184+0000","last_active":"2023-12-16T01:53:45.649982+0000","last_peered":"2023-12-16T01:53:45.649982+0000","last_clean":"2023-12-16T01:53:45.649982+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:53:45.649982+0000","last_undegraded":"2023-12-16T01:53:45.649982+0000","last_fullsized":"2023-12-16T01:53:45.649982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.720677+0000","last_change":"2023-12-16T01:53:56.720697+0000","last_active":"2023-12-16T01:53:56.720677+0000","last_peered":"2023-12-16T01:53:56.720677+0000","last_clean":"2023-12-16T01:53:56.720677+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:56.720677+0000","last_undegraded":"2023-12-16T01:53:56.720677+0000","last_fullsized":"2023-12-16T01:53:56.720677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.720597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:33.671876+0000","scrub_duration":0.0010248239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.064394+0000","last_change":"2023-12-16T01:53:56.064453+0000","last_active":"2023-12-16T01:53:56.064394+0000","last_peered":"2023-12-16T01:53:56.064394+0000","last_clean":"2023-12-16T01:53:56.064394+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:53:56.064394+0000","last_undegraded":"2023-12-16T01:53:56.064394+0000","last_fullsized":"2023-12-16T01:53:56.064394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.064317+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:54.927425+0000","scrub_duration":0.0028072420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.827344+0000","last_change":"2023-12-16T01:54:03.827344+0000","last_active":"2023-12-16T01:54:03.827344+0000","last_peered":"2023-12-16T01:54:03.827344+0000","last_clean":"2023-12-16T01:54:03.827344+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:54:03.827344+0000","last_undegraded":"2023-12-16T01:54:03.827344+0000","last_fullsized":"2023-12-16T01:54:03.827344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.827247+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:04.241218+0000","scrub_duration":0.001453356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.124361+0000","last_change":"2023-12-16T01:53:54.124381+0000","last_active":"2023-12-16T01:53:54.124361+0000","last_peered":"2023-12-16T01:53:54.124361+0000","last_clean":"2023-12-16T01:53:54.124361+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:54.124361+0000","last_undegraded":"2023-12-16T01:53:54.124361+0000","last_fullsized":"2023-12-16T01:53:54.124361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.124293+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:11.195283+0000","scrub_duration":0.00092168199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.759978+0000","last_change":"2023-12-16T01:53:57.760032+0000","last_active":"2023-12-16T01:53:57.759978+0000","last_peered":"2023-12-16T01:53:57.759978+0000","last_clean":"2023-12-16T01:53:57.759978+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:53:57.759978+0000","last_undegraded":"2023-12-16T01:53:57.759978+0000","last_fullsized":"2023-12-16T01:53:57.759978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.759893+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:51.550594+0000","scrub_duration":0.0035525439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.553957+0000","last_change":"2023-12-16T01:25:54.980080+0000","last_active":"2023-12-16T01:53:04.553957+0000","last_peered":"2023-12-16T01:53:04.553957+0000","last_clean":"2023-12-16T01:53:04.553957+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:53:04.553957+0000","last_undegraded":"2023-12-16T01:53:04.553957+0000","last_fullsized":"2023-12-16T01:53:04.553957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.762139+0000","last_change":"2023-12-16T01:53:46.762139+0000","last_active":"2023-12-16T01:53:46.762139+0000","last_peered":"2023-12-16T01:53:46.762139+0000","last_clean":"2023-12-16T01:53:46.762139+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:46.762139+0000","last_undegraded":"2023-12-16T01:53:46.762139+0000","last_fullsized":"2023-12-16T01:53:46.762139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_clean_scrub_stamp":"2023-12-16T01:53:46.762050+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:14:34.070815+0000","scrub_duration":0.00115817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.074927+0000","last_change":"2023-12-16T01:54:00.074946+0000","last_active":"2023-12-16T01:54:00.074927+0000","last_peered":"2023-12-16T01:54:00.074927+0000","last_clean":"2023-12-16T01:54:00.074927+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:54:00.074927+0000","last_undegraded":"2023-12-16T01:54:00.074927+0000","last_fullsized":"2023-12-16T01:54:00.074927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.074849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:07.538136+0000","scrub_duration":0.0010289749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":167,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:52:58.942318+0000","last_change":"2023-12-16T01:25:54.984439+0000","last_active":"2023-12-16T01:52:58.942318+0000","last_peered":"2023-12-16T01:52:58.942318+0000","last_clean":"2023-12-16T01:52:58.942318+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:52:58.942318+0000","last_undegraded":"2023-12-16T01:52:58.942318+0000","last_fullsized":"2023-12-16T01:52:58.942318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.113069+0000","last_change":"2023-12-16T01:54:08.113087+0000","last_active":"2023-12-16T01:54:08.113069+0000","last_peered":"2023-12-16T01:54:08.113069+0000","last_clean":"2023-12-16T01:54:08.113069+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:54:08.113069+0000","last_undegraded":"2023-12-16T01:54:08.113069+0000","last_fullsized":"2023-12-16T01:54:08.113069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:54:08.113001+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:54:08.113001+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.113001+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:45.839952+0000","scrub_duration":0.00083020499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.216961+0000","last_change":"2023-12-16T01:54:14.216995+0000","last_active":"2023-12-16T01:54:14.216961+0000","last_peered":"2023-12-16T01:54:14.216961+0000","last_clean":"2023-12-16T01:54:14.216961+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:54:14.216961+0000","last_undegraded":"2023-12-16T01:54:14.216961+0000","last_fullsized":"2023-12-16T01:54:14.216961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:54:14.216870+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:54:14.216870+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.216870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:09.912524+0000","scrub_duration":0.00133464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958609+0000","last_change":"2023-12-16T01:25:54.990175+0000","last_active":"2023-12-16T01:53:47.958609+0000","last_peered":"2023-12-16T01:53:47.958609+0000","last_clean":"2023-12-16T01:53:47.958609+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:53:47.958609+0000","last_undegraded":"2023-12-16T01:53:47.958609+0000","last_fullsized":"2023-12-16T01:53:47.958609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:10.184221+0000","last_change":"2023-12-16T01:54:10.184243+0000","last_active":"2023-12-16T01:54:10.184221+0000","last_peered":"2023-12-16T01:54:10.184221+0000","last_clean":"2023-12-16T01:54:10.184221+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:54:10.184221+0000","last_undegraded":"2023-12-16T01:54:10.184221+0000","last_fullsized":"2023-12-16T01:54:10.184221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:10.184147+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:10.184147+0000","last_clean_scrub_stamp":"2023-12-16T01:54:10.184147+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.454836+0000","scrub_duration":0.0012486699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'305","reported_seq":345,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.287784+0000","last_change":"2023-12-16T01:53:54.287821+0000","last_active":"2023-12-16T01:53:54.287784+0000","last_peered":"2023-12-16T01:53:54.287784+0000","last_clean":"2023-12-16T01:53:54.287784+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:54.287784+0000","last_undegraded":"2023-12-16T01:53:54.287784+0000","last_fullsized":"2023-12-16T01:53:54.287784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'305","last_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_deep_scrub":"28'305","last_deep_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.287730+0000","objects_scrubbed":3,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:54.985981+0000","scrub_duration":0.0098894640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551382+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:04.551382+0000","last_peered":"2023-12-16T01:53:04.551382+0000","last_clean":"2023-12-16T01:53:04.551382+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:04.551382+0000","last_undegraded":"2023-12-16T01:53:04.551382+0000","last_fullsized":"2023-12-16T01:53:04.551382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.122651+0000","last_change":"2023-12-16T01:53:53.122671+0000","last_active":"2023-12-16T01:53:53.122651+0000","last_peered":"2023-12-16T01:53:53.122651+0000","last_clean":"2023-12-16T01:53:53.122651+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:53.122651+0000","last_undegraded":"2023-12-16T01:53:53.122651+0000","last_fullsized":"2023-12-16T01:53:53.122651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.122566+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:09.183578+0000","scrub_duration":0.0013206579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'862","reported_seq":902,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.890311+0000","last_change":"2023-12-16T01:53:48.890311+0000","last_active":"2023-12-16T01:53:48.890311+0000","last_peered":"2023-12-16T01:53:48.890311+0000","last_clean":"2023-12-16T01:53:48.890311+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:48.890311+0000","last_undegraded":"2023-12-16T01:53:48.890311+0000","last_fullsized":"2023-12-16T01:53:48.890311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'862","last_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_deep_scrub":"28'862","last_deep_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.890224+0000","objects_scrubbed":4,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:27.964886+0000","scrub_duration":0.017688373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413315+0000","last_change":"2023-12-16T01:25:54.988084+0000","last_active":"2023-12-16T01:53:46.413315+0000","last_peered":"2023-12-16T01:53:46.413315+0000","last_clean":"2023-12-16T01:53:46.413315+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:53:46.413315+0000","last_undegraded":"2023-12-16T01:53:46.413315+0000","last_fullsized":"2023-12-16T01:53:46.413315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.035555+0000","last_change":"2023-12-16T01:53:50.035555+0000","last_active":"2023-12-16T01:53:50.035555+0000","last_peered":"2023-12-16T01:53:50.035555+0000","last_clean":"2023-12-16T01:53:50.035555+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:50.035555+0000","last_undegraded":"2023-12-16T01:53:50.035555+0000","last_fullsized":"2023-12-16T01:53:50.035555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.035441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:24:50.625126+0000","scrub_duration":0.000932255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'733","reported_seq":772,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.268484+0000","last_change":"2023-12-16T01:53:55.268530+0000","last_active":"2023-12-16T01:53:55.268484+0000","last_peered":"2023-12-16T01:53:55.268484+0000","last_clean":"2023-12-16T01:53:55.268484+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:55.268484+0000","last_undegraded":"2023-12-16T01:53:55.268484+0000","last_fullsized":"2023-12-16T01:53:55.268484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'733","last_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_deep_scrub":"28'733","last_deep_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.268403+0000","objects_scrubbed":2,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:47.666935+0000","scrub_duration":0.0025599799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.731713+0000","last_change":"2023-12-16T01:54:23.731732+0000","last_active":"2023-12-16T01:54:23.731713+0000","last_peered":"2023-12-16T01:54:23.731713+0000","last_clean":"2023-12-16T01:54:23.731713+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:54:23.731713+0000","last_undegraded":"2023-12-16T01:54:23.731713+0000","last_fullsized":"2023-12-16T01:54:23.731713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'148","last_scrub_stamp":"2023-12-16T01:54:23.731645+0000","last_deep_scrub":"28'148","last_deep_scrub_stamp":"2023-12-16T01:54:23.731645+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.731645+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:22:12.153494+0000","scrub_duration":0.0015408500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.036067+0000","last_change":"2023-12-16T01:54:14.036119+0000","last_active":"2023-12-16T01:54:14.036067+0000","last_peered":"2023-12-16T01:54:14.036067+0000","last_clean":"2023-12-16T01:54:14.036067+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:54:14.036067+0000","last_undegraded":"2023-12-16T01:54:14.036067+0000","last_fullsized":"2023-12-16T01:54:14.036067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:14.035948+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:14.035948+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.035948+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:51.762899+0000","scrub_duration":0.0012783219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.107511+0000","last_change":"2023-12-16T01:53:54.107532+0000","last_active":"2023-12-16T01:53:54.107511+0000","last_peered":"2023-12-16T01:53:54.107511+0000","last_clean":"2023-12-16T01:53:54.107511+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:54.107511+0000","last_undegraded":"2023-12-16T01:53:54.107511+0000","last_fullsized":"2023-12-16T01:53:54.107511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.107444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:13.177048+0000","scrub_duration":0.0010581900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.351537+0000","last_change":"2023-12-16T01:54:02.351560+0000","last_active":"2023-12-16T01:54:02.351537+0000","last_peered":"2023-12-16T01:54:02.351537+0000","last_clean":"2023-12-16T01:54:02.351537+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:54:02.351537+0000","last_undegraded":"2023-12-16T01:54:02.351537+0000","last_fullsized":"2023-12-16T01:54:02.351537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.351459+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:39.889377+0000","scrub_duration":0.0017115850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.737412+0000","last_change":"2023-12-16T01:54:00.737430+0000","last_active":"2023-12-16T01:54:00.737412+0000","last_peered":"2023-12-16T01:54:00.737412+0000","last_clean":"2023-12-16T01:54:00.737412+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:54:00.737412+0000","last_undegraded":"2023-12-16T01:54:00.737412+0000","last_fullsized":"2023-12-16T01:54:00.737412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.737350+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:56.008039+0000","scrub_duration":0.000879626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.810899+0000","last_change":"2023-12-16T01:53:45.810944+0000","last_active":"2023-12-16T01:53:45.810899+0000","last_peered":"2023-12-16T01:53:45.810899+0000","last_clean":"2023-12-16T01:53:45.810899+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:45.810899+0000","last_undegraded":"2023-12-16T01:53:45.810899+0000","last_fullsized":"2023-12-16T01:53:45.810899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_clean_scrub_stamp":"2023-12-16T01:53:45.810796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:43:50.027324+0000","scrub_duration":0.0012633939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.413309+0000","last_change":"2023-12-16T01:25:54.988299+0000","last_active":"2023-12-16T01:53:46.413309+0000","last_peered":"2023-12-16T01:53:46.413309+0000","last_clean":"2023-12-16T01:53:46.413309+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:53:46.413309+0000","last_undegraded":"2023-12-16T01:53:46.413309+0000","last_fullsized":"2023-12-16T01:53:46.413309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":175,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:29.005815+0000","last_change":"2023-12-16T01:54:29.005838+0000","last_active":"2023-12-16T01:54:29.005815+0000","last_peered":"2023-12-16T01:54:29.005815+0000","last_clean":"2023-12-16T01:54:29.005815+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:54:29.005815+0000","last_undegraded":"2023-12-16T01:54:29.005815+0000","last_fullsized":"2023-12-16T01:54:29.005815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'137","last_scrub_stamp":"2023-12-16T01:54:29.005727+0000","last_deep_scrub":"28'137","last_deep_scrub_stamp":"2023-12-16T01:54:29.005727+0000","last_clean_scrub_stamp":"2023-12-16T01:54:29.005727+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:27.096355+0000","scrub_duration":0.0015835980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.939201+0000","last_change":"2023-12-16T01:54:23.939220+0000","last_active":"2023-12-16T01:54:23.939201+0000","last_peered":"2023-12-16T01:54:23.939201+0000","last_clean":"2023-12-16T01:54:23.939201+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:54:23.939201+0000","last_undegraded":"2023-12-16T01:54:23.939201+0000","last_fullsized":"2023-12-16T01:54:23.939201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:23.939133+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:23.939133+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.939133+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:09.037341+0000","scrub_duration":0.0012202879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.186350+0000","last_change":"2023-12-16T01:54:16.186390+0000","last_active":"2023-12-16T01:54:16.186350+0000","last_peered":"2023-12-16T01:54:16.186350+0000","last_clean":"2023-12-16T01:54:16.186350+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:54:16.186350+0000","last_undegraded":"2023-12-16T01:54:16.186350+0000","last_fullsized":"2023-12-16T01:54:16.186350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:54:16.186244+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:54:16.186244+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.186244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:30.603337+0000","scrub_duration":0.0012334049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:38.989803+0000","last_change":"2023-12-16T01:26:31.583645+0000","last_active":"2023-12-16T01:53:38.989803+0000","last_peered":"2023-12-16T01:53:38.989803+0000","last_clean":"2023-12-16T01:53:38.989803+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:53:38.989803+0000","last_undegraded":"2023-12-16T01:53:38.989803+0000","last_fullsized":"2023-12-16T01:53:38.989803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.029996+0000","last_change":"2023-12-16T01:53:54.030017+0000","last_active":"2023-12-16T01:53:54.029996+0000","last_peered":"2023-12-16T01:53:54.029996+0000","last_clean":"2023-12-16T01:53:54.029996+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:54.029996+0000","last_undegraded":"2023-12-16T01:53:54.029996+0000","last_fullsized":"2023-12-16T01:53:54.029996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.029929+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:00.181539+0000","scrub_duration":0.0010094170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.153531+0000","last_change":"2023-12-16T01:53:56.153566+0000","last_active":"2023-12-16T01:53:56.153531+0000","last_peered":"2023-12-16T01:53:56.153531+0000","last_clean":"2023-12-16T01:53:56.153531+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:56.153531+0000","last_undegraded":"2023-12-16T01:53:56.153531+0000","last_fullsized":"2023-12-16T01:53:56.153531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.153447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:39.166123+0000","scrub_duration":0.0013686760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'707","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:27.187301+0000","last_change":"2023-12-16T01:54:27.187324+0000","last_active":"2023-12-16T01:54:27.187301+0000","last_peered":"2023-12-16T01:54:27.187301+0000","last_clean":"2023-12-16T01:54:27.187301+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:54:27.187301+0000","last_undegraded":"2023-12-16T01:54:27.187301+0000","last_fullsized":"2023-12-16T01:54:27.187301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'707","last_scrub_stamp":"2023-12-16T01:54:27.187241+0000","last_deep_scrub":"28'707","last_deep_scrub_stamp":"2023-12-16T01:54:27.187241+0000","last_clean_scrub_stamp":"2023-12-16T01:54:27.187241+0000","objects_scrubbed":1,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:47.914075+0000","scrub_duration":0.016851775999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:21.905334+0000","last_change":"2023-12-16T01:54:21.905369+0000","last_active":"2023-12-16T01:54:21.905334+0000","last_peered":"2023-12-16T01:54:21.905334+0000","last_clean":"2023-12-16T01:54:21.905334+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:54:21.905334+0000","last_undegraded":"2023-12-16T01:54:21.905334+0000","last_fullsized":"2023-12-16T01:54:21.905334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:21.905235+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:21.905235+0000","last_clean_scrub_stamp":"2023-12-16T01:54:21.905235+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:40.148671+0000","scrub_duration":0.001311701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.014874+0000","last_change":"2023-12-16T01:54:26.014895+0000","last_active":"2023-12-16T01:54:26.014874+0000","last_peered":"2023-12-16T01:54:26.014874+0000","last_clean":"2023-12-16T01:54:26.014874+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:54:26.014874+0000","last_undegraded":"2023-12-16T01:54:26.014874+0000","last_fullsized":"2023-12-16T01:54:26.014874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-12-16T01:54:26.014808+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-12-16T01:54:26.014808+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.014808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:48.064294+0000","scrub_duration":0.0014740300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'708","reported_seq":746,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.044464+0000","last_change":"2023-12-16T01:54:00.044489+0000","last_active":"2023-12-16T01:54:00.044464+0000","last_peered":"2023-12-16T01:54:00.044464+0000","last_clean":"2023-12-16T01:54:00.044464+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:54:00.044464+0000","last_undegraded":"2023-12-16T01:54:00.044464+0000","last_fullsized":"2023-12-16T01:54:00.044464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'708","last_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_deep_scrub":"28'708","last_deep_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.044392+0000","objects_scrubbed":1,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:00.634076+0000","scrub_duration":0.015574605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.819424+0000","last_change":"2023-12-16T01:53:50.819445+0000","last_active":"2023-12-16T01:53:50.819424+0000","last_peered":"2023-12-16T01:53:50.819424+0000","last_clean":"2023-12-16T01:53:50.819424+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:50.819424+0000","last_undegraded":"2023-12-16T01:53:50.819424+0000","last_fullsized":"2023-12-16T01:53:50.819424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'31","last_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_deep_scrub":"28'31","last_deep_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.819349+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:25.110184+0000","scrub_duration":0.0014030030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:10.424844+0000","last_change":"2023-12-16T01:54:10.424867+0000","last_active":"2023-12-16T01:54:10.424844+0000","last_peered":"2023-12-16T01:54:10.424844+0000","last_clean":"2023-12-16T01:54:10.424844+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:54:10.424844+0000","last_undegraded":"2023-12-16T01:54:10.424844+0000","last_fullsized":"2023-12-16T01:54:10.424844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'168","last_scrub_stamp":"2023-12-16T01:54:10.424760+0000","last_deep_scrub":"28'168","last_deep_scrub_stamp":"2023-12-16T01:54:10.424760+0000","last_clean_scrub_stamp":"2023-12-16T01:54:10.424760+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:30:04.215461+0000","scrub_duration":0.001768616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.853642+0000","last_change":"2023-12-16T01:53:49.853662+0000","last_active":"2023-12-16T01:53:49.853642+0000","last_peered":"2023-12-16T01:53:49.853642+0000","last_clean":"2023-12-16T01:53:49.853642+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:49.853642+0000","last_undegraded":"2023-12-16T01:53:49.853642+0000","last_fullsized":"2023-12-16T01:53:49.853642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.853560+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:47.856024+0000","scrub_duration":0.001387723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.335969+0000","last_change":"2023-12-16T01:53:58.335995+0000","last_active":"2023-12-16T01:53:58.335969+0000","last_peered":"2023-12-16T01:53:58.335969+0000","last_clean":"2023-12-16T01:53:58.335969+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:58.335969+0000","last_undegraded":"2023-12-16T01:53:58.335969+0000","last_fullsized":"2023-12-16T01:53:58.335969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'50","last_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_deep_scrub":"28'50","last_deep_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.335879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:56.338342+0000","scrub_duration":0.001381522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003207+0000","last_change":"2023-12-16T01:25:49.153690+0000","last_active":"2023-12-16T01:53:33.003207+0000","last_peered":"2023-12-16T01:53:33.003207+0000","last_clean":"2023-12-16T01:53:33.003207+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:53:33.003207+0000","last_undegraded":"2023-12-16T01:53:33.003207+0000","last_fullsized":"2023-12-16T01:53:33.003207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.044332+0000","last_change":"2023-12-16T01:53:50.044369+0000","last_active":"2023-12-16T01:53:50.044332+0000","last_peered":"2023-12-16T01:53:50.044332+0000","last_clean":"2023-12-16T01:53:50.044332+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:50.044332+0000","last_undegraded":"2023-12-16T01:53:50.044332+0000","last_fullsized":"2023-12-16T01:53:50.044332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.044262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:27.808420+0000","scrub_duration":0.0011708160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.958518+0000","last_change":"2023-12-16T01:25:49.148119+0000","last_active":"2023-12-16T01:53:47.958518+0000","last_peered":"2023-12-16T01:53:47.958518+0000","last_clean":"2023-12-16T01:53:47.958518+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:53:47.958518+0000","last_undegraded":"2023-12-16T01:53:47.958518+0000","last_fullsized":"2023-12-16T01:53:47.958518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:24.214245+0000","last_change":"2023-12-16T01:54:24.214266+0000","last_active":"2023-12-16T01:54:24.214245+0000","last_peered":"2023-12-16T01:54:24.214245+0000","last_clean":"2023-12-16T01:54:24.214245+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:54:24.214245+0000","last_undegraded":"2023-12-16T01:54:24.214245+0000","last_fullsized":"2023-12-16T01:54:24.214245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:24.214177+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:24.214177+0000","last_clean_scrub_stamp":"2023-12-16T01:54:24.214177+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:56:49.729370+0000","scrub_duration":0.0010708530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.620368+0000","last_change":"2023-12-16T01:54:03.620408+0000","last_active":"2023-12-16T01:54:03.620368+0000","last_peered":"2023-12-16T01:54:03.620368+0000","last_clean":"2023-12-16T01:54:03.620368+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:54:03.620368+0000","last_undegraded":"2023-12-16T01:54:03.620368+0000","last_fullsized":"2023-12-16T01:54:03.620368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.620291+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:41.384448+0000","scrub_duration":0.001035563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.046833+0000","last_change":"2023-12-16T01:54:16.046870+0000","last_active":"2023-12-16T01:54:16.046833+0000","last_peered":"2023-12-16T01:54:16.046833+0000","last_clean":"2023-12-16T01:54:16.046833+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:54:16.046833+0000","last_undegraded":"2023-12-16T01:54:16.046833+0000","last_fullsized":"2023-12-16T01:54:16.046833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:54:16.046718+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:54:16.046718+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.046718+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:46.227198+0000","scrub_duration":0.001640655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.162751+0000","last_change":"2023-12-16T01:54:12.162769+0000","last_active":"2023-12-16T01:54:12.162751+0000","last_peered":"2023-12-16T01:54:12.162751+0000","last_clean":"2023-12-16T01:54:12.162751+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:54:12.162751+0000","last_undegraded":"2023-12-16T01:54:12.162751+0000","last_fullsized":"2023-12-16T01:54:12.162751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:54:12.162688+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:54:12.162688+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.162688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:05.950652+0000","scrub_duration":0.0011708510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:09.935583+0000","last_change":"2023-12-16T01:54:09.935603+0000","last_active":"2023-12-16T01:54:09.935583+0000","last_peered":"2023-12-16T01:54:09.935583+0000","last_clean":"2023-12-16T01:54:09.935583+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:54:09.935583+0000","last_undegraded":"2023-12-16T01:54:09.935583+0000","last_fullsized":"2023-12-16T01:54:09.935583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2023-12-16T01:54:09.935514+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2023-12-16T01:54:09.935514+0000","last_clean_scrub_stamp":"2023-12-16T01:54:09.935514+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:04.544423+0000","scrub_duration":0.001116955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.710495+0000","last_change":"2023-12-16T01:53:59.710514+0000","last_active":"2023-12-16T01:53:59.710495+0000","last_peered":"2023-12-16T01:53:59.710495+0000","last_clean":"2023-12-16T01:53:59.710495+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:59.710495+0000","last_undegraded":"2023-12-16T01:53:59.710495+0000","last_fullsized":"2023-12-16T01:53:59.710495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.710431+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:52.108963+0000","scrub_duration":0.00086866999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.807870+0000","last_change":"2023-12-16T01:53:47.807889+0000","last_active":"2023-12-16T01:53:47.807870+0000","last_peered":"2023-12-16T01:53:47.807870+0000","last_clean":"2023-12-16T01:53:47.807870+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:47.807870+0000","last_undegraded":"2023-12-16T01:53:47.807870+0000","last_fullsized":"2023-12-16T01:53:47.807870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.807786+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:03.908247+0000","scrub_duration":0.0012442099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:27.061793+0000","last_change":"2023-12-16T01:54:27.061813+0000","last_active":"2023-12-16T01:54:27.061793+0000","last_peered":"2023-12-16T01:54:27.061793+0000","last_clean":"2023-12-16T01:54:27.061793+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:54:27.061793+0000","last_undegraded":"2023-12-16T01:54:27.061793+0000","last_fullsized":"2023-12-16T01:54:27.061793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:27.061721+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:27.061721+0000","last_clean_scrub_stamp":"2023-12-16T01:54:27.061721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:57.242202+0000","scrub_duration":0.0011862120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003201+0000","last_change":"2023-12-16T01:25:49.153846+0000","last_active":"2023-12-16T01:53:33.003201+0000","last_peered":"2023-12-16T01:53:33.003201+0000","last_clean":"2023-12-16T01:53:33.003201+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:53:33.003201+0000","last_undegraded":"2023-12-16T01:53:33.003201+0000","last_fullsized":"2023-12-16T01:53:33.003201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.372063+0000","last_change":"2023-12-16T01:53:59.372084+0000","last_active":"2023-12-16T01:53:59.372063+0000","last_peered":"2023-12-16T01:53:59.372063+0000","last_clean":"2023-12-16T01:53:59.372063+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:59.372063+0000","last_undegraded":"2023-12-16T01:53:59.372063+0000","last_fullsized":"2023-12-16T01:53:59.372063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.371983+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:57:27.780046+0000","scrub_duration":0.0014106590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.101807+0000","last_change":"2023-12-16T01:53:53.101827+0000","last_active":"2023-12-16T01:53:53.101807+0000","last_peered":"2023-12-16T01:53:53.101807+0000","last_clean":"2023-12-16T01:53:53.101807+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:53.101807+0000","last_undegraded":"2023-12-16T01:53:53.101807+0000","last_fullsized":"2023-12-16T01:53:53.101807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.101731+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:41.523580+0000","scrub_duration":0.001408493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.189281+0000","last_change":"2023-12-16T01:54:13.189300+0000","last_active":"2023-12-16T01:54:13.189281+0000","last_peered":"2023-12-16T01:54:13.189281+0000","last_clean":"2023-12-16T01:54:13.189281+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:54:13.189281+0000","last_undegraded":"2023-12-16T01:54:13.189281+0000","last_fullsized":"2023-12-16T01:54:13.189281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2023-12-16T01:54:13.189209+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2023-12-16T01:54:13.189209+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.189209+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:43.369689+0000","scrub_duration":0.00095558600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.026555+0000","last_change":"2023-12-16T01:54:13.026575+0000","last_active":"2023-12-16T01:54:13.026555+0000","last_peered":"2023-12-16T01:54:13.026555+0000","last_clean":"2023-12-16T01:54:13.026555+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:54:13.026555+0000","last_undegraded":"2023-12-16T01:54:13.026555+0000","last_fullsized":"2023-12-16T01:54:13.026555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:54:13.026479+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:54:13.026479+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.026479+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:11.117107+0000","scrub_duration":0.0012824760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.183617+0000","last_change":"2023-12-16T01:54:26.183650+0000","last_active":"2023-12-16T01:54:26.183617+0000","last_peered":"2023-12-16T01:54:26.183617+0000","last_clean":"2023-12-16T01:54:26.183617+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:54:26.183617+0000","last_undegraded":"2023-12-16T01:54:26.183617+0000","last_fullsized":"2023-12-16T01:54:26.183617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:26.183523+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:26.183523+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.183523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:01:51.819803+0000","scrub_duration":0.00098922000000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.291234+0000","last_change":"2023-12-16T01:54:20.291254+0000","last_active":"2023-12-16T01:54:20.291234+0000","last_peered":"2023-12-16T01:54:20.291234+0000","last_clean":"2023-12-16T01:54:20.291234+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:54:20.291234+0000","last_undegraded":"2023-12-16T01:54:20.291234+0000","last_fullsized":"2023-12-16T01:54:20.291234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:20.291163+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:20.291163+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.291163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:39.360767+0000","scrub_duration":0.0011258080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.075941+0000","last_change":"2023-12-16T01:25:49.146861+0000","last_active":"2023-12-16T01:53:33.075941+0000","last_peered":"2023-12-16T01:53:33.075941+0000","last_clean":"2023-12-16T01:53:33.075941+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:53:33.075941+0000","last_undegraded":"2023-12-16T01:53:33.075941+0000","last_fullsized":"2023-12-16T01:53:33.075941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.064702+0000","last_change":"2023-12-16T01:54:12.064722+0000","last_active":"2023-12-16T01:54:12.064702+0000","last_peered":"2023-12-16T01:54:12.064702+0000","last_clean":"2023-12-16T01:54:12.064702+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:54:12.064702+0000","last_undegraded":"2023-12-16T01:54:12.064702+0000","last_fullsized":"2023-12-16T01:54:12.064702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:54:12.064634+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:54:12.064634+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.064634+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:57.162842+0000","scrub_duration":0.0009898629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.064505+0000","last_change":"2023-12-16T01:54:14.064525+0000","last_active":"2023-12-16T01:54:14.064505+0000","last_peered":"2023-12-16T01:54:14.064505+0000","last_clean":"2023-12-16T01:54:14.064505+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:54:14.064505+0000","last_undegraded":"2023-12-16T01:54:14.064505+0000","last_fullsized":"2023-12-16T01:54:14.064505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:54:14.064440+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:54:14.064440+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.064440+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:36.113927+0000","scrub_duration":0.00088475900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.781093+0000","last_change":"2023-12-16T01:54:02.781112+0000","last_active":"2023-12-16T01:54:02.781093+0000","last_peered":"2023-12-16T01:54:02.781093+0000","last_clean":"2023-12-16T01:54:02.781093+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:54:02.781093+0000","last_undegraded":"2023-12-16T01:54:02.781093+0000","last_fullsized":"2023-12-16T01:54:02.781093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.781026+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:00.783489+0000","scrub_duration":0.0010688659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:15.016584+0000","last_change":"2023-12-16T01:54:15.016622+0000","last_active":"2023-12-16T01:54:15.016584+0000","last_peered":"2023-12-16T01:54:15.016584+0000","last_clean":"2023-12-16T01:54:15.016584+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:54:15.016584+0000","last_undegraded":"2023-12-16T01:54:15.016584+0000","last_fullsized":"2023-12-16T01:54:15.016584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30","last_scrub_stamp":"2023-12-16T01:54:15.016472+0000","last_deep_scrub":"28'30","last_deep_scrub_stamp":"2023-12-16T01:54:15.016472+0000","last_clean_scrub_stamp":"2023-12-16T01:54:15.016472+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:08.804435+0000","scrub_duration":0.001432675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.076910+0000","last_change":"2023-12-16T01:54:20.076932+0000","last_active":"2023-12-16T01:54:20.076910+0000","last_peered":"2023-12-16T01:54:20.076910+0000","last_clean":"2023-12-16T01:54:20.076910+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:54:20.076910+0000","last_undegraded":"2023-12-16T01:54:20.076910+0000","last_fullsized":"2023-12-16T01:54:20.076910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:20.076831+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:20.076831+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.076831+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:37.396986+0000","scrub_duration":0.001131235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.646330+0000","last_change":"2023-12-16T01:54:02.646365+0000","last_active":"2023-12-16T01:54:02.646330+0000","last_peered":"2023-12-16T01:54:02.646330+0000","last_clean":"2023-12-16T01:54:02.646330+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:54:02.646330+0000","last_undegraded":"2023-12-16T01:54:02.646330+0000","last_fullsized":"2023-12-16T01:54:02.646330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.646262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:36.193892+0000","scrub_duration":0.0012008120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.063353+0000","last_change":"2023-12-16T01:53:50.063370+0000","last_active":"2023-12-16T01:53:50.063353+0000","last_peered":"2023-12-16T01:53:50.063353+0000","last_clean":"2023-12-16T01:53:50.063353+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:50.063353+0000","last_undegraded":"2023-12-16T01:53:50.063353+0000","last_fullsized":"2023-12-16T01:53:50.063353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.063280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:56:51.897233+0000","scrub_duration":0.0012023349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.792454+0000","last_change":"2023-12-16T01:53:51.792454+0000","last_active":"2023-12-16T01:53:51.792454+0000","last_peered":"2023-12-16T01:53:51.792454+0000","last_clean":"2023-12-16T01:53:51.792454+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:51.792454+0000","last_undegraded":"2023-12-16T01:53:51.792454+0000","last_fullsized":"2023-12-16T01:53:51.792454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.792374+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:52.206345+0000","scrub_duration":0.00118464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:52.065928+0000","last_change":"2023-12-16T01:53:52.065951+0000","last_active":"2023-12-16T01:53:52.065928+0000","last_peered":"2023-12-16T01:53:52.065928+0000","last_clean":"2023-12-16T01:53:52.065928+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:52.065928+0000","last_undegraded":"2023-12-16T01:53:52.065928+0000","last_fullsized":"2023-12-16T01:53:52.065928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_clean_scrub_stamp":"2023-12-16T01:53:52.065855+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:50.928964+0000","scrub_duration":0.0010821439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:21.079655+0000","last_change":"2023-12-16T01:54:21.079674+0000","last_active":"2023-12-16T01:54:21.079655+0000","last_peered":"2023-12-16T01:54:21.079655+0000","last_clean":"2023-12-16T01:54:21.079655+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:54:21.079655+0000","last_undegraded":"2023-12-16T01:54:21.079655+0000","last_fullsized":"2023-12-16T01:54:21.079655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:21.079593+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:21.079593+0000","last_clean_scrub_stamp":"2023-12-16T01:54:21.079593+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:35.496686+0000","scrub_duration":0.00089815900000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.103565+0000","last_change":"2023-12-16T01:53:47.103599+0000","last_active":"2023-12-16T01:53:47.103565+0000","last_peered":"2023-12-16T01:53:47.103565+0000","last_clean":"2023-12-16T01:53:47.103565+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:47.103565+0000","last_undegraded":"2023-12-16T01:53:47.103565+0000","last_fullsized":"2023-12-16T01:53:47.103565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.103490+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:40.015122+0000","scrub_duration":0.001277678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8679,"ondisk_log_size":8679,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542495,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.41099999999999998},"min":{"1min":0.34899999999999998,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.373},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42399999999999999,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.64800000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.435,"15min":0.437},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.72799999999999998},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.65800000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.35999999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.66300000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.28899999999999998},"max":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.66400000000000003},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.224},"max":{"1min":0.501,"5min":0.61799999999999999,"15min":0.69699999999999995},"last":0.314},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.39000000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.60299999999999998,"5min":0.627,"15min":0.67900000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.503,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.47499999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.315,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.66700000000000004},"last":0.439},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":0.77700000000000002},"last":0.496}]}]},{"osd":6,"up_from":14,"seq":60129542493,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.27100000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.63,"5min":0.63,"15min":0.69399999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.45700000000000002,"15min":0.43099999999999999},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.25600000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.86599999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.26100000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67600000000000005},"last":0.5},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.92300000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.47999999999999998,"15min":0.46700000000000003},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"min":{"1min":0.28999999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.40000000000000002}]},{"osd":5,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.27900000000000003,"5min":0.254,"15min":0.254},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.33200000000000002,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47999999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.44}]}]},{"osd":5,"up_from":14,"seq":60129542494,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.442},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.438,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.432}]},{"osd":1,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.78700000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.44400000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.26000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.71699999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":0.54300000000000004,"5min":0.56499999999999995,"15min":0.67400000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.70799999999999996},"last":0.35199999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.39900000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:53:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.69799999999999995},"last":0.307},{"interface":"front","average":{"1min":0.436,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.371}]}]},{"osd":4,"up_from":14,"seq":60129542495,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45500000000000002,"15min":0.434},"min":{"1min":0.376,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.623,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.35299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44,"15min":0.42099999999999999},"min":{"1min":0.36199999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.63600000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.38900000000000001,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66300000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.32300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.45300000000000001},"min":{"1min":0.39700000000000002,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.438,"15min":0.42699999999999999},"min":{"1min":0.374,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.44500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55600000000000005}]},{"osd":5,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.373},{"interface":"front","average":{"1min":0.432,"5min":0.40500000000000003,"15min":0.39700000000000002},"min":{"1min":0.251,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.46400000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.28000000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.495}]},{"osd":7,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.72099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.46200000000000002},"min":{"1min":0.32400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48099999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542494,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.28699999999999998},"min":{"1min":0.22,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29999999999999999},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.35399999999999998}]},{"osd":1,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.312,"15min":0.30499999999999999},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.45200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.52400000000000002},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.50600000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.497,"5min":0.51300000000000001,"15min":0.63400000000000001},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"max":{"1min":0.54600000000000004,"5min":0.69799999999999995,"15min":0.79300000000000004},"last":0.442}]},{"osd":5,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.64700000000000002},"last":0.51000000000000001}]},{"osd":6,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.55900000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.314},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Dec 16 01:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.40100000000000002,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.70099999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.49399999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542494,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.29099999999999998,"15min":0.29399999999999998},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.60499999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.309,"15min":0.30599999999999999},"min":{"1min":0.218,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.54600000000000004},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.56599999999999995},"last":0.38}]},{"osd":3,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.315,"15min":0.317},"min":{"1min":0.24199999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.55000000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.67800000000000005},"last":0.36099999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.438},"min":{"1min":0.317,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.65000000000000002,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.67900000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.34999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.82899999999999996},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.74299999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Dec 16 01:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.69599999999999995,"15min":0.76000000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71099999999999997},"last":0.59999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542494,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.29899999999999999},"min":{"1min":0.21099999999999999,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.438,"5min":0.50700000000000001,"15min":0.56999999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.308},"min":{"1min":0.23999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.46300000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.35699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.20200000000000001},"max":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.27600000000000002,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.437,"15min":0.432},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.68000000000000005,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.28399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.77700000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.76200000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.46400000000000002},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.96699999999999997},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.80700000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.76600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542494,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.216,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54900000000000004},"last":0.245},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.27500000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.67700000000000005},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.35499999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.70399999999999996,"15min":0.753},"last":0.442},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.73099999999999998},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Dec 16 01:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:54:30.609 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.609 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.609 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.610 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.610 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.610 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.610 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.610 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-16T01:25:46.612747+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=46, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.610 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.611 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.612 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.612 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.612 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.612 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.612 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.613 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.613 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.613 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.613 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:30.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T01:54:36.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:54:36.283 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:54:50.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:54:50.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.716+0000 7f608aa3d640 1 Processor -- start 2023-12-16T01:54:50.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.716+0000 7f608aa3d640 1 -- start start 2023-12-16T01:54:50.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.717+0000 7f608aa3d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f60841501c0 0x7f6084159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:50.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.717+0000 7f608aa3d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6084156e60 0x7f6084071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:50.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.717+0000 7f608aa3d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6084072b60 con 0x7f60840bff00 2023-12-16T01:54:50.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.717+0000 7f608aa3d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60841572d0 con 0x7f6084156e60 2023-12-16T01:54:50.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.717+0000 7f608aa3d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840c1a90 con 0x7f60841501c0 2023-12-16T01:54:50.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.718+0000 7f6088fda640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6084156e60 0x7f6084071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:50.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.718+0000 7f6083fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f60841501c0 0x7f6084159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:50.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.718+0000 7f60837fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f60840bff00 0x7f6084072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:45028/0 (socket says 172.21.15.107:45028) 2023-12-16T01:54:50.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.718+0000 7f60837fe640 1 -- 172.21.15.107:0/885854434 learned_addr learned my addr 172.21.15.107:0/885854434 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:54:50.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.720+0000 7f6083fff640 1 -- 172.21.15.107:0/885854434 >> v2:172.21.15.107:3300/0 conn(0x7f6084156e60 msgr2=0x7f6084071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:54:50.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.720+0000 7f6083fff640 1 --2- 172.21.15.107:0/885854434 >> v2:172.21.15.107:3300/0 conn(0x7f6084156e60 0x7f6084071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:50.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.720+0000 7f6083fff640 1 -- 172.21.15.107:0/885854434 >> v1:172.21.15.107:6789/0 conn(0x7f60840bff00 legacy=0x7f6084072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:50.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.720+0000 7f6083fff640 1 -- 172.21.15.107:0/885854434 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840c1d30 con 0x7f60841501c0 2023-12-16T01:54:50.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.722+0000 7f6083fff640 1 --2- 172.21.15.107:0/885854434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60841501c0 0x7f6084159860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60840cbad0 tx=0x7f607402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8203ac01763f525 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:50.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.726+0000 7f6082ffd640 1 -- 172.21.15.107:0/885854434 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074030610 con 0x7f60841501c0 2023-12-16T01:54:50.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.726+0000 7f6082ffd640 1 -- 172.21.15.107:0/885854434 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074030770 con 0x7f60841501c0 2023-12-16T01:54:50.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.726+0000 7f6082ffd640 1 -- 172.21.15.107:0/885854434 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074030b00 con 0x7f60841501c0 2023-12-16T01:54:50.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 -- 172.21.15.107:0/885854434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60841501c0 msgr2=0x7f6084159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:50.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 --2- 172.21.15.107:0/885854434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60841501c0 0x7f6084159860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60840cbad0 tx=0x7f607402b960 comp rx=0 tx=0).stop 2023-12-16T01:54:50.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 -- 172.21.15.107:0/885854434 shutdown_connections 2023-12-16T01:54:50.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 --2- 172.21.15.107:0/885854434 >> v2:172.21.15.107:3300/0 conn(0x7f6084156e60 0x7f6084071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:50.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 --2- 172.21.15.107:0/885854434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60841501c0 0x7f6084159860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:50.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 -- 172.21.15.107:0/885854434 >> 172.21.15.107:0/885854434 conn(0x7f608406cd60 msgr2=0x7f608406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:54:50.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 -- 172.21.15.107:0/885854434 shutdown_connections 2023-12-16T01:54:50.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.727+0000 7f608aa3d640 1 -- 172.21.15.107:0/885854434 wait complete. 2023-12-16T01:54:50.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.728+0000 7f608aa3d640 1 Processor -- start 2023-12-16T01:54:50.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.728+0000 7f608aa3d640 1 -- start start 2023-12-16T01:54:50.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.729+0000 7f608aa3d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60840bff00 0x7f60841f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:50.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.729+0000 7f608aa3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 0x7f60841499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:50.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.729+0000 7f608aa3d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6084156e60 0x7f60841e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:50.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.729+0000 7f608aa3d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084151570 con 0x7f60841501c0 2023-12-16T01:54:50.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.729+0000 7f608aa3d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60841f3850 con 0x7f6084156e60 2023-12-16T01:54:50.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.729+0000 7f608aa3d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60841593a0 con 0x7f60840bff00 2023-12-16T01:54:50.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.730+0000 7f60837fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 0x7f60841499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:50.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.730+0000 7f60837fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 0x7f60841499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37830/0 (socket says 172.21.15.107:37830) 2023-12-16T01:54:50.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.730+0000 7f60837fe640 1 -- 172.21.15.107:0/1093623557 learned_addr learned my addr 172.21.15.107:0/1093623557 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:54:50.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.730+0000 7f6083fff640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60840bff00 0x7f60841f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:50.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.730+0000 7f6088fda640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6084156e60 0x7f60841e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:50.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.733+0000 7f60837fe640 1 -- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60840bff00 msgr2=0x7f60841f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:50.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.733+0000 7f60837fe640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60840bff00 0x7f60841f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:50.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.733+0000 7f60837fe640 1 -- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6084156e60 msgr2=0x7f60841e0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:50.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.733+0000 7f60837fe640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6084156e60 0x7f60841e0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:50.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.733+0000 7f60837fe640 1 -- 172.21.15.107:0/1093623557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074009400 con 0x7f60841501c0 2023-12-16T01:54:50.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.735+0000 7f60837fe640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 0x7f60841499e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f607800c400 tx=0x7f607800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:50.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.739+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078005ce0 con 0x7f60841501c0 2023-12-16T01:54:50.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.739+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078005e40 con 0x7f60841501c0 2023-12-16T01:54:50.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.739+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780072d0 con 0x7f60841501c0 2023-12-16T01:54:50.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.739+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60841e0ac0 con 0x7f60841501c0 2023-12-16T01:54:50.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.739+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6084151170 con 0x7f60841501c0 2023-12-16T01:54:50.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.740+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60840c77e0 con 0x7f60841501c0 2023-12-16T01:54:50.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.981+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f60780074f0 con 0x7f60841501c0 2023-12-16T01:54:50.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.982+0000 7f6080ff9640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f607006ae90 0x7f607006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:54:50.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.982+0000 7f6083fff640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f607006ae90 0x7f607006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:54:50.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.982+0000 7f6083fff640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f607006ae90 0x7f607006d350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6074036000 tx=0x7f6074008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:54:50.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.995+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6078057e70 con 0x7f60841501c0 2023-12-16T01:54:50.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:50.995+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f60780541b0 con 0x7f60841501c0 2023-12-16T01:54:51.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.158+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60840729f0 con 0x7f607006ae90 2023-12-16T01:54:51.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.167+0000 7f6080ff9640 1 -- 172.21.15.107:0/1093623557 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373946 (secure 0 0 0) 0x7f60840729f0 con 0x7f607006ae90 2023-12-16T01:54:51.173 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:54:51.175 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:54:51.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f607006ae90 msgr2=0x7f607006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:51.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f607006ae90 0x7f607006d350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6074036000 tx=0x7f6074008030 comp rx=0 tx=0).stop 2023-12-16T01:54:51.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 msgr2=0x7f60841499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:54:51.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 0x7f60841499e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f607800c400 tx=0x7f607800c8c0 comp rx=0 tx=0).stop 2023-12-16T01:54:51.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 shutdown_connections 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f607006ae90 0x7f607006d350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6084156e60 0x7f60841e0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60841501c0 0x7f60841499e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 --2- 172.21.15.107:0/1093623557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60840bff00 0x7f60841f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 >> 172.21.15.107:0/1093623557 conn(0x7f608406cd60 msgr2=0x7f608406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 shutdown_connections 2023-12-16T01:54:51.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:54:51.171+0000 7f608aa3d640 1 -- 172.21.15.107:0/1093623557 wait complete. 2023-12-16T01:54:51.184 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":898,"stamp":"2023-12-16T01:54:50.106017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15814,"ondisk_log_size":15814,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"2.1f","version":"28'624","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.712481+0000","last_change":"2023-12-16T01:53:53.712506+0000","last_active":"2023-12-16T01:53:53.712481+0000","last_peered":"2023-12-16T01:53:53.712481+0000","last_clean":"2023-12-16T01:53:53.712481+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:53.712481+0000","last_undegraded":"2023-12-16T01:53:53.712481+0000","last_fullsized":"2023-12-16T01:53:53.712481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'624","last_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_deep_scrub":"28'624","last_deep_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.712422+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:46.624054+0000","scrub_duration":0.013433865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:18.081704+0000","last_change":"2023-12-16T01:54:18.081724+0000","last_active":"2023-12-16T01:54:18.081704+0000","last_peered":"2023-12-16T01:54:18.081704+0000","last_clean":"2023-12-16T01:54:18.081704+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:54:18.081704+0000","last_undegraded":"2023-12-16T01:54:18.081704+0000","last_fullsized":"2023-12-16T01:54:18.081704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2023-12-16T01:54:18.081625+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2023-12-16T01:54:18.081625+0000","last_clean_scrub_stamp":"2023-12-16T01:54:18.081625+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:26.347108+0000","scrub_duration":0.0012030560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:06.405931+0000","last_change":"2023-12-16T01:54:06.405952+0000","last_active":"2023-12-16T01:54:06.405931+0000","last_peered":"2023-12-16T01:54:06.405931+0000","last_clean":"2023-12-16T01:54:06.405931+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:54:06.405931+0000","last_undegraded":"2023-12-16T01:54:06.405931+0000","last_fullsized":"2023-12-16T01:54:06.405931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'160","last_scrub_stamp":"2023-12-16T01:54:06.405857+0000","last_deep_scrub":"28'160","last_deep_scrub_stamp":"2023-12-16T01:54:06.405857+0000","last_clean_scrub_stamp":"2023-12-16T01:54:06.405857+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:09.887576+0000","scrub_duration":0.001779709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'728","reported_seq":769,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.949340+0000","last_change":"2023-12-16T01:54:04.949379+0000","last_active":"2023-12-16T01:54:04.949340+0000","last_peered":"2023-12-16T01:54:04.949340+0000","last_clean":"2023-12-16T01:54:04.949340+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:54:04.949340+0000","last_undegraded":"2023-12-16T01:54:04.949340+0000","last_fullsized":"2023-12-16T01:54:04.949340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'728","last_scrub_stamp":"2023-12-16T01:54:04.949267+0000","last_deep_scrub":"28'728","last_deep_scrub_stamp":"2023-12-16T01:54:04.949267+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.949267+0000","objects_scrubbed":1,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:33.947014+0000","scrub_duration":0.011806354999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.140515+0000","last_change":"2023-12-16T01:53:48.140533+0000","last_active":"2023-12-16T01:53:48.140515+0000","last_peered":"2023-12-16T01:53:48.140515+0000","last_clean":"2023-12-16T01:53:48.140515+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:48.140515+0000","last_undegraded":"2023-12-16T01:53:48.140515+0000","last_fullsized":"2023-12-16T01:53:48.140515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.140450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:41.931150+0000","scrub_duration":0.0013849089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.587783+0000","last_change":"2023-12-16T01:54:04.587804+0000","last_active":"2023-12-16T01:54:04.587783+0000","last_peered":"2023-12-16T01:54:04.587783+0000","last_clean":"2023-12-16T01:54:04.587783+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:54:04.587783+0000","last_undegraded":"2023-12-16T01:54:04.587783+0000","last_fullsized":"2023-12-16T01:54:04.587783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'129","last_scrub_stamp":"2023-12-16T01:54:04.587715+0000","last_deep_scrub":"28'129","last_deep_scrub_stamp":"2023-12-16T01:54:04.587715+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.587715+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:13:07.957493+0000","scrub_duration":0.0016608619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1397","reported_seq":1435,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.109371+0000","last_change":"2023-12-16T01:53:59.109396+0000","last_active":"2023-12-16T01:53:59.109371+0000","last_peered":"2023-12-16T01:53:59.109371+0000","last_clean":"2023-12-16T01:53:59.109371+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:59.109371+0000","last_undegraded":"2023-12-16T01:53:59.109371+0000","last_fullsized":"2023-12-16T01:53:59.109371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1397","last_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_deep_scrub":"28'1397","last_deep_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.109317+0000","objects_scrubbed":3,"log_size":1397,"log_dups_size":0,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:26.537787+0000","scrub_duration":0.0258877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.858232+0000","last_change":"2023-12-16T01:53:51.858251+0000","last_active":"2023-12-16T01:53:51.858232+0000","last_peered":"2023-12-16T01:53:51.858232+0000","last_clean":"2023-12-16T01:53:51.858232+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:51.858232+0000","last_undegraded":"2023-12-16T01:53:51.858232+0000","last_fullsized":"2023-12-16T01:53:51.858232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.858159+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:58:51.979244+0000","scrub_duration":0.00087977699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.651479+0000","last_change":"2023-12-16T01:54:20.651501+0000","last_active":"2023-12-16T01:54:20.651479+0000","last_peered":"2023-12-16T01:54:20.651479+0000","last_clean":"2023-12-16T01:54:20.651479+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:54:20.651479+0000","last_undegraded":"2023-12-16T01:54:20.651479+0000","last_fullsized":"2023-12-16T01:54:20.651479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:20.651399+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:20.651399+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.651399+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:26.060571+0000","scrub_duration":0.001840382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.083732+0000","last_change":"2023-12-16T01:54:08.083754+0000","last_active":"2023-12-16T01:54:08.083732+0000","last_peered":"2023-12-16T01:54:08.083732+0000","last_clean":"2023-12-16T01:54:08.083732+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:54:08.083732+0000","last_undegraded":"2023-12-16T01:54:08.083732+0000","last_fullsized":"2023-12-16T01:54:08.083732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:54:08.083672+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:54:08.083672+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.083672+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:25.913138+0000","scrub_duration":0.0019540069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:33.003266+0000","last_change":"2023-12-16T01:26:31.582892+0000","last_active":"2023-12-16T01:53:33.003266+0000","last_peered":"2023-12-16T01:53:33.003266+0000","last_clean":"2023-12-16T01:53:33.003266+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:53:33.003266+0000","last_undegraded":"2023-12-16T01:53:33.003266+0000","last_fullsized":"2023-12-16T01:53:33.003266+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:47.706092+0000","last_clean_scrub_stamp":"2023-12-16T01:25:47.706092+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":157,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.661739+0000","last_change":"2023-12-16T01:54:13.661759+0000","last_active":"2023-12-16T01:54:13.661739+0000","last_peered":"2023-12-16T01:54:13.661739+0000","last_clean":"2023-12-16T01:54:13.661739+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:54:13.661739+0000","last_undegraded":"2023-12-16T01:54:13.661739+0000","last_fullsized":"2023-12-16T01:54:13.661739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'122","last_scrub_stamp":"2023-12-16T01:54:13.661672+0000","last_deep_scrub":"28'122","last_deep_scrub_stamp":"2023-12-16T01:54:13.661672+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.661672+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:35.068765+0000","scrub_duration":0.0017602150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:43.196727+0000","last_change":"2023-12-16T01:54:43.196747+0000","last_active":"2023-12-16T01:54:43.196727+0000","last_peered":"2023-12-16T01:54:43.196727+0000","last_clean":"2023-12-16T01:54:43.196727+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:54:43.196727+0000","last_undegraded":"2023-12-16T01:54:43.196727+0000","last_fullsized":"2023-12-16T01:54:43.196727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:43.196659+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:43.196659+0000","last_clean_scrub_stamp":"2023-12-16T01:54:43.196659+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:08:23.770704+0000","scrub_duration":0.001123977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'639","reported_seq":678,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.231826+0000","last_change":"2023-12-16T01:54:26.231867+0000","last_active":"2023-12-16T01:54:26.231826+0000","last_peered":"2023-12-16T01:54:26.231826+0000","last_clean":"2023-12-16T01:54:26.231826+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:54:26.231826+0000","last_undegraded":"2023-12-16T01:54:26.231826+0000","last_fullsized":"2023-12-16T01:54:26.231826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'639","last_scrub_stamp":"2023-12-16T01:54:26.231737+0000","last_deep_scrub":"28'639","last_deep_scrub_stamp":"2023-12-16T01:54:26.231737+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.231737+0000","objects_scrubbed":2,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:39:24.800131+0000","scrub_duration":0.018664725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":139,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:05.503440+0000","last_change":"2023-12-16T01:25:54.987114+0000","last_active":"2023-12-16T01:53:05.503440+0000","last_peered":"2023-12-16T01:53:05.503440+0000","last_clean":"2023-12-16T01:53:05.503440+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:53:05.503440+0000","last_undegraded":"2023-12-16T01:53:05.503440+0000","last_fullsized":"2023-12-16T01:53:05.503440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.376779+0000","last_change":"2023-12-16T01:54:00.376828+0000","last_active":"2023-12-16T01:54:00.376779+0000","last_peered":"2023-12-16T01:54:00.376779+0000","last_clean":"2023-12-16T01:54:00.376779+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:54:00.376779+0000","last_undegraded":"2023-12-16T01:54:00.376779+0000","last_fullsized":"2023-12-16T01:54:00.376779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.376682+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:29.025843+0000","scrub_duration":0.0016058649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:07.165165+0000","last_change":"2023-12-16T01:54:07.165187+0000","last_active":"2023-12-16T01:54:07.165165+0000","last_peered":"2023-12-16T01:54:07.165165+0000","last_clean":"2023-12-16T01:54:07.165165+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:54:07.165165+0000","last_undegraded":"2023-12-16T01:54:07.165165+0000","last_fullsized":"2023-12-16T01:54:07.165165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:54:07.165084+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:54:07.165084+0000","last_clean_scrub_stamp":"2023-12-16T01:54:07.165084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:55:00.076716+0000","scrub_duration":0.0010529879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:35.141233+0000","last_change":"2023-12-16T01:54:35.141253+0000","last_active":"2023-12-16T01:54:35.141233+0000","last_peered":"2023-12-16T01:54:35.141233+0000","last_clean":"2023-12-16T01:54:35.141233+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:54:35.141233+0000","last_undegraded":"2023-12-16T01:54:35.141233+0000","last_fullsized":"2023-12-16T01:54:35.141233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'167","last_scrub_stamp":"2023-12-16T01:54:35.141165+0000","last_deep_scrub":"28'167","last_deep_scrub_stamp":"2023-12-16T01:54:35.141165+0000","last_clean_scrub_stamp":"2023-12-16T01:54:35.141165+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:22.807588+0000","scrub_duration":0.0015004790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.818668+0000","last_change":"2023-12-16T01:54:12.818687+0000","last_active":"2023-12-16T01:54:12.818668+0000","last_peered":"2023-12-16T01:54:12.818668+0000","last_clean":"2023-12-16T01:54:12.818668+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:54:12.818668+0000","last_undegraded":"2023-12-16T01:54:12.818668+0000","last_fullsized":"2023-12-16T01:54:12.818668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:12.818595+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:12.818595+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.818595+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:34.225689+0000","scrub_duration":0.00096157499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.669327+0000","last_change":"2023-12-16T01:53:54.669327+0000","last_active":"2023-12-16T01:53:54.669327+0000","last_peered":"2023-12-16T01:53:54.669327+0000","last_clean":"2023-12-16T01:53:54.669327+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:53:54.669327+0000","last_undegraded":"2023-12-16T01:53:54.669327+0000","last_fullsized":"2023-12-16T01:53:54.669327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.669197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.939886+0000","scrub_duration":0.0011923369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.485133+0000","last_change":"2023-12-16T01:54:13.485178+0000","last_active":"2023-12-16T01:54:13.485133+0000","last_peered":"2023-12-16T01:54:13.485133+0000","last_clean":"2023-12-16T01:54:13.485133+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:54:13.485133+0000","last_undegraded":"2023-12-16T01:54:13.485133+0000","last_fullsized":"2023-12-16T01:54:13.485133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:13.485033+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:13.485033+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.485033+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:32.554637+0000","scrub_duration":0.001406738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.122613+0000","last_change":"2023-12-16T01:53:59.122633+0000","last_active":"2023-12-16T01:53:59.122613+0000","last_peered":"2023-12-16T01:53:59.122613+0000","last_clean":"2023-12-16T01:53:59.122613+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:59.122613+0000","last_undegraded":"2023-12-16T01:53:59.122613+0000","last_fullsized":"2023-12-16T01:53:59.122613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.122554+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:09:35.015552+0000","scrub_duration":0.0010611500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.086079+0000","last_change":"2023-12-16T01:53:57.086079+0000","last_active":"2023-12-16T01:53:57.086079+0000","last_peered":"2023-12-16T01:53:57.086079+0000","last_clean":"2023-12-16T01:53:57.086079+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:57.086079+0000","last_undegraded":"2023-12-16T01:53:57.086079+0000","last_fullsized":"2023-12-16T01:53:57.086079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.085993+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:03.237603+0000","scrub_duration":0.0009980989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:24.750877+0000","last_change":"2023-12-16T01:54:24.750899+0000","last_active":"2023-12-16T01:54:24.750877+0000","last_peered":"2023-12-16T01:54:24.750877+0000","last_clean":"2023-12-16T01:54:24.750877+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:54:24.750877+0000","last_undegraded":"2023-12-16T01:54:24.750877+0000","last_fullsized":"2023-12-16T01:54:24.750877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'123","last_scrub_stamp":"2023-12-16T01:54:24.750798+0000","last_deep_scrub":"28'123","last_deep_scrub_stamp":"2023-12-16T01:54:24.750798+0000","last_clean_scrub_stamp":"2023-12-16T01:54:24.750798+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:42.994235+0000","scrub_duration":0.001693733,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.861610+0000","last_change":"2023-12-16T01:54:13.861630+0000","last_active":"2023-12-16T01:54:13.861610+0000","last_peered":"2023-12-16T01:54:13.861610+0000","last_clean":"2023-12-16T01:54:13.861610+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:54:13.861610+0000","last_undegraded":"2023-12-16T01:54:13.861610+0000","last_fullsized":"2023-12-16T01:54:13.861610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:54:13.861535+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:54:13.861535+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.861535+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:40.196046+0000","scrub_duration":0.00099201499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.221552+0000","last_change":"2023-12-16T01:54:23.221573+0000","last_active":"2023-12-16T01:54:23.221552+0000","last_peered":"2023-12-16T01:54:23.221552+0000","last_clean":"2023-12-16T01:54:23.221552+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:54:23.221552+0000","last_undegraded":"2023-12-16T01:54:23.221552+0000","last_fullsized":"2023-12-16T01:54:23.221552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-12-16T01:54:23.221494+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-12-16T01:54:23.221494+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.221494+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:27:27.499893+0000","scrub_duration":0.001892208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":188,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.682101+0000","last_change":"2023-12-16T01:54:11.682122+0000","last_active":"2023-12-16T01:54:11.682101+0000","last_peered":"2023-12-16T01:54:11.682101+0000","last_clean":"2023-12-16T01:54:11.682101+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:54:11.682101+0000","last_undegraded":"2023-12-16T01:54:11.682101+0000","last_fullsized":"2023-12-16T01:54:11.682101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'151","last_scrub_stamp":"2023-12-16T01:54:11.682026+0000","last_deep_scrub":"28'151","last_deep_scrub_stamp":"2023-12-16T01:54:11.682026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.682026+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:49.342638+0000","scrub_duration":0.0016144899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.947049+0000","last_change":"2023-12-16T01:54:20.947068+0000","last_active":"2023-12-16T01:54:20.947049+0000","last_peered":"2023-12-16T01:54:20.947049+0000","last_clean":"2023-12-16T01:54:20.947049+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:54:20.947049+0000","last_undegraded":"2023-12-16T01:54:20.947049+0000","last_fullsized":"2023-12-16T01:54:20.947049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:54:20.946986+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:54:20.946986+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.946986+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:22:09.368835+0000","scrub_duration":0.001206894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'311","reported_seq":352,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.757164+0000","last_change":"2023-12-16T01:54:08.757199+0000","last_active":"2023-12-16T01:54:08.757164+0000","last_peered":"2023-12-16T01:54:08.757164+0000","last_clean":"2023-12-16T01:54:08.757164+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:54:08.757164+0000","last_undegraded":"2023-12-16T01:54:08.757164+0000","last_fullsized":"2023-12-16T01:54:08.757164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'311","last_scrub_stamp":"2023-12-16T01:54:08.757077+0000","last_deep_scrub":"28'311","last_deep_scrub_stamp":"2023-12-16T01:54:08.757077+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.757077+0000","objects_scrubbed":1,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:56:34.272270+0000","scrub_duration":0.0033505319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:34.076229+0000","last_change":"2023-12-16T01:54:34.076264+0000","last_active":"2023-12-16T01:54:34.076229+0000","last_peered":"2023-12-16T01:54:34.076229+0000","last_clean":"2023-12-16T01:54:34.076229+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:54:34.076229+0000","last_undegraded":"2023-12-16T01:54:34.076229+0000","last_fullsized":"2023-12-16T01:54:34.076229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'134","last_scrub_stamp":"2023-12-16T01:54:34.076122+0000","last_deep_scrub":"28'134","last_deep_scrub_stamp":"2023-12-16T01:54:34.076122+0000","last_clean_scrub_stamp":"2023-12-16T01:54:34.076122+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:27.864086+0000","scrub_duration":0.0018790879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:28.101960+0000","last_change":"2023-12-16T01:54:28.101981+0000","last_active":"2023-12-16T01:54:28.101960+0000","last_peered":"2023-12-16T01:54:28.101960+0000","last_clean":"2023-12-16T01:54:28.101960+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:54:28.101960+0000","last_undegraded":"2023-12-16T01:54:28.101960+0000","last_fullsized":"2023-12-16T01:54:28.101960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:28.101888+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:28.101888+0000","last_clean_scrub_stamp":"2023-12-16T01:54:28.101888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:35.565175+0000","scrub_duration":0.00093575400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:17.149995+0000","last_change":"2023-12-16T01:54:17.150031+0000","last_active":"2023-12-16T01:54:17.149995+0000","last_peered":"2023-12-16T01:54:17.149995+0000","last_clean":"2023-12-16T01:54:17.149995+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:54:17.149995+0000","last_undegraded":"2023-12-16T01:54:17.149995+0000","last_fullsized":"2023-12-16T01:54:17.149995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:17.149917+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:17.149917+0000","last_clean_scrub_stamp":"2023-12-16T01:54:17.149917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:13.375365+0000","scrub_duration":0.0013443159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:31.118996+0000","last_change":"2023-12-16T01:54:31.119015+0000","last_active":"2023-12-16T01:54:31.118996+0000","last_peered":"2023-12-16T01:54:31.118996+0000","last_clean":"2023-12-16T01:54:31.118996+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:54:31.118996+0000","last_undegraded":"2023-12-16T01:54:31.118996+0000","last_fullsized":"2023-12-16T01:54:31.118996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:31.118937+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:31.118937+0000","last_clean_scrub_stamp":"2023-12-16T01:54:31.118937+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:49.362374+0000","scrub_duration":0.0016082830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.810864+0000","last_change":"2023-12-16T01:53:53.810913+0000","last_active":"2023-12-16T01:53:53.810864+0000","last_peered":"2023-12-16T01:53:53.810864+0000","last_clean":"2023-12-16T01:53:53.810864+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:53.810864+0000","last_undegraded":"2023-12-16T01:53:53.810864+0000","last_fullsized":"2023-12-16T01:53:53.810864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.810791+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:09.911252+0000","scrub_duration":0.001403133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.013004+0000","last_change":"2023-12-16T01:53:59.013024+0000","last_active":"2023-12-16T01:53:59.013004+0000","last_peered":"2023-12-16T01:53:59.013004+0000","last_clean":"2023-12-16T01:53:59.013004+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:59.013004+0000","last_undegraded":"2023-12-16T01:53:59.013004+0000","last_fullsized":"2023-12-16T01:53:59.013004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.012926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:06.476212+0000","scrub_duration":0.001035209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":228,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:30.105642+0000","last_change":"2023-12-16T01:54:30.105661+0000","last_active":"2023-12-16T01:54:30.105642+0000","last_peered":"2023-12-16T01:54:30.105642+0000","last_clean":"2023-12-16T01:54:30.105642+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:54:30.105642+0000","last_undegraded":"2023-12-16T01:54:30.105642+0000","last_fullsized":"2023-12-16T01:54:30.105642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2023-12-16T01:54:30.105568+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2023-12-16T01:54:30.105568+0000","last_clean_scrub_stamp":"2023-12-16T01:54:30.105568+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:47.935034+0000","scrub_duration":0.001555414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:28.061168+0000","last_change":"2023-12-16T01:54:28.061186+0000","last_active":"2023-12-16T01:54:28.061168+0000","last_peered":"2023-12-16T01:54:28.061168+0000","last_clean":"2023-12-16T01:54:28.061168+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:54:28.061168+0000","last_undegraded":"2023-12-16T01:54:28.061168+0000","last_fullsized":"2023-12-16T01:54:28.061168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:54:28.061099+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:54:28.061099+0000","last_clean_scrub_stamp":"2023-12-16T01:54:28.061099+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:23.756752+0000","scrub_duration":0.0010128380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:30.172015+0000","last_change":"2023-12-16T01:54:30.172034+0000","last_active":"2023-12-16T01:54:30.172015+0000","last_peered":"2023-12-16T01:54:30.172015+0000","last_clean":"2023-12-16T01:54:30.172015+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:54:30.172015+0000","last_undegraded":"2023-12-16T01:54:30.172015+0000","last_fullsized":"2023-12-16T01:54:30.172015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:30.171958+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:30.171958+0000","last_clean_scrub_stamp":"2023-12-16T01:54:30.171958+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:29:10.595758+0000","scrub_duration":0.0011299140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:36.098115+0000","last_change":"2023-12-16T01:54:36.098134+0000","last_active":"2023-12-16T01:54:36.098115+0000","last_peered":"2023-12-16T01:54:36.098115+0000","last_clean":"2023-12-16T01:54:36.098115+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:54:36.098115+0000","last_undegraded":"2023-12-16T01:54:36.098115+0000","last_fullsized":"2023-12-16T01:54:36.098115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'132","last_scrub_stamp":"2023-12-16T01:54:36.098053+0000","last_deep_scrub":"28'132","last_deep_scrub_stamp":"2023-12-16T01:54:36.098053+0000","last_clean_scrub_stamp":"2023-12-16T01:54:36.098053+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:58.147540+0000","scrub_duration":0.0014859949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.903310+0000","last_change":"2023-12-16T01:54:08.903330+0000","last_active":"2023-12-16T01:54:08.903310+0000","last_peered":"2023-12-16T01:54:08.903310+0000","last_clean":"2023-12-16T01:54:08.903310+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:54:08.903310+0000","last_undegraded":"2023-12-16T01:54:08.903310+0000","last_fullsized":"2023-12-16T01:54:08.903310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:08.903246+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:08.903246+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.903246+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:25.974236+0000","scrub_duration":0.00090658899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2056,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.230907+0000","last_change":"2023-12-16T01:53:49.230942+0000","last_active":"2023-12-16T01:53:49.230907+0000","last_peered":"2023-12-16T01:53:49.230907+0000","last_clean":"2023-12-16T01:53:49.230907+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:49.230907+0000","last_undegraded":"2023-12-16T01:53:49.230907+0000","last_fullsized":"2023-12-16T01:53:49.230907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1009","last_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_deep_scrub":"28'1009","last_deep_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.230821+0000","objects_scrubbed":1,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:23.521655+0000","scrub_duration":0.0014598370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:33.153327+0000","last_change":"2023-12-16T01:54:33.153348+0000","last_active":"2023-12-16T01:54:33.153327+0000","last_peered":"2023-12-16T01:54:33.153327+0000","last_clean":"2023-12-16T01:54:33.153327+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:54:33.153327+0000","last_undegraded":"2023-12-16T01:54:33.153327+0000","last_fullsized":"2023-12-16T01:54:33.153327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'147","last_scrub_stamp":"2023-12-16T01:54:33.153261+0000","last_deep_scrub":"28'147","last_deep_scrub_stamp":"2023-12-16T01:54:33.153261+0000","last_clean_scrub_stamp":"2023-12-16T01:54:33.153261+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:18.251469+0000","scrub_duration":0.001319122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.206569+0000","last_change":"2023-12-16T01:54:11.206591+0000","last_active":"2023-12-16T01:54:11.206569+0000","last_peered":"2023-12-16T01:54:11.206569+0000","last_clean":"2023-12-16T01:54:11.206569+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:54:11.206569+0000","last_undegraded":"2023-12-16T01:54:11.206569+0000","last_fullsized":"2023-12-16T01:54:11.206569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2023-12-16T01:54:11.206504+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2023-12-16T01:54:11.206504+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.206504+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:44.754134+0000","scrub_duration":0.0012846170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'556","reported_seq":597,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:25.216109+0000","last_change":"2023-12-16T01:54:25.216151+0000","last_active":"2023-12-16T01:54:25.216109+0000","last_peered":"2023-12-16T01:54:25.216109+0000","last_clean":"2023-12-16T01:54:25.216109+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:54:25.216109+0000","last_undegraded":"2023-12-16T01:54:25.216109+0000","last_fullsized":"2023-12-16T01:54:25.216109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'556","last_scrub_stamp":"2023-12-16T01:54:25.216045+0000","last_deep_scrub":"28'556","last_deep_scrub_stamp":"2023-12-16T01:54:25.216045+0000","last_clean_scrub_stamp":"2023-12-16T01:54:25.216045+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:06.713469+0000","scrub_duration":0.012453327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:38.185599+0000","last_change":"2023-12-16T01:54:38.185638+0000","last_active":"2023-12-16T01:54:38.185599+0000","last_peered":"2023-12-16T01:54:38.185599+0000","last_clean":"2023-12-16T01:54:38.185599+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:54:38.185599+0000","last_undegraded":"2023-12-16T01:54:38.185599+0000","last_fullsized":"2023-12-16T01:54:38.185599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:38.185527+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:38.185527+0000","last_clean_scrub_stamp":"2023-12-16T01:54:38.185527+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:39:36.753921+0000","scrub_duration":0.001295575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.859147+0000","last_change":"2023-12-16T01:54:16.859168+0000","last_active":"2023-12-16T01:54:16.859147+0000","last_peered":"2023-12-16T01:54:16.859147+0000","last_clean":"2023-12-16T01:54:16.859147+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:54:16.859147+0000","last_undegraded":"2023-12-16T01:54:16.859147+0000","last_fullsized":"2023-12-16T01:54:16.859147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:16.859078+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:16.859078+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.859078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:22.268251+0000","scrub_duration":0.0011505560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:18.119038+0000","last_change":"2023-12-16T01:54:18.119056+0000","last_active":"2023-12-16T01:54:18.119038+0000","last_peered":"2023-12-16T01:54:18.119038+0000","last_clean":"2023-12-16T01:54:18.119038+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:54:18.119038+0000","last_undegraded":"2023-12-16T01:54:18.119038+0000","last_fullsized":"2023-12-16T01:54:18.119038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2023-12-16T01:54:18.118973+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2023-12-16T01:54:18.118973+0000","last_clean_scrub_stamp":"2023-12-16T01:54:18.118973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:05.785396+0000","scrub_duration":0.001105857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:44.814945+0000","last_change":"2023-12-16T01:53:44.814970+0000","last_active":"2023-12-16T01:53:44.814945+0000","last_peered":"2023-12-16T01:53:44.814945+0000","last_clean":"2023-12-16T01:53:44.814945+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:53:44.814945+0000","last_undegraded":"2023-12-16T01:53:44.814945+0000","last_fullsized":"2023-12-16T01:53:44.814945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_clean_scrub_stamp":"2023-12-16T01:53:44.814880+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:43.334912+0000","scrub_duration":0.0039548450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:48.285960+0000","last_change":"2023-12-16T01:54:48.285982+0000","last_active":"2023-12-16T01:54:48.285960+0000","last_peered":"2023-12-16T01:54:48.285960+0000","last_clean":"2023-12-16T01:54:48.285960+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:54:48.285960+0000","last_undegraded":"2023-12-16T01:54:48.285960+0000","last_fullsized":"2023-12-16T01:54:48.285960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'153","last_scrub_stamp":"2023-12-16T01:54:48.285881+0000","last_deep_scrub":"28'153","last_deep_scrub_stamp":"2023-12-16T01:54:48.285881+0000","last_clean_scrub_stamp":"2023-12-16T01:54:48.285881+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:25.122602+0000","scrub_duration":0.00186315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.144912+0000","last_change":"2023-12-16T01:53:55.144935+0000","last_active":"2023-12-16T01:53:55.144912+0000","last_peered":"2023-12-16T01:53:55.144912+0000","last_clean":"2023-12-16T01:53:55.144912+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:55.144912+0000","last_undegraded":"2023-12-16T01:53:55.144912+0000","last_fullsized":"2023-12-16T01:53:55.144912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.144831+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:38.126196+0000","scrub_duration":0.001096376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.254172+0000","last_change":"2023-12-16T01:53:59.254191+0000","last_active":"2023-12-16T01:53:59.254172+0000","last_peered":"2023-12-16T01:53:59.254172+0000","last_clean":"2023-12-16T01:53:59.254172+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:59.254172+0000","last_undegraded":"2023-12-16T01:53:59.254172+0000","last_fullsized":"2023-12-16T01:53:59.254172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.254108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:27.903270+0000","scrub_duration":0.0011951380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.635697+0000","last_change":"2023-12-16T01:54:14.635718+0000","last_active":"2023-12-16T01:54:14.635697+0000","last_peered":"2023-12-16T01:54:14.635697+0000","last_clean":"2023-12-16T01:54:14.635697+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:54:14.635697+0000","last_undegraded":"2023-12-16T01:54:14.635697+0000","last_fullsized":"2023-12-16T01:54:14.635697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:14.635626+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:14.635626+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.635626+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:40.970137+0000","scrub_duration":0.0014828199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.116003+0000","last_change":"2023-12-16T01:54:23.116021+0000","last_active":"2023-12-16T01:54:23.116003+0000","last_peered":"2023-12-16T01:54:23.116003+0000","last_clean":"2023-12-16T01:54:23.116003+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:54:23.116003+0000","last_undegraded":"2023-12-16T01:54:23.116003+0000","last_fullsized":"2023-12-16T01:54:23.116003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'40","last_scrub_stamp":"2023-12-16T01:54:23.115940+0000","last_deep_scrub":"28'40","last_deep_scrub_stamp":"2023-12-16T01:54:23.115940+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.115940+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:16.903903+0000","scrub_duration":0.0015752660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.017317+0000","last_change":"2023-12-16T01:53:58.017355+0000","last_active":"2023-12-16T01:53:58.017317+0000","last_peered":"2023-12-16T01:53:58.017317+0000","last_clean":"2023-12-16T01:53:58.017317+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:58.017317+0000","last_undegraded":"2023-12-16T01:53:58.017317+0000","last_fullsized":"2023-12-16T01:53:58.017317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.017183+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:25.445654+0000","scrub_duration":0.0031128100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:31.097154+0000","last_change":"2023-12-16T01:54:31.097173+0000","last_active":"2023-12-16T01:54:31.097154+0000","last_peered":"2023-12-16T01:54:31.097154+0000","last_clean":"2023-12-16T01:54:31.097154+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:54:31.097154+0000","last_undegraded":"2023-12-16T01:54:31.097154+0000","last_fullsized":"2023-12-16T01:54:31.097154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2023-12-16T01:54:31.097084+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2023-12-16T01:54:31.097084+0000","last_clean_scrub_stamp":"2023-12-16T01:54:31.097084+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:34.785799+0000","scrub_duration":0.00157708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.105095+0000","last_change":"2023-12-16T01:54:11.105131+0000","last_active":"2023-12-16T01:54:11.105095+0000","last_peered":"2023-12-16T01:54:11.105095+0000","last_clean":"2023-12-16T01:54:11.105095+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:54:11.105095+0000","last_undegraded":"2023-12-16T01:54:11.105095+0000","last_fullsized":"2023-12-16T01:54:11.105095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:11.105021+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:11.105021+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.105021+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:40.102768+0000","scrub_duration":0.001124416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.801680+0000","last_change":"2023-12-16T01:54:04.801704+0000","last_active":"2023-12-16T01:54:04.801680+0000","last_peered":"2023-12-16T01:54:04.801680+0000","last_clean":"2023-12-16T01:54:04.801680+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:54:04.801680+0000","last_undegraded":"2023-12-16T01:54:04.801680+0000","last_fullsized":"2023-12-16T01:54:04.801680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:04.801617+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:04.801617+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.801617+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:23.871220+0000","scrub_duration":0.0017376620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:45.225668+0000","last_change":"2023-12-16T01:54:45.225692+0000","last_active":"2023-12-16T01:54:45.225668+0000","last_peered":"2023-12-16T01:54:45.225668+0000","last_clean":"2023-12-16T01:54:45.225668+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:54:45.225668+0000","last_undegraded":"2023-12-16T01:54:45.225668+0000","last_fullsized":"2023-12-16T01:54:45.225668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'133","last_scrub_stamp":"2023-12-16T01:54:45.225583+0000","last_deep_scrub":"28'133","last_deep_scrub_stamp":"2023-12-16T01:54:45.225583+0000","last_clean_scrub_stamp":"2023-12-16T01:54:45.225583+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:03:45.336405+0000","scrub_duration":0.0022368370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.720677+0000","last_change":"2023-12-16T01:53:56.720697+0000","last_active":"2023-12-16T01:53:56.720677+0000","last_peered":"2023-12-16T01:53:56.720677+0000","last_clean":"2023-12-16T01:53:56.720677+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:56.720677+0000","last_undegraded":"2023-12-16T01:53:56.720677+0000","last_fullsized":"2023-12-16T01:53:56.720677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.720597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:33.671876+0000","scrub_duration":0.0010248239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'3","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.064394+0000","last_change":"2023-12-16T01:53:56.064453+0000","last_active":"2023-12-16T01:53:56.064394+0000","last_peered":"2023-12-16T01:53:56.064394+0000","last_clean":"2023-12-16T01:53:56.064394+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:53:56.064394+0000","last_undegraded":"2023-12-16T01:53:56.064394+0000","last_fullsized":"2023-12-16T01:53:56.064394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.064317+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:54.927425+0000","scrub_duration":0.0028072420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.827344+0000","last_change":"2023-12-16T01:54:03.827344+0000","last_active":"2023-12-16T01:54:03.827344+0000","last_peered":"2023-12-16T01:54:03.827344+0000","last_clean":"2023-12-16T01:54:03.827344+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:54:03.827344+0000","last_undegraded":"2023-12-16T01:54:03.827344+0000","last_fullsized":"2023-12-16T01:54:03.827344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.827247+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:04.241218+0000","scrub_duration":0.001453356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.124361+0000","last_change":"2023-12-16T01:53:54.124381+0000","last_active":"2023-12-16T01:53:54.124361+0000","last_peered":"2023-12-16T01:53:54.124361+0000","last_clean":"2023-12-16T01:53:54.124361+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:54.124361+0000","last_undegraded":"2023-12-16T01:53:54.124361+0000","last_fullsized":"2023-12-16T01:53:54.124361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.124293+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:11.195283+0000","scrub_duration":0.00092168199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.759978+0000","last_change":"2023-12-16T01:53:57.760032+0000","last_active":"2023-12-16T01:53:57.759978+0000","last_peered":"2023-12-16T01:53:57.759978+0000","last_clean":"2023-12-16T01:53:57.759978+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:53:57.759978+0000","last_undegraded":"2023-12-16T01:53:57.759978+0000","last_fullsized":"2023-12-16T01:53:57.759978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.759893+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:51.550594+0000","scrub_duration":0.0035525439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:34.115686+0000","last_change":"2023-12-16T01:54:34.115717+0000","last_active":"2023-12-16T01:54:34.115686+0000","last_peered":"2023-12-16T01:54:34.115686+0000","last_clean":"2023-12-16T01:54:34.115686+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:54:34.115686+0000","last_undegraded":"2023-12-16T01:54:34.115686+0000","last_fullsized":"2023-12-16T01:54:34.115686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'142","last_scrub_stamp":"2023-12-16T01:54:34.115621+0000","last_deep_scrub":"28'142","last_deep_scrub_stamp":"2023-12-16T01:54:34.115621+0000","last_clean_scrub_stamp":"2023-12-16T01:54:34.115621+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:27:38.394019+0000","scrub_duration":0.0016162559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.762139+0000","last_change":"2023-12-16T01:53:46.762139+0000","last_active":"2023-12-16T01:53:46.762139+0000","last_peered":"2023-12-16T01:53:46.762139+0000","last_clean":"2023-12-16T01:53:46.762139+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:46.762139+0000","last_undegraded":"2023-12-16T01:53:46.762139+0000","last_fullsized":"2023-12-16T01:53:46.762139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_clean_scrub_stamp":"2023-12-16T01:53:46.762050+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:14:34.070815+0000","scrub_duration":0.00115817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.074927+0000","last_change":"2023-12-16T01:54:00.074946+0000","last_active":"2023-12-16T01:54:00.074927+0000","last_peered":"2023-12-16T01:54:00.074927+0000","last_clean":"2023-12-16T01:54:00.074927+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:54:00.074927+0000","last_undegraded":"2023-12-16T01:54:00.074927+0000","last_fullsized":"2023-12-16T01:54:00.074927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.074849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:07.538136+0000","scrub_duration":0.0010289749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":175,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:36.198846+0000","last_change":"2023-12-16T01:54:36.198866+0000","last_active":"2023-12-16T01:54:36.198846+0000","last_peered":"2023-12-16T01:54:36.198846+0000","last_clean":"2023-12-16T01:54:36.198846+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:54:36.198846+0000","last_undegraded":"2023-12-16T01:54:36.198846+0000","last_fullsized":"2023-12-16T01:54:36.198846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'140","last_scrub_stamp":"2023-12-16T01:54:36.198782+0000","last_deep_scrub":"28'140","last_deep_scrub_stamp":"2023-12-16T01:54:36.198782+0000","last_clean_scrub_stamp":"2023-12-16T01:54:36.198782+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:17.696206+0000","scrub_duration":0.0014315980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.113069+0000","last_change":"2023-12-16T01:54:08.113087+0000","last_active":"2023-12-16T01:54:08.113069+0000","last_peered":"2023-12-16T01:54:08.113069+0000","last_clean":"2023-12-16T01:54:08.113069+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:54:08.113069+0000","last_undegraded":"2023-12-16T01:54:08.113069+0000","last_fullsized":"2023-12-16T01:54:08.113069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:54:08.113001+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:54:08.113001+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.113001+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:45.839952+0000","scrub_duration":0.00083020499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.216961+0000","last_change":"2023-12-16T01:54:14.216995+0000","last_active":"2023-12-16T01:54:14.216961+0000","last_peered":"2023-12-16T01:54:14.216961+0000","last_clean":"2023-12-16T01:54:14.216961+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:54:14.216961+0000","last_undegraded":"2023-12-16T01:54:14.216961+0000","last_fullsized":"2023-12-16T01:54:14.216961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:54:14.216870+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:54:14.216870+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.216870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:09.912524+0000","scrub_duration":0.00133464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":156,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:38.139806+0000","last_change":"2023-12-16T01:54:38.139827+0000","last_active":"2023-12-16T01:54:38.139806+0000","last_peered":"2023-12-16T01:54:38.139806+0000","last_clean":"2023-12-16T01:54:38.139806+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:54:38.139806+0000","last_undegraded":"2023-12-16T01:54:38.139806+0000","last_fullsized":"2023-12-16T01:54:38.139806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'120","last_scrub_stamp":"2023-12-16T01:54:38.139727+0000","last_deep_scrub":"28'120","last_deep_scrub_stamp":"2023-12-16T01:54:38.139727+0000","last_clean_scrub_stamp":"2023-12-16T01:54:38.139727+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:36.230355+0000","scrub_duration":0.001376078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:10.184221+0000","last_change":"2023-12-16T01:54:10.184243+0000","last_active":"2023-12-16T01:54:10.184221+0000","last_peered":"2023-12-16T01:54:10.184221+0000","last_clean":"2023-12-16T01:54:10.184221+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:54:10.184221+0000","last_undegraded":"2023-12-16T01:54:10.184221+0000","last_fullsized":"2023-12-16T01:54:10.184221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:10.184147+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:10.184147+0000","last_clean_scrub_stamp":"2023-12-16T01:54:10.184147+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.454836+0000","scrub_duration":0.0012486699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'305","reported_seq":345,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.287784+0000","last_change":"2023-12-16T01:53:54.287821+0000","last_active":"2023-12-16T01:53:54.287784+0000","last_peered":"2023-12-16T01:53:54.287784+0000","last_clean":"2023-12-16T01:53:54.287784+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:54.287784+0000","last_undegraded":"2023-12-16T01:53:54.287784+0000","last_fullsized":"2023-12-16T01:53:54.287784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'305","last_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_deep_scrub":"28'305","last_deep_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.287730+0000","objects_scrubbed":3,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:54.985981+0000","scrub_duration":0.0098894640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:04.551382+0000","last_change":"2023-12-16T01:25:54.991162+0000","last_active":"2023-12-16T01:53:04.551382+0000","last_peered":"2023-12-16T01:53:04.551382+0000","last_clean":"2023-12-16T01:53:04.551382+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:53:04.551382+0000","last_undegraded":"2023-12-16T01:53:04.551382+0000","last_fullsized":"2023-12-16T01:53:04.551382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:25:53.736718+0000","last_clean_scrub_stamp":"2023-12-16T01:25:53.736718+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.122671+0000","last_change":"2023-12-16T01:53:53.122671+0000","last_active":"2023-12-16T01:53:53.122671+0000","last_peered":"2023-12-16T01:53:53.122671+0000","last_clean":"2023-12-16T01:53:53.122671+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:53.122671+0000","last_undegraded":"2023-12-16T01:53:53.122671+0000","last_fullsized":"2023-12-16T01:53:53.122671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.122566+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:09.183578+0000","scrub_duration":0.0013206579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'862","reported_seq":902,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.890311+0000","last_change":"2023-12-16T01:53:48.890311+0000","last_active":"2023-12-16T01:53:48.890311+0000","last_peered":"2023-12-16T01:53:48.890311+0000","last_clean":"2023-12-16T01:53:48.890311+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:48.890311+0000","last_undegraded":"2023-12-16T01:53:48.890311+0000","last_fullsized":"2023-12-16T01:53:48.890311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'862","last_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_deep_scrub":"28'862","last_deep_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.890224+0000","objects_scrubbed":4,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:27.964886+0000","scrub_duration":0.017688373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:33.041556+0000","last_change":"2023-12-16T01:54:33.041604+0000","last_active":"2023-12-16T01:54:33.041556+0000","last_peered":"2023-12-16T01:54:33.041556+0000","last_clean":"2023-12-16T01:54:33.041556+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:54:33.041556+0000","last_undegraded":"2023-12-16T01:54:33.041556+0000","last_fullsized":"2023-12-16T01:54:33.041556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:33.041464+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:33.041464+0000","last_clean_scrub_stamp":"2023-12-16T01:54:33.041464+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:25:04.679721+0000","scrub_duration":0.0019089549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.035555+0000","last_change":"2023-12-16T01:53:50.035555+0000","last_active":"2023-12-16T01:53:50.035555+0000","last_peered":"2023-12-16T01:53:50.035555+0000","last_clean":"2023-12-16T01:53:50.035555+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:50.035555+0000","last_undegraded":"2023-12-16T01:53:50.035555+0000","last_fullsized":"2023-12-16T01:53:50.035555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.035441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:24:50.625126+0000","scrub_duration":0.000932255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'733","reported_seq":773,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.268530+0000","last_change":"2023-12-16T01:53:55.268530+0000","last_active":"2023-12-16T01:53:55.268530+0000","last_peered":"2023-12-16T01:53:55.268530+0000","last_clean":"2023-12-16T01:53:55.268530+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:55.268530+0000","last_undegraded":"2023-12-16T01:53:55.268530+0000","last_fullsized":"2023-12-16T01:53:55.268530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'733","last_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_deep_scrub":"28'733","last_deep_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.268403+0000","objects_scrubbed":2,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:47.666935+0000","scrub_duration":0.0025599799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.731713+0000","last_change":"2023-12-16T01:54:23.731732+0000","last_active":"2023-12-16T01:54:23.731713+0000","last_peered":"2023-12-16T01:54:23.731713+0000","last_clean":"2023-12-16T01:54:23.731713+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:54:23.731713+0000","last_undegraded":"2023-12-16T01:54:23.731713+0000","last_fullsized":"2023-12-16T01:54:23.731713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'148","last_scrub_stamp":"2023-12-16T01:54:23.731645+0000","last_deep_scrub":"28'148","last_deep_scrub_stamp":"2023-12-16T01:54:23.731645+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.731645+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:22:12.153494+0000","scrub_duration":0.0015408500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.036067+0000","last_change":"2023-12-16T01:54:14.036119+0000","last_active":"2023-12-16T01:54:14.036067+0000","last_peered":"2023-12-16T01:54:14.036067+0000","last_clean":"2023-12-16T01:54:14.036067+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:54:14.036067+0000","last_undegraded":"2023-12-16T01:54:14.036067+0000","last_fullsized":"2023-12-16T01:54:14.036067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:14.035948+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:14.035948+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.035948+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:51.762899+0000","scrub_duration":0.0012783219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.107532+0000","last_change":"2023-12-16T01:53:54.107532+0000","last_active":"2023-12-16T01:53:54.107532+0000","last_peered":"2023-12-16T01:53:54.107532+0000","last_clean":"2023-12-16T01:53:54.107532+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:54.107532+0000","last_undegraded":"2023-12-16T01:53:54.107532+0000","last_fullsized":"2023-12-16T01:53:54.107532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.107444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:13.177048+0000","scrub_duration":0.0010581900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.351537+0000","last_change":"2023-12-16T01:54:02.351560+0000","last_active":"2023-12-16T01:54:02.351537+0000","last_peered":"2023-12-16T01:54:02.351537+0000","last_clean":"2023-12-16T01:54:02.351537+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:54:02.351537+0000","last_undegraded":"2023-12-16T01:54:02.351537+0000","last_fullsized":"2023-12-16T01:54:02.351537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.351459+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:39.889377+0000","scrub_duration":0.0017115850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.737430+0000","last_change":"2023-12-16T01:54:00.737430+0000","last_active":"2023-12-16T01:54:00.737430+0000","last_peered":"2023-12-16T01:54:00.737430+0000","last_clean":"2023-12-16T01:54:00.737430+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:54:00.737430+0000","last_undegraded":"2023-12-16T01:54:00.737430+0000","last_fullsized":"2023-12-16T01:54:00.737430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.737350+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:56.008039+0000","scrub_duration":0.000879626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.810944+0000","last_change":"2023-12-16T01:53:45.810944+0000","last_active":"2023-12-16T01:53:45.810944+0000","last_peered":"2023-12-16T01:53:45.810944+0000","last_clean":"2023-12-16T01:53:45.810944+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:45.810944+0000","last_undegraded":"2023-12-16T01:53:45.810944+0000","last_fullsized":"2023-12-16T01:53:45.810944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_clean_scrub_stamp":"2023-12-16T01:53:45.810796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:43:50.027324+0000","scrub_duration":0.0012633939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":198,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:35.085529+0000","last_change":"2023-12-16T01:54:35.085567+0000","last_active":"2023-12-16T01:54:35.085529+0000","last_peered":"2023-12-16T01:54:35.085529+0000","last_clean":"2023-12-16T01:54:35.085529+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:54:35.085529+0000","last_undegraded":"2023-12-16T01:54:35.085529+0000","last_fullsized":"2023-12-16T01:54:35.085529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'162","last_scrub_stamp":"2023-12-16T01:54:35.085450+0000","last_deep_scrub":"28'162","last_deep_scrub_stamp":"2023-12-16T01:54:35.085450+0000","last_clean_scrub_stamp":"2023-12-16T01:54:35.085450+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:30:32.243191+0000","scrub_duration":0.0015581519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":175,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:29.005815+0000","last_change":"2023-12-16T01:54:29.005838+0000","last_active":"2023-12-16T01:54:29.005815+0000","last_peered":"2023-12-16T01:54:29.005815+0000","last_clean":"2023-12-16T01:54:29.005815+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:54:29.005815+0000","last_undegraded":"2023-12-16T01:54:29.005815+0000","last_fullsized":"2023-12-16T01:54:29.005815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'137","last_scrub_stamp":"2023-12-16T01:54:29.005727+0000","last_deep_scrub":"28'137","last_deep_scrub_stamp":"2023-12-16T01:54:29.005727+0000","last_clean_scrub_stamp":"2023-12-16T01:54:29.005727+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:27.096355+0000","scrub_duration":0.0015835980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.939220+0000","last_change":"2023-12-16T01:54:23.939220+0000","last_active":"2023-12-16T01:54:23.939220+0000","last_peered":"2023-12-16T01:54:23.939220+0000","last_clean":"2023-12-16T01:54:23.939220+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:54:23.939220+0000","last_undegraded":"2023-12-16T01:54:23.939220+0000","last_fullsized":"2023-12-16T01:54:23.939220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:23.939133+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:23.939133+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.939133+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:09.037341+0000","scrub_duration":0.0012202879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.186390+0000","last_change":"2023-12-16T01:54:16.186390+0000","last_active":"2023-12-16T01:54:16.186390+0000","last_peered":"2023-12-16T01:54:16.186390+0000","last_clean":"2023-12-16T01:54:16.186390+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:54:16.186390+0000","last_undegraded":"2023-12-16T01:54:16.186390+0000","last_fullsized":"2023-12-16T01:54:16.186390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:54:16.186244+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:54:16.186244+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.186244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:30.603337+0000","scrub_duration":0.0012334049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:36.179471+0000","last_change":"2023-12-16T01:54:36.179495+0000","last_active":"2023-12-16T01:54:36.179471+0000","last_peered":"2023-12-16T01:54:36.179471+0000","last_clean":"2023-12-16T01:54:36.179471+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:54:36.179471+0000","last_undegraded":"2023-12-16T01:54:36.179471+0000","last_fullsized":"2023-12-16T01:54:36.179471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'153","last_scrub_stamp":"2023-12-16T01:54:36.179397+0000","last_deep_scrub":"28'153","last_deep_scrub_stamp":"2023-12-16T01:54:36.179397+0000","last_clean_scrub_stamp":"2023-12-16T01:54:36.179397+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:03:29.254993+0000","scrub_duration":0.001440057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.030017+0000","last_change":"2023-12-16T01:53:54.030017+0000","last_active":"2023-12-16T01:53:54.030017+0000","last_peered":"2023-12-16T01:53:54.030017+0000","last_clean":"2023-12-16T01:53:54.030017+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:54.030017+0000","last_undegraded":"2023-12-16T01:53:54.030017+0000","last_fullsized":"2023-12-16T01:53:54.030017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.029929+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:00.181539+0000","scrub_duration":0.0010094170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.153531+0000","last_change":"2023-12-16T01:53:56.153566+0000","last_active":"2023-12-16T01:53:56.153531+0000","last_peered":"2023-12-16T01:53:56.153531+0000","last_clean":"2023-12-16T01:53:56.153531+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:56.153531+0000","last_undegraded":"2023-12-16T01:53:56.153531+0000","last_fullsized":"2023-12-16T01:53:56.153531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.153447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:39.166123+0000","scrub_duration":0.0013686760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'707","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:27.187301+0000","last_change":"2023-12-16T01:54:27.187324+0000","last_active":"2023-12-16T01:54:27.187301+0000","last_peered":"2023-12-16T01:54:27.187301+0000","last_clean":"2023-12-16T01:54:27.187301+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:54:27.187301+0000","last_undegraded":"2023-12-16T01:54:27.187301+0000","last_fullsized":"2023-12-16T01:54:27.187301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'707","last_scrub_stamp":"2023-12-16T01:54:27.187241+0000","last_deep_scrub":"28'707","last_deep_scrub_stamp":"2023-12-16T01:54:27.187241+0000","last_clean_scrub_stamp":"2023-12-16T01:54:27.187241+0000","objects_scrubbed":1,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:47.914075+0000","scrub_duration":0.016851775999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:21.905334+0000","last_change":"2023-12-16T01:54:21.905369+0000","last_active":"2023-12-16T01:54:21.905334+0000","last_peered":"2023-12-16T01:54:21.905334+0000","last_clean":"2023-12-16T01:54:21.905334+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:54:21.905334+0000","last_undegraded":"2023-12-16T01:54:21.905334+0000","last_fullsized":"2023-12-16T01:54:21.905334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:21.905235+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:21.905235+0000","last_clean_scrub_stamp":"2023-12-16T01:54:21.905235+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:40.148671+0000","scrub_duration":0.001311701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.014874+0000","last_change":"2023-12-16T01:54:26.014895+0000","last_active":"2023-12-16T01:54:26.014874+0000","last_peered":"2023-12-16T01:54:26.014874+0000","last_clean":"2023-12-16T01:54:26.014874+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:54:26.014874+0000","last_undegraded":"2023-12-16T01:54:26.014874+0000","last_fullsized":"2023-12-16T01:54:26.014874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-12-16T01:54:26.014808+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-12-16T01:54:26.014808+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.014808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:48.064294+0000","scrub_duration":0.0014740300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'708","reported_seq":746,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.044464+0000","last_change":"2023-12-16T01:54:00.044489+0000","last_active":"2023-12-16T01:54:00.044464+0000","last_peered":"2023-12-16T01:54:00.044464+0000","last_clean":"2023-12-16T01:54:00.044464+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:54:00.044464+0000","last_undegraded":"2023-12-16T01:54:00.044464+0000","last_fullsized":"2023-12-16T01:54:00.044464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'708","last_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_deep_scrub":"28'708","last_deep_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.044392+0000","objects_scrubbed":1,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:00.634076+0000","scrub_duration":0.015574605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.819424+0000","last_change":"2023-12-16T01:53:50.819445+0000","last_active":"2023-12-16T01:53:50.819424+0000","last_peered":"2023-12-16T01:53:50.819424+0000","last_clean":"2023-12-16T01:53:50.819424+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:50.819424+0000","last_undegraded":"2023-12-16T01:53:50.819424+0000","last_fullsized":"2023-12-16T01:53:50.819424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'31","last_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_deep_scrub":"28'31","last_deep_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.819349+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:25.110184+0000","scrub_duration":0.0014030030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:10.424844+0000","last_change":"2023-12-16T01:54:10.424867+0000","last_active":"2023-12-16T01:54:10.424844+0000","last_peered":"2023-12-16T01:54:10.424844+0000","last_clean":"2023-12-16T01:54:10.424844+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:54:10.424844+0000","last_undegraded":"2023-12-16T01:54:10.424844+0000","last_fullsized":"2023-12-16T01:54:10.424844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'168","last_scrub_stamp":"2023-12-16T01:54:10.424760+0000","last_deep_scrub":"28'168","last_deep_scrub_stamp":"2023-12-16T01:54:10.424760+0000","last_clean_scrub_stamp":"2023-12-16T01:54:10.424760+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:30:04.215461+0000","scrub_duration":0.001768616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.853642+0000","last_change":"2023-12-16T01:53:49.853662+0000","last_active":"2023-12-16T01:53:49.853642+0000","last_peered":"2023-12-16T01:53:49.853642+0000","last_clean":"2023-12-16T01:53:49.853642+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:49.853642+0000","last_undegraded":"2023-12-16T01:53:49.853642+0000","last_fullsized":"2023-12-16T01:53:49.853642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.853560+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:47.856024+0000","scrub_duration":0.001387723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.335969+0000","last_change":"2023-12-16T01:53:58.335995+0000","last_active":"2023-12-16T01:53:58.335969+0000","last_peered":"2023-12-16T01:53:58.335969+0000","last_clean":"2023-12-16T01:53:58.335969+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:58.335969+0000","last_undegraded":"2023-12-16T01:53:58.335969+0000","last_fullsized":"2023-12-16T01:53:58.335969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'50","last_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_deep_scrub":"28'50","last_deep_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.335879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:56.338342+0000","scrub_duration":0.001381522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:35.178204+0000","last_change":"2023-12-16T01:54:35.178224+0000","last_active":"2023-12-16T01:54:35.178204+0000","last_peered":"2023-12-16T01:54:35.178204+0000","last_clean":"2023-12-16T01:54:35.178204+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:54:35.178204+0000","last_undegraded":"2023-12-16T01:54:35.178204+0000","last_fullsized":"2023-12-16T01:54:35.178204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:54:35.178135+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:54:35.178135+0000","last_clean_scrub_stamp":"2023-12-16T01:54:35.178135+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:28:58.084322+0000","scrub_duration":0.0011163779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.044332+0000","last_change":"2023-12-16T01:53:50.044369+0000","last_active":"2023-12-16T01:53:50.044332+0000","last_peered":"2023-12-16T01:53:50.044332+0000","last_clean":"2023-12-16T01:53:50.044332+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:50.044332+0000","last_undegraded":"2023-12-16T01:53:50.044332+0000","last_fullsized":"2023-12-16T01:53:50.044332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.044262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:27.808420+0000","scrub_duration":0.0011708160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:29.137632+0000","last_change":"2023-12-16T01:54:29.137668+0000","last_active":"2023-12-16T01:54:29.137632+0000","last_peered":"2023-12-16T01:54:29.137632+0000","last_clean":"2023-12-16T01:54:29.137632+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:54:29.137632+0000","last_undegraded":"2023-12-16T01:54:29.137632+0000","last_fullsized":"2023-12-16T01:54:29.137632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2023-12-16T01:54:29.137515+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2023-12-16T01:54:29.137515+0000","last_clean_scrub_stamp":"2023-12-16T01:54:29.137515+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:34.546688+0000","scrub_duration":0.001102684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:24.214245+0000","last_change":"2023-12-16T01:54:24.214266+0000","last_active":"2023-12-16T01:54:24.214245+0000","last_peered":"2023-12-16T01:54:24.214245+0000","last_clean":"2023-12-16T01:54:24.214245+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:54:24.214245+0000","last_undegraded":"2023-12-16T01:54:24.214245+0000","last_fullsized":"2023-12-16T01:54:24.214245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:24.214177+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:24.214177+0000","last_clean_scrub_stamp":"2023-12-16T01:54:24.214177+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:56:49.729370+0000","scrub_duration":0.0010708530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.620368+0000","last_change":"2023-12-16T01:54:03.620408+0000","last_active":"2023-12-16T01:54:03.620368+0000","last_peered":"2023-12-16T01:54:03.620368+0000","last_clean":"2023-12-16T01:54:03.620368+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:54:03.620368+0000","last_undegraded":"2023-12-16T01:54:03.620368+0000","last_fullsized":"2023-12-16T01:54:03.620368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.620291+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:41.384448+0000","scrub_duration":0.001035563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.046833+0000","last_change":"2023-12-16T01:54:16.046870+0000","last_active":"2023-12-16T01:54:16.046833+0000","last_peered":"2023-12-16T01:54:16.046833+0000","last_clean":"2023-12-16T01:54:16.046833+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:54:16.046833+0000","last_undegraded":"2023-12-16T01:54:16.046833+0000","last_fullsized":"2023-12-16T01:54:16.046833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:54:16.046718+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:54:16.046718+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.046718+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:46.227198+0000","scrub_duration":0.001640655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.162751+0000","last_change":"2023-12-16T01:54:12.162769+0000","last_active":"2023-12-16T01:54:12.162751+0000","last_peered":"2023-12-16T01:54:12.162751+0000","last_clean":"2023-12-16T01:54:12.162751+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:54:12.162751+0000","last_undegraded":"2023-12-16T01:54:12.162751+0000","last_fullsized":"2023-12-16T01:54:12.162751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:54:12.162688+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:54:12.162688+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.162688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:05.950652+0000","scrub_duration":0.0011708510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:09.935583+0000","last_change":"2023-12-16T01:54:09.935603+0000","last_active":"2023-12-16T01:54:09.935583+0000","last_peered":"2023-12-16T01:54:09.935583+0000","last_clean":"2023-12-16T01:54:09.935583+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:54:09.935583+0000","last_undegraded":"2023-12-16T01:54:09.935583+0000","last_fullsized":"2023-12-16T01:54:09.935583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2023-12-16T01:54:09.935514+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2023-12-16T01:54:09.935514+0000","last_clean_scrub_stamp":"2023-12-16T01:54:09.935514+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:04.544423+0000","scrub_duration":0.001116955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.710495+0000","last_change":"2023-12-16T01:53:59.710514+0000","last_active":"2023-12-16T01:53:59.710495+0000","last_peered":"2023-12-16T01:53:59.710495+0000","last_clean":"2023-12-16T01:53:59.710495+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:59.710495+0000","last_undegraded":"2023-12-16T01:53:59.710495+0000","last_fullsized":"2023-12-16T01:53:59.710495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.710431+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:52.108963+0000","scrub_duration":0.00086866999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":90,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.807870+0000","last_change":"2023-12-16T01:53:47.807889+0000","last_active":"2023-12-16T01:53:47.807870+0000","last_peered":"2023-12-16T01:53:47.807870+0000","last_clean":"2023-12-16T01:53:47.807870+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:47.807870+0000","last_undegraded":"2023-12-16T01:53:47.807870+0000","last_fullsized":"2023-12-16T01:53:47.807870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.807786+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:03.908247+0000","scrub_duration":0.0012442099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:27.061793+0000","last_change":"2023-12-16T01:54:27.061813+0000","last_active":"2023-12-16T01:54:27.061793+0000","last_peered":"2023-12-16T01:54:27.061793+0000","last_clean":"2023-12-16T01:54:27.061793+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:54:27.061793+0000","last_undegraded":"2023-12-16T01:54:27.061793+0000","last_fullsized":"2023-12-16T01:54:27.061793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:27.061721+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:27.061721+0000","last_clean_scrub_stamp":"2023-12-16T01:54:27.061721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:57.242202+0000","scrub_duration":0.0011862120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:32.179710+0000","last_change":"2023-12-16T01:54:32.179743+0000","last_active":"2023-12-16T01:54:32.179710+0000","last_peered":"2023-12-16T01:54:32.179710+0000","last_clean":"2023-12-16T01:54:32.179710+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:54:32.179710+0000","last_undegraded":"2023-12-16T01:54:32.179710+0000","last_fullsized":"2023-12-16T01:54:32.179710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:54:32.179619+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:54:32.179619+0000","last_clean_scrub_stamp":"2023-12-16T01:54:32.179619+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:29.923594+0000","scrub_duration":0.0012890499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.372063+0000","last_change":"2023-12-16T01:53:59.372084+0000","last_active":"2023-12-16T01:53:59.372063+0000","last_peered":"2023-12-16T01:53:59.372063+0000","last_clean":"2023-12-16T01:53:59.372063+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:59.372063+0000","last_undegraded":"2023-12-16T01:53:59.372063+0000","last_fullsized":"2023-12-16T01:53:59.372063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.371983+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:57:27.780046+0000","scrub_duration":0.0014106590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.101807+0000","last_change":"2023-12-16T01:53:53.101827+0000","last_active":"2023-12-16T01:53:53.101807+0000","last_peered":"2023-12-16T01:53:53.101807+0000","last_clean":"2023-12-16T01:53:53.101807+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:53.101807+0000","last_undegraded":"2023-12-16T01:53:53.101807+0000","last_fullsized":"2023-12-16T01:53:53.101807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.101731+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:41.523580+0000","scrub_duration":0.001408493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.189281+0000","last_change":"2023-12-16T01:54:13.189300+0000","last_active":"2023-12-16T01:54:13.189281+0000","last_peered":"2023-12-16T01:54:13.189281+0000","last_clean":"2023-12-16T01:54:13.189281+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:54:13.189281+0000","last_undegraded":"2023-12-16T01:54:13.189281+0000","last_fullsized":"2023-12-16T01:54:13.189281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2023-12-16T01:54:13.189209+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2023-12-16T01:54:13.189209+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.189209+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:43.369689+0000","scrub_duration":0.00095558600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.026555+0000","last_change":"2023-12-16T01:54:13.026575+0000","last_active":"2023-12-16T01:54:13.026555+0000","last_peered":"2023-12-16T01:54:13.026555+0000","last_clean":"2023-12-16T01:54:13.026555+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:54:13.026555+0000","last_undegraded":"2023-12-16T01:54:13.026555+0000","last_fullsized":"2023-12-16T01:54:13.026555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:54:13.026479+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:54:13.026479+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.026479+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:11.117107+0000","scrub_duration":0.0012824760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.183617+0000","last_change":"2023-12-16T01:54:26.183650+0000","last_active":"2023-12-16T01:54:26.183617+0000","last_peered":"2023-12-16T01:54:26.183617+0000","last_clean":"2023-12-16T01:54:26.183617+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:54:26.183617+0000","last_undegraded":"2023-12-16T01:54:26.183617+0000","last_fullsized":"2023-12-16T01:54:26.183617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:26.183523+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:26.183523+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.183523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:01:51.819803+0000","scrub_duration":0.00098922000000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.291254+0000","last_change":"2023-12-16T01:54:20.291254+0000","last_active":"2023-12-16T01:54:20.291254+0000","last_peered":"2023-12-16T01:54:20.291254+0000","last_clean":"2023-12-16T01:54:20.291254+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:54:20.291254+0000","last_undegraded":"2023-12-16T01:54:20.291254+0000","last_fullsized":"2023-12-16T01:54:20.291254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:20.291163+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:20.291163+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.291163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:39.360767+0000","scrub_duration":0.0011258080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:32.066037+0000","last_change":"2023-12-16T01:54:32.066037+0000","last_active":"2023-12-16T01:54:32.066037+0000","last_peered":"2023-12-16T01:54:32.066037+0000","last_clean":"2023-12-16T01:54:32.066037+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:54:32.066037+0000","last_undegraded":"2023-12-16T01:54:32.066037+0000","last_fullsized":"2023-12-16T01:54:32.066037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2023-12-16T01:54:32.065949+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2023-12-16T01:54:32.065949+0000","last_clean_scrub_stamp":"2023-12-16T01:54:32.065949+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:46.483042+0000","scrub_duration":0.0010981999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.064722+0000","last_change":"2023-12-16T01:54:12.064722+0000","last_active":"2023-12-16T01:54:12.064722+0000","last_peered":"2023-12-16T01:54:12.064722+0000","last_clean":"2023-12-16T01:54:12.064722+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:54:12.064722+0000","last_undegraded":"2023-12-16T01:54:12.064722+0000","last_fullsized":"2023-12-16T01:54:12.064722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:54:12.064634+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:54:12.064634+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.064634+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:57.162842+0000","scrub_duration":0.0009898629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.064525+0000","last_change":"2023-12-16T01:54:14.064525+0000","last_active":"2023-12-16T01:54:14.064525+0000","last_peered":"2023-12-16T01:54:14.064525+0000","last_clean":"2023-12-16T01:54:14.064525+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:54:14.064525+0000","last_undegraded":"2023-12-16T01:54:14.064525+0000","last_fullsized":"2023-12-16T01:54:14.064525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:54:14.064440+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:54:14.064440+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.064440+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:36.113927+0000","scrub_duration":0.00088475900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.781093+0000","last_change":"2023-12-16T01:54:02.781112+0000","last_active":"2023-12-16T01:54:02.781093+0000","last_peered":"2023-12-16T01:54:02.781093+0000","last_clean":"2023-12-16T01:54:02.781093+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:54:02.781093+0000","last_undegraded":"2023-12-16T01:54:02.781093+0000","last_fullsized":"2023-12-16T01:54:02.781093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.781026+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:00.783489+0000","scrub_duration":0.0010688659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:15.016584+0000","last_change":"2023-12-16T01:54:15.016622+0000","last_active":"2023-12-16T01:54:15.016584+0000","last_peered":"2023-12-16T01:54:15.016584+0000","last_clean":"2023-12-16T01:54:15.016584+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:54:15.016584+0000","last_undegraded":"2023-12-16T01:54:15.016584+0000","last_fullsized":"2023-12-16T01:54:15.016584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30","last_scrub_stamp":"2023-12-16T01:54:15.016472+0000","last_deep_scrub":"28'30","last_deep_scrub_stamp":"2023-12-16T01:54:15.016472+0000","last_clean_scrub_stamp":"2023-12-16T01:54:15.016472+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:08.804435+0000","scrub_duration":0.001432675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.076910+0000","last_change":"2023-12-16T01:54:20.076932+0000","last_active":"2023-12-16T01:54:20.076910+0000","last_peered":"2023-12-16T01:54:20.076910+0000","last_clean":"2023-12-16T01:54:20.076910+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:54:20.076910+0000","last_undegraded":"2023-12-16T01:54:20.076910+0000","last_fullsized":"2023-12-16T01:54:20.076910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:20.076831+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:20.076831+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.076831+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:37.396986+0000","scrub_duration":0.001131235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.646330+0000","last_change":"2023-12-16T01:54:02.646365+0000","last_active":"2023-12-16T01:54:02.646330+0000","last_peered":"2023-12-16T01:54:02.646330+0000","last_clean":"2023-12-16T01:54:02.646330+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:54:02.646330+0000","last_undegraded":"2023-12-16T01:54:02.646330+0000","last_fullsized":"2023-12-16T01:54:02.646330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.646262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:36.193892+0000","scrub_duration":0.0012008120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.063353+0000","last_change":"2023-12-16T01:53:50.063370+0000","last_active":"2023-12-16T01:53:50.063353+0000","last_peered":"2023-12-16T01:53:50.063353+0000","last_clean":"2023-12-16T01:53:50.063353+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:50.063353+0000","last_undegraded":"2023-12-16T01:53:50.063353+0000","last_fullsized":"2023-12-16T01:53:50.063353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.063280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:56:51.897233+0000","scrub_duration":0.0012023349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.792454+0000","last_change":"2023-12-16T01:53:51.792454+0000","last_active":"2023-12-16T01:53:51.792454+0000","last_peered":"2023-12-16T01:53:51.792454+0000","last_clean":"2023-12-16T01:53:51.792454+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:51.792454+0000","last_undegraded":"2023-12-16T01:53:51.792454+0000","last_fullsized":"2023-12-16T01:53:51.792454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.792374+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:52.206345+0000","scrub_duration":0.00118464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":82,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:52.065928+0000","last_change":"2023-12-16T01:53:52.065951+0000","last_active":"2023-12-16T01:53:52.065928+0000","last_peered":"2023-12-16T01:53:52.065928+0000","last_clean":"2023-12-16T01:53:52.065928+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:52.065928+0000","last_undegraded":"2023-12-16T01:53:52.065928+0000","last_fullsized":"2023-12-16T01:53:52.065928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_clean_scrub_stamp":"2023-12-16T01:53:52.065855+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:50.928964+0000","scrub_duration":0.0010821439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:21.079655+0000","last_change":"2023-12-16T01:54:21.079674+0000","last_active":"2023-12-16T01:54:21.079655+0000","last_peered":"2023-12-16T01:54:21.079655+0000","last_clean":"2023-12-16T01:54:21.079655+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:54:21.079655+0000","last_undegraded":"2023-12-16T01:54:21.079655+0000","last_fullsized":"2023-12-16T01:54:21.079655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:21.079593+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:21.079593+0000","last_clean_scrub_stamp":"2023-12-16T01:54:21.079593+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:35.496686+0000","scrub_duration":0.00089815900000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.103565+0000","last_change":"2023-12-16T01:53:47.103599+0000","last_active":"2023-12-16T01:53:47.103565+0000","last_peered":"2023-12-16T01:53:47.103565+0000","last_clean":"2023-12-16T01:53:47.103565+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:47.103565+0000","last_undegraded":"2023-12-16T01:53:47.103565+0000","last_fullsized":"2023-12-16T01:53:47.103565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.103490+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:40.015122+0000","scrub_duration":0.001277678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8679,"ondisk_log_size":8679,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542499,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.41799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.221},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.46400000000000002,"15min":0.442},"min":{"1min":0.40799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.39800000000000002,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.47799999999999998,"15min":0.45100000000000001},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61699999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.44,"15min":0.42099999999999999},"min":{"1min":0.39100000000000001,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.224},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69699999999999995},"last":0.501},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40500000000000003},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.254},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.434,"15min":0.432},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65100000000000002}]},{"osd":6,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.44500000000000001},"min":{"1min":0.33200000000000002,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542497,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.221,"15min":0.214},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.69399999999999995},"last":0.62},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.73999999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.25600000000000001},"max":{"1min":0.61799999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.42999999999999999},"min":{"1min":0.38800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.86599999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.66700000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.47499999999999998,"15min":0.441},"min":{"1min":0.34899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.46700000000000003,"15min":0.45000000000000001},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.92300000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.66100000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55300000000000005}]},{"osd":4,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.26900000000000002,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.66900000000000004,"5min":0.874,"15min":0.874},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.32000000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74399999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.39300000000000002},"min":{"1min":0.32600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.65800000000000003,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.437},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.42399999999999999}]},{"osd":7,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.45300000000000001},"min":{"1min":0.38700000000000001,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.68100000000000005,"5min":1.956,"15min":1.956},"last":0.44800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542498,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42099999999999999,"15min":0.40400000000000003},"min":{"1min":0.371,"5min":0.191,"15min":0.191},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66800000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.32600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60299999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.71099999999999997}]},{"osd":1,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.78700000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63700000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.59399999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.624}]},{"osd":3,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.71699999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.47599999999999998,"15min":0.46300000000000002},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.36199999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23100000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.67400000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.29199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.59499999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26300000000000001},"max":{"1min":0.53100000000000003,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.505},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.44800000000000001},"min":{"1min":0.33700000000000002,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.72699999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542499,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45500000000000002,"15min":0.434},"min":{"1min":0.376,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.623,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.35299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44,"15min":0.42099999999999999},"min":{"1min":0.36199999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.63600000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.38900000000000001,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66300000000000003},"last":0.45100000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.32300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.45300000000000001},"min":{"1min":0.39700000000000002,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.438,"15min":0.42699999999999999},"min":{"1min":0.374,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.44500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.40500000000000003,"15min":0.39700000000000002},"min":{"1min":0.251,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.28000000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.498}]},{"osd":7,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.72099999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.46200000000000002},"min":{"1min":0.32400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.51900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542498,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.28699999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.47399999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.215,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.434,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.496,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32800000000000001,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.218},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.52400000000000002},"last":0.40500000000000003}]},{"osd":2,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.45400000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.31},{"interface":"front","average":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35799999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.63400000000000001},"last":0.438}]},{"osd":4,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.46100000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.29799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.504}]},{"osd":5,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.45300000000000001},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48699999999999999,"15min":0.46400000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.77500000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.48899999999999999,"15min":0.47299999999999998},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.48099999999999998},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54300000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542498,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.29499999999999998},"min":{"1min":0.216,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.46200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.315,"15min":0.30499999999999999},"min":{"1min":0.216,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.54600000000000004},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.33000000000000002},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.504,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.435}]},{"osd":3,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.317},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22},"max":{"1min":0.495,"5min":0.495,"15min":0.52600000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.46600000000000003,"15min":0.443},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71399999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.443,"15min":0.435},"min":{"1min":0.35799999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.39100000000000001,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46800000000000003,"15min":0.45600000000000002},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.38200000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.497},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57199999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542498,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.29899999999999999},"min":{"1min":0.21099999999999999,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.438,"5min":0.50700000000000001,"15min":0.56999999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.308},"min":{"1min":0.23999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.35699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.20200000000000001},"max":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.378},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.27600000000000002,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.437,"15min":0.432},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.68000000000000005,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.28399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.77700000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.70899999999999996}]},{"osd":6,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.76200000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.46400000000000002},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.96699999999999997},"last":0.57799999999999996}]},{"osd":7,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.80700000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542498,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30099999999999999},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.46700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.30499999999999999,"15min":0.30299999999999999},"min":{"1min":0.23499999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.432,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.23899999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.32900000000000001},"min":{"1min":0.245,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23699999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46999999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.42799999999999999,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.312},{"interface":"front","average":{"1min":0.375,"5min":0.35499999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.57699999999999996},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.439,"15min":0.42099999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64200000000000002,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.44500000000000001},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45800000000000002,"15min":0.44700000000000001},"min":{"1min":0.40000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71099999999999997,"5min":0.748,"15min":0.748},"last":0.5}]},{"osd":6,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.41599999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.753},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40500000000000003}]},{"osd":7,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:54:51.191 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-16T01:25:47.706092+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:51.191 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:51.192 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T01:25:53.736718+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=25, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=1, tm_min=53, tm_sec=41, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T01:54:51.193 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T01:55:00.356 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:29:57.647 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.361 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:29:57.652 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.366 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:29:57.590 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.367 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:29:57.591 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.369 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:29:57.593 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.370 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:29:57.593 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.440 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:29:57.731 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.457 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:29:57.681 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:00.458 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:29:57.682 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:55:06.359 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:55:06.362 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:55:11.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T01:55:11.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 Processor -- start 2023-12-16T01:55:11.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 -- start start 2023-12-16T01:55:11.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb33c1501c0 0x7fb33c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c0bff00 0x7fb33c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c072450 0x7fb33c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c0c1a90 con 0x7fb33c072450 2023-12-16T01:55:11.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c0c1d30 con 0x7fb33c1501c0 2023-12-16T01:55:11.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.303+0000 7fb3423fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0c2010 con 0x7fb33c0bff00 2023-12-16T01:55:11.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.304+0000 7fb340998640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c072450 0x7fb33c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.304+0000 7fb340998640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c072450 0x7fb33c071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33298/0 (socket says 172.21.15.107:33298) 2023-12-16T01:55:11.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.304+0000 7fb340998640 1 -- 172.21.15.107:0/3820332481 learned_addr learned my addr 172.21.15.107:0/3820332481 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:11.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.304+0000 7fb33b7fe640 1 --2- 172.21.15.107:0/3820332481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c0bff00 0x7fb33c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.304+0000 7fb33bfff640 1 --2- 172.21.15.107:0/3820332481 >> v2:172.21.15.157:3300/0 conn(0x7fb33c1501c0 0x7fb33c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.307+0000 7fb340998640 1 -- 172.21.15.107:0/3820332481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c0bff00 msgr2=0x7fb33c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:11.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.307+0000 7fb340998640 1 --2- 172.21.15.107:0/3820332481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c0bff00 0x7fb33c156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.307+0000 7fb340998640 1 -- 172.21.15.107:0/3820332481 >> v2:172.21.15.157:3300/0 conn(0x7fb33c1501c0 msgr2=0x7fb33c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:11.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.307+0000 7fb340998640 1 --2- 172.21.15.107:0/3820332481 >> v2:172.21.15.157:3300/0 conn(0x7fb33c1501c0 0x7fb33c159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.307+0000 7fb340998640 1 -- 172.21.15.107:0/3820332481 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c156380 con 0x7fb33c072450 2023-12-16T01:55:11.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.309+0000 7fb340998640 1 --2- 172.21.15.107:0/3820332481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c072450 0x7fb33c071710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0cbad0 tx=0x7fb33402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3be18561b6ac69a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:11.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb33affd640 1 -- 172.21.15.107:0/3820332481 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33402cb00 con 0x7fb33c072450 2023-12-16T01:55:11.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb33affd640 1 -- 172.21.15.107:0/3820332481 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33402cc60 con 0x7fb33c072450 2023-12-16T01:55:11.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb33affd640 1 -- 172.21.15.107:0/3820332481 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3340343f0 con 0x7fb33c072450 2023-12-16T01:55:11.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 -- 172.21.15.107:0/3820332481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c072450 msgr2=0x7fb33c071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 --2- 172.21.15.107:0/3820332481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c072450 0x7fb33c071710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0cbad0 tx=0x7fb33402bf60 comp rx=0 tx=0).stop 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 -- 172.21.15.107:0/3820332481 shutdown_connections 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 --2- 172.21.15.107:0/3820332481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c072450 0x7fb33c071710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 --2- 172.21.15.107:0/3820332481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c0bff00 0x7fb33c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 --2- 172.21.15.107:0/3820332481 >> v2:172.21.15.157:3300/0 conn(0x7fb33c1501c0 0x7fb33c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 -- 172.21.15.107:0/3820332481 >> 172.21.15.107:0/3820332481 conn(0x7fb33c06cd60 msgr2=0x7fb33c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 -- 172.21.15.107:0/3820332481 shutdown_connections 2023-12-16T01:55:11.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.313+0000 7fb3423fb640 1 -- 172.21.15.107:0/3820332481 wait complete. 2023-12-16T01:55:11.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.315+0000 7fb3423fb640 1 Processor -- start 2023-12-16T01:55:11.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.315+0000 7fb3423fb640 1 -- start start 2023-12-16T01:55:11.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb3423fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c072450 0x7fb33c1efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb3423fb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb33c0bff00 0x7fb33c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb3423fb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 0x7fb33c14ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb3423fb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c154180 con 0x7fb33c1501c0 2023-12-16T01:55:11.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb3423fb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c154460 con 0x7fb33c0bff00 2023-12-16T01:55:11.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb3423fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c154740 con 0x7fb33c072450 2023-12-16T01:55:11.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb340998640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 0x7fb33c14ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb33b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb33c0bff00 0x7fb33c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb33bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c072450 0x7fb33c1efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb340998640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 0x7fb33c14ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33302/0 (socket says 172.21.15.107:33302) 2023-12-16T01:55:11.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.316+0000 7fb340998640 1 -- 172.21.15.107:0/2476720981 learned_addr learned my addr 172.21.15.107:0/2476720981 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.320+0000 7fb340998640 1 -- 172.21.15.107:0/2476720981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c072450 msgr2=0x7fb33c1efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.320+0000 7fb340998640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c072450 0x7fb33c1efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.320+0000 7fb340998640 1 -- 172.21.15.107:0/2476720981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb33c0bff00 msgr2=0x7fb33c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.320+0000 7fb340998640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb33c0bff00 0x7fb33c155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.320+0000 7fb340998640 1 -- 172.21.15.107:0/2476720981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334009b30 con 0x7fb33c1501c0 2023-12-16T01:55:11.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.322+0000 7fb340998640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 0x7fb33c14ba50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb334036040 tx=0x7fb334004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:11.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.325+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334009510 con 0x7fb33c1501c0 2023-12-16T01:55:11.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.325+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33403e450 con 0x7fb33c1501c0 2023-12-16T01:55:11.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.325+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33403e800 con 0x7fb33c1501c0 2023-12-16T01:55:11.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.325+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c154a20 con 0x7fb33c1501c0 2023-12-16T01:55:11.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.326+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c154fe0 con 0x7fb33c1501c0 2023-12-16T01:55:11.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.326+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c0c77e0 con 0x7fb33c1501c0 2023-12-16T01:55:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.346+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb33403e960 con 0x7fb33c1501c0 2023-12-16T01:55:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.346+0000 7fb338ff9640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb32806aec0 0x7fb32806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.347+0000 7fb33bfff640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb32806aec0 0x7fb32806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.347+0000 7fb33bfff640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb32806aec0 0x7fb32806d380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009aa0 tx=0x7fb32c009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:11.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.350+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb33407b7b0 con 0x7fb33c1501c0 2023-12-16T01:55:11.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.584+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb334077af0 con 0x7fb33c1501c0 2023-12-16T01:55:11.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.747+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 --> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb33c0c1730 con 0x7fb32806aec0 2023-12-16T01:55:11.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.756+0000 7fb338ff9640 1 -- 172.21.15.107:0/2476720981 <== mgr.4182 v2:172.21.15.107:6832/3457421284 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+374072 (secure 0 0 0) 0x7fb32c011a00 con 0x7fb32806aec0 2023-12-16T01:55:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:55:11.764 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-12-16T01:55:11.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.759+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb32806aec0 msgr2=0x7fb32806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.759+0000 7fb3423fb640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb32806aec0 0x7fb32806d380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009aa0 tx=0x7fb32c009190 comp rx=0 tx=0).stop 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.759+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 msgr2=0x7fb33c14ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.759+0000 7fb3423fb640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 0x7fb33c14ba50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb334036040 tx=0x7fb334004a40 comp rx=0 tx=0).stop 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 shutdown_connections 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c1501c0 0x7fb33c14ba50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb32806aec0 0x7fb32806d380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb33c0bff00 0x7fb33c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 --2- 172.21.15.107:0/2476720981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb33c072450 0x7fb33c1efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 >> 172.21.15.107:0/2476720981 conn(0x7fb33c06cd60 msgr2=0x7fb33c14c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 shutdown_connections 2023-12-16T01:55:11.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.760+0000 7fb3423fb640 1 -- 172.21.15.107:0/2476720981 wait complete. 2023-12-16T01:55:11.772 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":908,"stamp":"2023-12-16T01:55:10.111701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41274830,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1122,"num_read_kb":1170,"num_write":13322,"num_write_kb":366012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15814,"ondisk_log_size":15814,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444232,"kb_used_data":57416,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754530488,"statfs":{"total":773094113280,"available":772639219712,"internally_reserved":0,"allocated":58793984,"data_stored":83518932,"data_compressed":7597666,"data_compressed_allocated":11862016,"data_compressed_original":38076416,"omap_allocated":12752,"internal_metadata":396021296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003127"},"pg_stats":[{"pgid":"2.1f","version":"28'624","reported_seq":666,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.712506+0000","last_change":"2023-12-16T01:53:53.712506+0000","last_active":"2023-12-16T01:53:53.712506+0000","last_peered":"2023-12-16T01:53:53.712506+0000","last_clean":"2023-12-16T01:53:53.712506+0000","last_became_active":"2023-12-16T01:25:47.894641+0000","last_became_peered":"2023-12-16T01:25:47.894641+0000","last_unstale":"2023-12-16T01:53:53.712506+0000","last_undegraded":"2023-12-16T01:53:53.712506+0000","last_fullsized":"2023-12-16T01:53:53.712506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'624","last_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_deep_scrub":"28'624","last_deep_scrub_stamp":"2023-12-16T01:53:53.712422+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.712422+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:46.624054+0000","scrub_duration":0.013433865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'28","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:18.081704+0000","last_change":"2023-12-16T01:54:18.081724+0000","last_active":"2023-12-16T01:54:18.081704+0000","last_peered":"2023-12-16T01:54:18.081704+0000","last_clean":"2023-12-16T01:54:18.081704+0000","last_became_active":"2023-12-16T01:25:49.116840+0000","last_became_peered":"2023-12-16T01:25:49.116840+0000","last_unstale":"2023-12-16T01:54:18.081704+0000","last_undegraded":"2023-12-16T01:54:18.081704+0000","last_fullsized":"2023-12-16T01:54:18.081704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2023-12-16T01:54:18.081625+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2023-12-16T01:54:18.081625+0000","last_clean_scrub_stamp":"2023-12-16T01:54:18.081625+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:26.347108+0000","scrub_duration":0.0012030560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'160","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:06.405952+0000","last_change":"2023-12-16T01:54:06.405952+0000","last_active":"2023-12-16T01:54:06.405952+0000","last_peered":"2023-12-16T01:54:06.405952+0000","last_clean":"2023-12-16T01:54:06.405952+0000","last_became_active":"2023-12-16T01:25:54.978539+0000","last_became_peered":"2023-12-16T01:25:54.978539+0000","last_unstale":"2023-12-16T01:54:06.405952+0000","last_undegraded":"2023-12-16T01:54:06.405952+0000","last_fullsized":"2023-12-16T01:54:06.405952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'160","last_scrub_stamp":"2023-12-16T01:54:06.405857+0000","last_deep_scrub":"28'160","last_deep_scrub_stamp":"2023-12-16T01:54:06.405857+0000","last_clean_scrub_stamp":"2023-12-16T01:54:06.405857+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:09.887576+0000","scrub_duration":0.001779709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":10641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'728","reported_seq":769,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.949340+0000","last_change":"2023-12-16T01:54:04.949379+0000","last_active":"2023-12-16T01:54:04.949340+0000","last_peered":"2023-12-16T01:54:04.949340+0000","last_clean":"2023-12-16T01:54:04.949340+0000","last_became_active":"2023-12-16T01:25:47.900098+0000","last_became_peered":"2023-12-16T01:25:47.900098+0000","last_unstale":"2023-12-16T01:54:04.949340+0000","last_undegraded":"2023-12-16T01:54:04.949340+0000","last_fullsized":"2023-12-16T01:54:04.949340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'728","last_scrub_stamp":"2023-12-16T01:54:04.949267+0000","last_deep_scrub":"28'728","last_deep_scrub_stamp":"2023-12-16T01:54:04.949267+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.949267+0000","objects_scrubbed":1,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:33.947014+0000","scrub_duration":0.011806354999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'38","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.140533+0000","last_change":"2023-12-16T01:53:48.140533+0000","last_active":"2023-12-16T01:53:48.140533+0000","last_peered":"2023-12-16T01:53:48.140533+0000","last_clean":"2023-12-16T01:53:48.140533+0000","last_became_active":"2023-12-16T01:25:49.118254+0000","last_became_peered":"2023-12-16T01:25:49.118254+0000","last_unstale":"2023-12-16T01:53:48.140533+0000","last_undegraded":"2023-12-16T01:53:48.140533+0000","last_fullsized":"2023-12-16T01:53:48.140533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:48.140450+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.140450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:41.931150+0000","scrub_duration":0.0013849089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'129","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.587804+0000","last_change":"2023-12-16T01:54:04.587804+0000","last_active":"2023-12-16T01:54:04.587804+0000","last_peered":"2023-12-16T01:54:04.587804+0000","last_clean":"2023-12-16T01:54:04.587804+0000","last_became_active":"2023-12-16T01:25:54.975521+0000","last_became_peered":"2023-12-16T01:25:54.975521+0000","last_unstale":"2023-12-16T01:54:04.587804+0000","last_undegraded":"2023-12-16T01:54:04.587804+0000","last_fullsized":"2023-12-16T01:54:04.587804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'129","last_scrub_stamp":"2023-12-16T01:54:04.587715+0000","last_deep_scrub":"28'129","last_deep_scrub_stamp":"2023-12-16T01:54:04.587715+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.587715+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:13:07.957493+0000","scrub_duration":0.0016608619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":5903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1397","reported_seq":1435,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.109371+0000","last_change":"2023-12-16T01:53:59.109396+0000","last_active":"2023-12-16T01:53:59.109371+0000","last_peered":"2023-12-16T01:53:59.109371+0000","last_clean":"2023-12-16T01:53:59.109371+0000","last_became_active":"2023-12-16T01:25:47.875787+0000","last_became_peered":"2023-12-16T01:25:47.875787+0000","last_unstale":"2023-12-16T01:53:59.109371+0000","last_undegraded":"2023-12-16T01:53:59.109371+0000","last_fullsized":"2023-12-16T01:53:59.109371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1397","last_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_deep_scrub":"28'1397","last_deep_scrub_stamp":"2023-12-16T01:53:59.109317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.109317+0000","objects_scrubbed":3,"log_size":1397,"log_dups_size":0,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:26.537787+0000","scrub_duration":0.0258877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":8999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'33","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.858232+0000","last_change":"2023-12-16T01:53:51.858251+0000","last_active":"2023-12-16T01:53:51.858232+0000","last_peered":"2023-12-16T01:53:51.858232+0000","last_clean":"2023-12-16T01:53:51.858232+0000","last_became_active":"2023-12-16T01:25:49.147380+0000","last_became_peered":"2023-12-16T01:25:49.147380+0000","last_unstale":"2023-12-16T01:53:51.858232+0000","last_undegraded":"2023-12-16T01:53:51.858232+0000","last_fullsized":"2023-12-16T01:53:51.858232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:53:51.858159+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.858159+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:58:51.979244+0000","scrub_duration":0.00087977699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.651479+0000","last_change":"2023-12-16T01:54:20.651501+0000","last_active":"2023-12-16T01:54:20.651479+0000","last_peered":"2023-12-16T01:54:20.651479+0000","last_clean":"2023-12-16T01:54:20.651479+0000","last_became_active":"2023-12-16T01:25:54.986099+0000","last_became_peered":"2023-12-16T01:25:54.986099+0000","last_unstale":"2023-12-16T01:54:20.651479+0000","last_undegraded":"2023-12-16T01:54:20.651479+0000","last_fullsized":"2023-12-16T01:54:20.651479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:20.651399+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:20.651399+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.651399+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:26.060571+0000","scrub_duration":0.001840382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.083732+0000","last_change":"2023-12-16T01:54:08.083754+0000","last_active":"2023-12-16T01:54:08.083732+0000","last_peered":"2023-12-16T01:54:08.083732+0000","last_clean":"2023-12-16T01:54:08.083732+0000","last_became_active":"2023-12-16T01:25:47.876009+0000","last_became_peered":"2023-12-16T01:25:47.876009+0000","last_unstale":"2023-12-16T01:54:08.083732+0000","last_undegraded":"2023-12-16T01:54:08.083732+0000","last_fullsized":"2023-12-16T01:54:08.083732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:54:08.083672+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:54:08.083672+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.083672+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:25.913138+0000","scrub_duration":0.0019540069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'48","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:54.292162+0000","last_change":"2023-12-16T01:54:54.292185+0000","last_active":"2023-12-16T01:54:54.292162+0000","last_peered":"2023-12-16T01:54:54.292162+0000","last_clean":"2023-12-16T01:54:54.292162+0000","last_became_active":"2023-12-16T01:26:31.582637+0000","last_became_peered":"2023-12-16T01:26:31.582637+0000","last_unstale":"2023-12-16T01:54:54.292162+0000","last_undegraded":"2023-12-16T01:54:54.292162+0000","last_fullsized":"2023-12-16T01:54:54.292162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'48","last_scrub_stamp":"2023-12-16T01:54:54.292079+0000","last_deep_scrub":"28'48","last_deep_scrub_stamp":"2023-12-16T01:54:54.292079+0000","last_clean_scrub_stamp":"2023-12-16T01:54:54.292079+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:29:12.594381+0000","scrub_duration":0.001648605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'122","reported_seq":157,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.661739+0000","last_change":"2023-12-16T01:54:13.661759+0000","last_active":"2023-12-16T01:54:13.661739+0000","last_peered":"2023-12-16T01:54:13.661739+0000","last_clean":"2023-12-16T01:54:13.661739+0000","last_became_active":"2023-12-16T01:25:54.980635+0000","last_became_peered":"2023-12-16T01:25:54.980635+0000","last_unstale":"2023-12-16T01:54:13.661739+0000","last_undegraded":"2023-12-16T01:54:13.661739+0000","last_fullsized":"2023-12-16T01:54:13.661739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'122","last_scrub_stamp":"2023-12-16T01:54:13.661672+0000","last_deep_scrub":"28'122","last_deep_scrub_stamp":"2023-12-16T01:54:13.661672+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.661672+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:35.068765+0000","scrub_duration":0.0017602150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":5580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'38","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:43.196727+0000","last_change":"2023-12-16T01:54:43.196747+0000","last_active":"2023-12-16T01:54:43.196727+0000","last_peered":"2023-12-16T01:54:43.196727+0000","last_clean":"2023-12-16T01:54:43.196727+0000","last_became_active":"2023-12-16T01:25:49.157460+0000","last_became_peered":"2023-12-16T01:25:49.157460+0000","last_unstale":"2023-12-16T01:54:43.196727+0000","last_undegraded":"2023-12-16T01:54:43.196727+0000","last_fullsized":"2023-12-16T01:54:43.196727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:43.196659+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:43.196659+0000","last_clean_scrub_stamp":"2023-12-16T01:54:43.196659+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:08:23.770704+0000","scrub_duration":0.001123977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'639","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.231867+0000","last_change":"2023-12-16T01:54:26.231867+0000","last_active":"2023-12-16T01:54:26.231867+0000","last_peered":"2023-12-16T01:54:26.231867+0000","last_clean":"2023-12-16T01:54:26.231867+0000","last_became_active":"2023-12-16T01:25:47.895333+0000","last_became_peered":"2023-12-16T01:25:47.895333+0000","last_unstale":"2023-12-16T01:54:26.231867+0000","last_undegraded":"2023-12-16T01:54:26.231867+0000","last_fullsized":"2023-12-16T01:54:26.231867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'639","last_scrub_stamp":"2023-12-16T01:54:26.231737+0000","last_deep_scrub":"28'639","last_deep_scrub_stamp":"2023-12-16T01:54:26.231737+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.231737+0000","objects_scrubbed":2,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:39:24.800131+0000","scrub_duration":0.018664725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'111","reported_seq":147,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:52.282152+0000","last_change":"2023-12-16T01:54:52.282171+0000","last_active":"2023-12-16T01:54:52.282152+0000","last_peered":"2023-12-16T01:54:52.282152+0000","last_clean":"2023-12-16T01:54:52.282152+0000","last_became_active":"2023-12-16T01:25:54.986667+0000","last_became_peered":"2023-12-16T01:25:54.986667+0000","last_unstale":"2023-12-16T01:54:52.282152+0000","last_undegraded":"2023-12-16T01:54:52.282152+0000","last_fullsized":"2023-12-16T01:54:52.282152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'111","last_scrub_stamp":"2023-12-16T01:54:52.282085+0000","last_deep_scrub":"28'111","last_deep_scrub_stamp":"2023-12-16T01:54:52.282085+0000","last_clean_scrub_stamp":"2023-12-16T01:54:52.282085+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:29.086962+0000","scrub_duration":0.001522308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'38","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.376828+0000","last_change":"2023-12-16T01:54:00.376828+0000","last_active":"2023-12-16T01:54:00.376828+0000","last_peered":"2023-12-16T01:54:00.376828+0000","last_clean":"2023-12-16T01:54:00.376828+0000","last_became_active":"2023-12-16T01:25:49.122552+0000","last_became_peered":"2023-12-16T01:25:49.122552+0000","last_unstale":"2023-12-16T01:54:00.376828+0000","last_undegraded":"2023-12-16T01:54:00.376828+0000","last_fullsized":"2023-12-16T01:54:00.376828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:00.376682+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.376682+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:29.025843+0000","scrub_duration":0.0016058649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:07.165165+0000","last_change":"2023-12-16T01:54:07.165187+0000","last_active":"2023-12-16T01:54:07.165165+0000","last_peered":"2023-12-16T01:54:07.165165+0000","last_clean":"2023-12-16T01:54:07.165165+0000","last_became_active":"2023-12-16T01:25:47.900534+0000","last_became_peered":"2023-12-16T01:25:47.900534+0000","last_unstale":"2023-12-16T01:54:07.165165+0000","last_undegraded":"2023-12-16T01:54:07.165165+0000","last_fullsized":"2023-12-16T01:54:07.165165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:54:07.165084+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:54:07.165084+0000","last_clean_scrub_stamp":"2023-12-16T01:54:07.165084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:55:00.076716+0000","scrub_duration":0.0010529879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'167","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:35.141233+0000","last_change":"2023-12-16T01:54:35.141253+0000","last_active":"2023-12-16T01:54:35.141233+0000","last_peered":"2023-12-16T01:54:35.141233+0000","last_clean":"2023-12-16T01:54:35.141233+0000","last_became_active":"2023-12-16T01:25:54.987804+0000","last_became_peered":"2023-12-16T01:25:54.987804+0000","last_unstale":"2023-12-16T01:54:35.141233+0000","last_undegraded":"2023-12-16T01:54:35.141233+0000","last_fullsized":"2023-12-16T01:54:35.141233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'167","last_scrub_stamp":"2023-12-16T01:54:35.141165+0000","last_deep_scrub":"28'167","last_deep_scrub_stamp":"2023-12-16T01:54:35.141165+0000","last_clean_scrub_stamp":"2023-12-16T01:54:35.141165+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:22.807588+0000","scrub_duration":0.0015004790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'37","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.818668+0000","last_change":"2023-12-16T01:54:12.818687+0000","last_active":"2023-12-16T01:54:12.818668+0000","last_peered":"2023-12-16T01:54:12.818668+0000","last_clean":"2023-12-16T01:54:12.818668+0000","last_became_active":"2023-12-16T01:25:49.121653+0000","last_became_peered":"2023-12-16T01:25:49.121653+0000","last_unstale":"2023-12-16T01:54:12.818668+0000","last_undegraded":"2023-12-16T01:54:12.818668+0000","last_fullsized":"2023-12-16T01:54:12.818668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:12.818595+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:12.818595+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.818595+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:34.225689+0000","scrub_duration":0.00096157499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.669327+0000","last_change":"2023-12-16T01:53:54.669327+0000","last_active":"2023-12-16T01:53:54.669327+0000","last_peered":"2023-12-16T01:53:54.669327+0000","last_clean":"2023-12-16T01:53:54.669327+0000","last_became_active":"2023-12-16T01:25:47.873542+0000","last_became_peered":"2023-12-16T01:25:47.873542+0000","last_unstale":"2023-12-16T01:53:54.669327+0000","last_undegraded":"2023-12-16T01:53:54.669327+0000","last_fullsized":"2023-12-16T01:53:54.669327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T01:53:54.669197+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.669197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.939886+0000","scrub_duration":0.0011923369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'144","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.485133+0000","last_change":"2023-12-16T01:54:13.485178+0000","last_active":"2023-12-16T01:54:13.485133+0000","last_peered":"2023-12-16T01:54:13.485133+0000","last_clean":"2023-12-16T01:54:13.485133+0000","last_became_active":"2023-12-16T01:25:54.985591+0000","last_became_peered":"2023-12-16T01:25:54.985591+0000","last_unstale":"2023-12-16T01:54:13.485133+0000","last_undegraded":"2023-12-16T01:54:13.485133+0000","last_fullsized":"2023-12-16T01:54:13.485133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:13.485033+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:13.485033+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.485033+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:32.554637+0000","scrub_duration":0.001406738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":12896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'36","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.122613+0000","last_change":"2023-12-16T01:53:59.122633+0000","last_active":"2023-12-16T01:53:59.122613+0000","last_peered":"2023-12-16T01:53:59.122613+0000","last_clean":"2023-12-16T01:53:59.122613+0000","last_became_active":"2023-12-16T01:25:49.152403+0000","last_became_peered":"2023-12-16T01:25:49.152403+0000","last_unstale":"2023-12-16T01:53:59.122613+0000","last_undegraded":"2023-12-16T01:53:59.122613+0000","last_fullsized":"2023-12-16T01:53:59.122613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:59.122554+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.122554+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:09:35.015552+0000","scrub_duration":0.0010611500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.086079+0000","last_change":"2023-12-16T01:53:57.086079+0000","last_active":"2023-12-16T01:53:57.086079+0000","last_peered":"2023-12-16T01:53:57.086079+0000","last_clean":"2023-12-16T01:53:57.086079+0000","last_became_active":"2023-12-16T01:25:47.874416+0000","last_became_peered":"2023-12-16T01:25:47.874416+0000","last_unstale":"2023-12-16T01:53:57.086079+0000","last_undegraded":"2023-12-16T01:53:57.086079+0000","last_fullsized":"2023-12-16T01:53:57.086079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:57.085993+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.085993+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:03.237603+0000","scrub_duration":0.0009980989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'123","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:24.750877+0000","last_change":"2023-12-16T01:54:24.750899+0000","last_active":"2023-12-16T01:54:24.750877+0000","last_peered":"2023-12-16T01:54:24.750877+0000","last_clean":"2023-12-16T01:54:24.750877+0000","last_became_active":"2023-12-16T01:25:54.981472+0000","last_became_peered":"2023-12-16T01:25:54.981472+0000","last_unstale":"2023-12-16T01:54:24.750877+0000","last_undegraded":"2023-12-16T01:54:24.750877+0000","last_fullsized":"2023-12-16T01:54:24.750877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'123","last_scrub_stamp":"2023-12-16T01:54:24.750798+0000","last_deep_scrub":"28'123","last_deep_scrub_stamp":"2023-12-16T01:54:24.750798+0000","last_clean_scrub_stamp":"2023-12-16T01:54:24.750798+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:42.994235+0000","scrub_duration":0.001693733,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'41","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.861610+0000","last_change":"2023-12-16T01:54:13.861630+0000","last_active":"2023-12-16T01:54:13.861610+0000","last_peered":"2023-12-16T01:54:13.861610+0000","last_clean":"2023-12-16T01:54:13.861610+0000","last_became_active":"2023-12-16T01:25:49.120415+0000","last_became_peered":"2023-12-16T01:25:49.120415+0000","last_unstale":"2023-12-16T01:54:13.861610+0000","last_undegraded":"2023-12-16T01:54:13.861610+0000","last_fullsized":"2023-12-16T01:54:13.861610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:54:13.861535+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:54:13.861535+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.861535+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:40.196046+0000","scrub_duration":0.00099201499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.221552+0000","last_change":"2023-12-16T01:54:23.221573+0000","last_active":"2023-12-16T01:54:23.221552+0000","last_peered":"2023-12-16T01:54:23.221552+0000","last_clean":"2023-12-16T01:54:23.221552+0000","last_became_active":"2023-12-16T01:25:47.895345+0000","last_became_peered":"2023-12-16T01:25:47.895345+0000","last_unstale":"2023-12-16T01:54:23.221552+0000","last_undegraded":"2023-12-16T01:54:23.221552+0000","last_fullsized":"2023-12-16T01:54:23.221552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-12-16T01:54:23.221494+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-12-16T01:54:23.221494+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.221494+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:27:27.499893+0000","scrub_duration":0.001892208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'151","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.682122+0000","last_change":"2023-12-16T01:54:11.682122+0000","last_active":"2023-12-16T01:54:11.682122+0000","last_peered":"2023-12-16T01:54:11.682122+0000","last_clean":"2023-12-16T01:54:11.682122+0000","last_became_active":"2023-12-16T01:25:54.983909+0000","last_became_peered":"2023-12-16T01:25:54.983909+0000","last_unstale":"2023-12-16T01:54:11.682122+0000","last_undegraded":"2023-12-16T01:54:11.682122+0000","last_fullsized":"2023-12-16T01:54:11.682122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'151","last_scrub_stamp":"2023-12-16T01:54:11.682026+0000","last_deep_scrub":"28'151","last_deep_scrub_stamp":"2023-12-16T01:54:11.682026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.682026+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:49.342638+0000","scrub_duration":0.0016144899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'33","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.947049+0000","last_change":"2023-12-16T01:54:20.947068+0000","last_active":"2023-12-16T01:54:20.947049+0000","last_peered":"2023-12-16T01:54:20.947049+0000","last_clean":"2023-12-16T01:54:20.947049+0000","last_became_active":"2023-12-16T01:25:49.113170+0000","last_became_peered":"2023-12-16T01:25:49.113170+0000","last_unstale":"2023-12-16T01:54:20.947049+0000","last_undegraded":"2023-12-16T01:54:20.947049+0000","last_fullsized":"2023-12-16T01:54:20.947049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:54:20.946986+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:54:20.946986+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.946986+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:22:09.368835+0000","scrub_duration":0.001206894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'311","reported_seq":352,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.757164+0000","last_change":"2023-12-16T01:54:08.757199+0000","last_active":"2023-12-16T01:54:08.757164+0000","last_peered":"2023-12-16T01:54:08.757164+0000","last_clean":"2023-12-16T01:54:08.757164+0000","last_became_active":"2023-12-16T01:25:47.873429+0000","last_became_peered":"2023-12-16T01:25:47.873429+0000","last_unstale":"2023-12-16T01:54:08.757164+0000","last_undegraded":"2023-12-16T01:54:08.757164+0000","last_fullsized":"2023-12-16T01:54:08.757164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'311","last_scrub_stamp":"2023-12-16T01:54:08.757077+0000","last_deep_scrub":"28'311","last_deep_scrub_stamp":"2023-12-16T01:54:08.757077+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.757077+0000","objects_scrubbed":1,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:56:34.272270+0000","scrub_duration":0.0033505319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'134","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:34.076229+0000","last_change":"2023-12-16T01:54:34.076264+0000","last_active":"2023-12-16T01:54:34.076229+0000","last_peered":"2023-12-16T01:54:34.076229+0000","last_clean":"2023-12-16T01:54:34.076229+0000","last_became_active":"2023-12-16T01:25:54.984173+0000","last_became_peered":"2023-12-16T01:25:54.984173+0000","last_unstale":"2023-12-16T01:54:34.076229+0000","last_undegraded":"2023-12-16T01:54:34.076229+0000","last_fullsized":"2023-12-16T01:54:34.076229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'134","last_scrub_stamp":"2023-12-16T01:54:34.076122+0000","last_deep_scrub":"28'134","last_deep_scrub_stamp":"2023-12-16T01:54:34.076122+0000","last_clean_scrub_stamp":"2023-12-16T01:54:34.076122+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:27.864086+0000","scrub_duration":0.0018790879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'37","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:28.101981+0000","last_change":"2023-12-16T01:54:28.101981+0000","last_active":"2023-12-16T01:54:28.101981+0000","last_peered":"2023-12-16T01:54:28.101981+0000","last_clean":"2023-12-16T01:54:28.101981+0000","last_became_active":"2023-12-16T01:25:49.113940+0000","last_became_peered":"2023-12-16T01:25:49.113940+0000","last_unstale":"2023-12-16T01:54:28.101981+0000","last_undegraded":"2023-12-16T01:54:28.101981+0000","last_fullsized":"2023-12-16T01:54:28.101981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:28.101888+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:28.101888+0000","last_clean_scrub_stamp":"2023-12-16T01:54:28.101888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:35.565175+0000","scrub_duration":0.00093575400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:17.150031+0000","last_change":"2023-12-16T01:54:17.150031+0000","last_active":"2023-12-16T01:54:17.150031+0000","last_peered":"2023-12-16T01:54:17.150031+0000","last_clean":"2023-12-16T01:54:17.150031+0000","last_became_active":"2023-12-16T01:25:47.897244+0000","last_became_peered":"2023-12-16T01:25:47.897244+0000","last_unstale":"2023-12-16T01:54:17.150031+0000","last_undegraded":"2023-12-16T01:54:17.150031+0000","last_fullsized":"2023-12-16T01:54:17.150031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:17.149917+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:17.149917+0000","last_clean_scrub_stamp":"2023-12-16T01:54:17.149917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:13.375365+0000","scrub_duration":0.0013443159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'135","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:31.119015+0000","last_change":"2023-12-16T01:54:31.119015+0000","last_active":"2023-12-16T01:54:31.119015+0000","last_peered":"2023-12-16T01:54:31.119015+0000","last_clean":"2023-12-16T01:54:31.119015+0000","last_became_active":"2023-12-16T01:25:54.988019+0000","last_became_peered":"2023-12-16T01:25:54.988019+0000","last_unstale":"2023-12-16T01:54:31.119015+0000","last_undegraded":"2023-12-16T01:54:31.119015+0000","last_fullsized":"2023-12-16T01:54:31.119015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:31.118937+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:31.118937+0000","last_clean_scrub_stamp":"2023-12-16T01:54:31.118937+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:49.362374+0000","scrub_duration":0.0016082830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":11183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.810913+0000","last_change":"2023-12-16T01:53:53.810913+0000","last_active":"2023-12-16T01:53:53.810913+0000","last_peered":"2023-12-16T01:53:53.810913+0000","last_clean":"2023-12-16T01:53:53.810913+0000","last_became_active":"2023-12-16T01:25:49.115977+0000","last_became_peered":"2023-12-16T01:25:49.115977+0000","last_unstale":"2023-12-16T01:53:53.810913+0000","last_undegraded":"2023-12-16T01:53:53.810913+0000","last_fullsized":"2023-12-16T01:53:53.810913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:53:53.810791+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.810791+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:09.911252+0000","scrub_duration":0.001403133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.013024+0000","last_change":"2023-12-16T01:53:59.013024+0000","last_active":"2023-12-16T01:53:59.013024+0000","last_peered":"2023-12-16T01:53:59.013024+0000","last_clean":"2023-12-16T01:53:59.013024+0000","last_became_active":"2023-12-16T01:25:47.899310+0000","last_became_peered":"2023-12-16T01:25:47.899310+0000","last_unstale":"2023-12-16T01:53:59.013024+0000","last_undegraded":"2023-12-16T01:53:59.013024+0000","last_fullsized":"2023-12-16T01:53:59.013024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:59.012926+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.012926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:06.476212+0000","scrub_duration":0.001035209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'191","reported_seq":229,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:30.105661+0000","last_change":"2023-12-16T01:54:30.105661+0000","last_active":"2023-12-16T01:54:30.105661+0000","last_peered":"2023-12-16T01:54:30.105661+0000","last_clean":"2023-12-16T01:54:30.105661+0000","last_became_active":"2023-12-16T01:25:54.982880+0000","last_became_peered":"2023-12-16T01:25:54.982880+0000","last_unstale":"2023-12-16T01:54:30.105661+0000","last_undegraded":"2023-12-16T01:54:30.105661+0000","last_fullsized":"2023-12-16T01:54:30.105661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2023-12-16T01:54:30.105568+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2023-12-16T01:54:30.105568+0000","last_clean_scrub_stamp":"2023-12-16T01:54:30.105568+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:47.935034+0000","scrub_duration":0.001555414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'33","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:28.061186+0000","last_change":"2023-12-16T01:54:28.061186+0000","last_active":"2023-12-16T01:54:28.061186+0000","last_peered":"2023-12-16T01:54:28.061186+0000","last_clean":"2023-12-16T01:54:28.061186+0000","last_became_active":"2023-12-16T01:25:49.146621+0000","last_became_peered":"2023-12-16T01:25:49.146621+0000","last_unstale":"2023-12-16T01:54:28.061186+0000","last_undegraded":"2023-12-16T01:54:28.061186+0000","last_fullsized":"2023-12-16T01:54:28.061186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2023-12-16T01:54:28.061099+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2023-12-16T01:54:28.061099+0000","last_clean_scrub_stamp":"2023-12-16T01:54:28.061099+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:23.756752+0000","scrub_duration":0.0010128380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:30.172034+0000","last_change":"2023-12-16T01:54:30.172034+0000","last_active":"2023-12-16T01:54:30.172034+0000","last_peered":"2023-12-16T01:54:30.172034+0000","last_clean":"2023-12-16T01:54:30.172034+0000","last_became_active":"2023-12-16T01:25:47.897761+0000","last_became_peered":"2023-12-16T01:25:47.897761+0000","last_unstale":"2023-12-16T01:54:30.172034+0000","last_undegraded":"2023-12-16T01:54:30.172034+0000","last_fullsized":"2023-12-16T01:54:30.172034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:30.171958+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:30.171958+0000","last_clean_scrub_stamp":"2023-12-16T01:54:30.171958+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:29:10.595758+0000","scrub_duration":0.0011299140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'132","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:36.098134+0000","last_change":"2023-12-16T01:54:36.098134+0000","last_active":"2023-12-16T01:54:36.098134+0000","last_peered":"2023-12-16T01:54:36.098134+0000","last_clean":"2023-12-16T01:54:36.098134+0000","last_became_active":"2023-12-16T01:25:54.989745+0000","last_became_peered":"2023-12-16T01:25:54.989745+0000","last_unstale":"2023-12-16T01:54:36.098134+0000","last_undegraded":"2023-12-16T01:54:36.098134+0000","last_fullsized":"2023-12-16T01:54:36.098134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'132","last_scrub_stamp":"2023-12-16T01:54:36.098053+0000","last_deep_scrub":"28'132","last_deep_scrub_stamp":"2023-12-16T01:54:36.098053+0000","last_clean_scrub_stamp":"2023-12-16T01:54:36.098053+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:58.147540+0000","scrub_duration":0.0014859949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":8670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'32","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.903310+0000","last_change":"2023-12-16T01:54:08.903330+0000","last_active":"2023-12-16T01:54:08.903310+0000","last_peered":"2023-12-16T01:54:08.903310+0000","last_clean":"2023-12-16T01:54:08.903310+0000","last_became_active":"2023-12-16T01:25:49.122841+0000","last_became_peered":"2023-12-16T01:25:49.122841+0000","last_unstale":"2023-12-16T01:54:08.903310+0000","last_undegraded":"2023-12-16T01:54:08.903310+0000","last_fullsized":"2023-12-16T01:54:08.903310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:08.903246+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:08.903246+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.903246+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:25.974236+0000","scrub_duration":0.00090658899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1009","reported_seq":2057,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.230942+0000","last_change":"2023-12-16T01:53:49.230942+0000","last_active":"2023-12-16T01:53:49.230942+0000","last_peered":"2023-12-16T01:53:49.230942+0000","last_clean":"2023-12-16T01:53:49.230942+0000","last_became_active":"2023-12-16T01:25:47.899382+0000","last_became_peered":"2023-12-16T01:25:47.899382+0000","last_unstale":"2023-12-16T01:53:49.230942+0000","last_undegraded":"2023-12-16T01:53:49.230942+0000","last_fullsized":"2023-12-16T01:53:49.230942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1009","last_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_deep_scrub":"28'1009","last_deep_scrub_stamp":"2023-12-16T01:53:49.230821+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.230821+0000","objects_scrubbed":1,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:23.521655+0000","scrub_duration":0.0014598370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221020,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":1007,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'147","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:33.153327+0000","last_change":"2023-12-16T01:54:33.153348+0000","last_active":"2023-12-16T01:54:33.153327+0000","last_peered":"2023-12-16T01:54:33.153327+0000","last_clean":"2023-12-16T01:54:33.153327+0000","last_became_active":"2023-12-16T01:25:54.987725+0000","last_became_peered":"2023-12-16T01:25:54.987725+0000","last_unstale":"2023-12-16T01:54:33.153327+0000","last_undegraded":"2023-12-16T01:54:33.153327+0000","last_fullsized":"2023-12-16T01:54:33.153327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'147","last_scrub_stamp":"2023-12-16T01:54:33.153261+0000","last_deep_scrub":"28'147","last_deep_scrub_stamp":"2023-12-16T01:54:33.153261+0000","last_clean_scrub_stamp":"2023-12-16T01:54:33.153261+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:18.251469+0000","scrub_duration":0.001319122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'29","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.206591+0000","last_change":"2023-12-16T01:54:11.206591+0000","last_active":"2023-12-16T01:54:11.206591+0000","last_peered":"2023-12-16T01:54:11.206591+0000","last_clean":"2023-12-16T01:54:11.206591+0000","last_became_active":"2023-12-16T01:25:49.117502+0000","last_became_peered":"2023-12-16T01:25:49.117502+0000","last_unstale":"2023-12-16T01:54:11.206591+0000","last_undegraded":"2023-12-16T01:54:11.206591+0000","last_fullsized":"2023-12-16T01:54:11.206591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2023-12-16T01:54:11.206504+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2023-12-16T01:54:11.206504+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.206504+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:44.754134+0000","scrub_duration":0.0012846170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'556","reported_seq":597,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:25.216109+0000","last_change":"2023-12-16T01:54:25.216151+0000","last_active":"2023-12-16T01:54:25.216109+0000","last_peered":"2023-12-16T01:54:25.216109+0000","last_clean":"2023-12-16T01:54:25.216109+0000","last_became_active":"2023-12-16T01:25:47.899760+0000","last_became_peered":"2023-12-16T01:25:47.899760+0000","last_unstale":"2023-12-16T01:54:25.216109+0000","last_undegraded":"2023-12-16T01:54:25.216109+0000","last_fullsized":"2023-12-16T01:54:25.216109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'556","last_scrub_stamp":"2023-12-16T01:54:25.216045+0000","last_deep_scrub":"28'556","last_deep_scrub_stamp":"2023-12-16T01:54:25.216045+0000","last_clean_scrub_stamp":"2023-12-16T01:54:25.216045+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:06.713469+0000","scrub_duration":0.012453327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'144","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:38.185599+0000","last_change":"2023-12-16T01:54:38.185638+0000","last_active":"2023-12-16T01:54:38.185599+0000","last_peered":"2023-12-16T01:54:38.185599+0000","last_clean":"2023-12-16T01:54:38.185599+0000","last_became_active":"2023-12-16T01:25:54.979943+0000","last_became_peered":"2023-12-16T01:25:54.979943+0000","last_unstale":"2023-12-16T01:54:38.185599+0000","last_undegraded":"2023-12-16T01:54:38.185599+0000","last_fullsized":"2023-12-16T01:54:38.185599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:38.185527+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:38.185527+0000","last_clean_scrub_stamp":"2023-12-16T01:54:38.185527+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:39:36.753921+0000","scrub_duration":0.001295575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'32","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.859168+0000","last_change":"2023-12-16T01:54:16.859168+0000","last_active":"2023-12-16T01:54:16.859168+0000","last_peered":"2023-12-16T01:54:16.859168+0000","last_clean":"2023-12-16T01:54:16.859168+0000","last_became_active":"2023-12-16T01:25:49.117507+0000","last_became_peered":"2023-12-16T01:25:49.117507+0000","last_unstale":"2023-12-16T01:54:16.859168+0000","last_undegraded":"2023-12-16T01:54:16.859168+0000","last_fullsized":"2023-12-16T01:54:16.859168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:16.859078+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:16.859078+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.859078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:22.268251+0000","scrub_duration":0.0011505560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:18.119056+0000","last_change":"2023-12-16T01:54:18.119056+0000","last_active":"2023-12-16T01:54:18.119056+0000","last_peered":"2023-12-16T01:54:18.119056+0000","last_clean":"2023-12-16T01:54:18.119056+0000","last_became_active":"2023-12-16T01:25:47.895282+0000","last_became_peered":"2023-12-16T01:25:47.895282+0000","last_unstale":"2023-12-16T01:54:18.119056+0000","last_undegraded":"2023-12-16T01:54:18.119056+0000","last_fullsized":"2023-12-16T01:54:18.119056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2023-12-16T01:54:18.118973+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2023-12-16T01:54:18.118973+0000","last_clean_scrub_stamp":"2023-12-16T01:54:18.118973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:05.785396+0000","scrub_duration":0.001105857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:44.814945+0000","last_change":"2023-12-16T01:53:44.814970+0000","last_active":"2023-12-16T01:53:44.814945+0000","last_peered":"2023-12-16T01:53:44.814945+0000","last_clean":"2023-12-16T01:53:44.814945+0000","last_became_active":"2023-12-16T01:25:36.521390+0000","last_became_peered":"2023-12-16T01:25:36.521390+0000","last_unstale":"2023-12-16T01:53:44.814945+0000","last_undegraded":"2023-12-16T01:53:44.814945+0000","last_fullsized":"2023-12-16T01:53:44.814945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-12-16T01:53:44.814880+0000","last_clean_scrub_stamp":"2023-12-16T01:53:44.814880+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:43.334912+0000","scrub_duration":0.0039548450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'153","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:48.285960+0000","last_change":"2023-12-16T01:54:48.285982+0000","last_active":"2023-12-16T01:54:48.285960+0000","last_peered":"2023-12-16T01:54:48.285960+0000","last_clean":"2023-12-16T01:54:48.285960+0000","last_became_active":"2023-12-16T01:25:54.990526+0000","last_became_peered":"2023-12-16T01:25:54.990526+0000","last_unstale":"2023-12-16T01:54:48.285960+0000","last_undegraded":"2023-12-16T01:54:48.285960+0000","last_fullsized":"2023-12-16T01:54:48.285960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'153","last_scrub_stamp":"2023-12-16T01:54:48.285881+0000","last_deep_scrub":"28'153","last_deep_scrub_stamp":"2023-12-16T01:54:48.285881+0000","last_clean_scrub_stamp":"2023-12-16T01:54:48.285881+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:25.122602+0000","scrub_duration":0.00186315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":9577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'34","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.144935+0000","last_change":"2023-12-16T01:53:55.144935+0000","last_active":"2023-12-16T01:53:55.144935+0000","last_peered":"2023-12-16T01:53:55.144935+0000","last_clean":"2023-12-16T01:53:55.144935+0000","last_became_active":"2023-12-16T01:25:49.152355+0000","last_became_peered":"2023-12-16T01:25:49.152355+0000","last_unstale":"2023-12-16T01:53:55.144935+0000","last_undegraded":"2023-12-16T01:53:55.144935+0000","last_fullsized":"2023-12-16T01:53:55.144935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:55.144831+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.144831+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:38.126196+0000","scrub_duration":0.001096376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.254191+0000","last_change":"2023-12-16T01:53:59.254191+0000","last_active":"2023-12-16T01:53:59.254191+0000","last_peered":"2023-12-16T01:53:59.254191+0000","last_clean":"2023-12-16T01:53:59.254191+0000","last_became_active":"2023-12-16T01:25:47.876164+0000","last_became_peered":"2023-12-16T01:25:47.876164+0000","last_unstale":"2023-12-16T01:53:59.254191+0000","last_undegraded":"2023-12-16T01:53:59.254191+0000","last_fullsized":"2023-12-16T01:53:59.254191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:59.254108+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.254108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:34:27.903270+0000","scrub_duration":0.0011951380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'144","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.635697+0000","last_change":"2023-12-16T01:54:14.635718+0000","last_active":"2023-12-16T01:54:14.635697+0000","last_peered":"2023-12-16T01:54:14.635697+0000","last_clean":"2023-12-16T01:54:14.635697+0000","last_became_active":"2023-12-16T01:25:54.984742+0000","last_became_peered":"2023-12-16T01:25:54.984742+0000","last_unstale":"2023-12-16T01:54:14.635697+0000","last_undegraded":"2023-12-16T01:54:14.635697+0000","last_fullsized":"2023-12-16T01:54:14.635697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-12-16T01:54:14.635626+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-12-16T01:54:14.635626+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.635626+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:40.970137+0000","scrub_duration":0.0014828199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'40","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.116021+0000","last_change":"2023-12-16T01:54:23.116021+0000","last_active":"2023-12-16T01:54:23.116021+0000","last_peered":"2023-12-16T01:54:23.116021+0000","last_clean":"2023-12-16T01:54:23.116021+0000","last_became_active":"2023-12-16T01:25:49.147062+0000","last_became_peered":"2023-12-16T01:25:49.147062+0000","last_unstale":"2023-12-16T01:54:23.116021+0000","last_undegraded":"2023-12-16T01:54:23.116021+0000","last_fullsized":"2023-12-16T01:54:23.116021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'40","last_scrub_stamp":"2023-12-16T01:54:23.115940+0000","last_deep_scrub":"28'40","last_deep_scrub_stamp":"2023-12-16T01:54:23.115940+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.115940+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:16.903903+0000","scrub_duration":0.0015752660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.017355+0000","last_change":"2023-12-16T01:53:58.017355+0000","last_active":"2023-12-16T01:53:58.017355+0000","last_peered":"2023-12-16T01:53:58.017355+0000","last_clean":"2023-12-16T01:53:58.017355+0000","last_became_active":"2023-12-16T01:25:47.899186+0000","last_became_peered":"2023-12-16T01:25:47.899186+0000","last_unstale":"2023-12-16T01:53:58.017355+0000","last_undegraded":"2023-12-16T01:53:58.017355+0000","last_fullsized":"2023-12-16T01:53:58.017355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:53:58.017183+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.017183+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:25.445654+0000","scrub_duration":0.0031128100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'190","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:31.097154+0000","last_change":"2023-12-16T01:54:31.097173+0000","last_active":"2023-12-16T01:54:31.097154+0000","last_peered":"2023-12-16T01:54:31.097154+0000","last_clean":"2023-12-16T01:54:31.097154+0000","last_became_active":"2023-12-16T01:25:54.981213+0000","last_became_peered":"2023-12-16T01:25:54.981213+0000","last_unstale":"2023-12-16T01:54:31.097154+0000","last_undegraded":"2023-12-16T01:54:31.097154+0000","last_fullsized":"2023-12-16T01:54:31.097154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2023-12-16T01:54:31.097084+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2023-12-16T01:54:31.097084+0000","last_clean_scrub_stamp":"2023-12-16T01:54:31.097084+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:34.785799+0000","scrub_duration":0.00157708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":10762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'36","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:11.105131+0000","last_change":"2023-12-16T01:54:11.105131+0000","last_active":"2023-12-16T01:54:11.105131+0000","last_peered":"2023-12-16T01:54:11.105131+0000","last_clean":"2023-12-16T01:54:11.105131+0000","last_became_active":"2023-12-16T01:25:49.140527+0000","last_became_peered":"2023-12-16T01:25:49.140527+0000","last_unstale":"2023-12-16T01:54:11.105131+0000","last_undegraded":"2023-12-16T01:54:11.105131+0000","last_fullsized":"2023-12-16T01:54:11.105131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:11.105021+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:11.105021+0000","last_clean_scrub_stamp":"2023-12-16T01:54:11.105021+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:40.102768+0000","scrub_duration":0.001124416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:04.801704+0000","last_change":"2023-12-16T01:54:04.801704+0000","last_active":"2023-12-16T01:54:04.801704+0000","last_peered":"2023-12-16T01:54:04.801704+0000","last_clean":"2023-12-16T01:54:04.801704+0000","last_became_active":"2023-12-16T01:25:47.899622+0000","last_became_peered":"2023-12-16T01:25:47.899622+0000","last_unstale":"2023-12-16T01:54:04.801704+0000","last_undegraded":"2023-12-16T01:54:04.801704+0000","last_fullsized":"2023-12-16T01:54:04.801704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:54:04.801617+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:54:04.801617+0000","last_clean_scrub_stamp":"2023-12-16T01:54:04.801617+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:23.871220+0000","scrub_duration":0.0017376620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'133","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:45.225668+0000","last_change":"2023-12-16T01:54:45.225692+0000","last_active":"2023-12-16T01:54:45.225668+0000","last_peered":"2023-12-16T01:54:45.225668+0000","last_clean":"2023-12-16T01:54:45.225668+0000","last_became_active":"2023-12-16T01:25:54.984811+0000","last_became_peered":"2023-12-16T01:25:54.984811+0000","last_unstale":"2023-12-16T01:54:45.225668+0000","last_undegraded":"2023-12-16T01:54:45.225668+0000","last_fullsized":"2023-12-16T01:54:45.225668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'133","last_scrub_stamp":"2023-12-16T01:54:45.225583+0000","last_deep_scrub":"28'133","last_deep_scrub_stamp":"2023-12-16T01:54:45.225583+0000","last_clean_scrub_stamp":"2023-12-16T01:54:45.225583+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:03:45.336405+0000","scrub_duration":0.0022368370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.720697+0000","last_change":"2023-12-16T01:53:56.720697+0000","last_active":"2023-12-16T01:53:56.720697+0000","last_peered":"2023-12-16T01:53:56.720697+0000","last_clean":"2023-12-16T01:53:56.720697+0000","last_became_active":"2023-12-16T01:25:49.146429+0000","last_became_peered":"2023-12-16T01:25:49.146429+0000","last_unstale":"2023-12-16T01:53:56.720697+0000","last_undegraded":"2023-12-16T01:53:56.720697+0000","last_fullsized":"2023-12-16T01:53:56.720697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2023-12-16T01:53:56.720597+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.720597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:33.671876+0000","scrub_duration":0.0010248239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.064453+0000","last_change":"2023-12-16T01:53:56.064453+0000","last_active":"2023-12-16T01:53:56.064453+0000","last_peered":"2023-12-16T01:53:56.064453+0000","last_clean":"2023-12-16T01:53:56.064453+0000","last_became_active":"2023-12-16T01:25:47.899424+0000","last_became_peered":"2023-12-16T01:25:47.899424+0000","last_unstale":"2023-12-16T01:53:56.064453+0000","last_undegraded":"2023-12-16T01:53:56.064453+0000","last_fullsized":"2023-12-16T01:53:56.064453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-12-16T01:53:56.064317+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.064317+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:54.927425+0000","scrub_duration":0.0028072420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'173","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.827344+0000","last_change":"2023-12-16T01:54:03.827344+0000","last_active":"2023-12-16T01:54:03.827344+0000","last_peered":"2023-12-16T01:54:03.827344+0000","last_clean":"2023-12-16T01:54:03.827344+0000","last_became_active":"2023-12-16T01:25:54.981944+0000","last_became_peered":"2023-12-16T01:25:54.981944+0000","last_unstale":"2023-12-16T01:54:03.827344+0000","last_undegraded":"2023-12-16T01:54:03.827344+0000","last_fullsized":"2023-12-16T01:54:03.827344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-12-16T01:54:03.827247+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.827247+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:04.241218+0000","scrub_duration":0.001453356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.124361+0000","last_change":"2023-12-16T01:53:54.124381+0000","last_active":"2023-12-16T01:53:54.124361+0000","last_peered":"2023-12-16T01:53:54.124361+0000","last_clean":"2023-12-16T01:53:54.124361+0000","last_became_active":"2023-12-16T01:25:49.153080+0000","last_became_peered":"2023-12-16T01:25:49.153080+0000","last_unstale":"2023-12-16T01:53:54.124361+0000","last_undegraded":"2023-12-16T01:53:54.124361+0000","last_fullsized":"2023-12-16T01:53:54.124361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:54.124293+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.124293+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:11.195283+0000","scrub_duration":0.00092168199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:57.759978+0000","last_change":"2023-12-16T01:53:57.760032+0000","last_active":"2023-12-16T01:53:57.759978+0000","last_peered":"2023-12-16T01:53:57.759978+0000","last_clean":"2023-12-16T01:53:57.759978+0000","last_became_active":"2023-12-16T01:25:47.873484+0000","last_became_peered":"2023-12-16T01:25:47.873484+0000","last_unstale":"2023-12-16T01:53:57.759978+0000","last_undegraded":"2023-12-16T01:53:57.759978+0000","last_fullsized":"2023-12-16T01:53:57.759978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-12-16T01:53:57.759893+0000","last_clean_scrub_stamp":"2023-12-16T01:53:57.759893+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:51.550594+0000","scrub_duration":0.0035525439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'142","reported_seq":178,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:34.115717+0000","last_change":"2023-12-16T01:54:34.115717+0000","last_active":"2023-12-16T01:54:34.115717+0000","last_peered":"2023-12-16T01:54:34.115717+0000","last_clean":"2023-12-16T01:54:34.115717+0000","last_became_active":"2023-12-16T01:25:54.979721+0000","last_became_peered":"2023-12-16T01:25:54.979721+0000","last_unstale":"2023-12-16T01:54:34.115717+0000","last_undegraded":"2023-12-16T01:54:34.115717+0000","last_fullsized":"2023-12-16T01:54:34.115717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'142","last_scrub_stamp":"2023-12-16T01:54:34.115621+0000","last_deep_scrub":"28'142","last_deep_scrub_stamp":"2023-12-16T01:54:34.115621+0000","last_clean_scrub_stamp":"2023-12-16T01:54:34.115621+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:27:38.394019+0000","scrub_duration":0.0016162559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'32","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:46.762139+0000","last_change":"2023-12-16T01:53:46.762139+0000","last_active":"2023-12-16T01:53:46.762139+0000","last_peered":"2023-12-16T01:53:46.762139+0000","last_clean":"2023-12-16T01:53:46.762139+0000","last_became_active":"2023-12-16T01:25:49.116779+0000","last_became_peered":"2023-12-16T01:25:49.116779+0000","last_unstale":"2023-12-16T01:53:46.762139+0000","last_undegraded":"2023-12-16T01:53:46.762139+0000","last_fullsized":"2023-12-16T01:53:46.762139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:53:46.762050+0000","last_clean_scrub_stamp":"2023-12-16T01:53:46.762050+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:14:34.070815+0000","scrub_duration":0.00115817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.074927+0000","last_change":"2023-12-16T01:54:00.074946+0000","last_active":"2023-12-16T01:54:00.074927+0000","last_peered":"2023-12-16T01:54:00.074927+0000","last_clean":"2023-12-16T01:54:00.074927+0000","last_became_active":"2023-12-16T01:25:47.893041+0000","last_became_peered":"2023-12-16T01:25:47.893041+0000","last_unstale":"2023-12-16T01:54:00.074927+0000","last_undegraded":"2023-12-16T01:54:00.074927+0000","last_fullsized":"2023-12-16T01:54:00.074927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2023-12-16T01:54:00.074849+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.074849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:46:07.538136+0000","scrub_duration":0.0010289749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'140","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:36.198866+0000","last_change":"2023-12-16T01:54:36.198866+0000","last_active":"2023-12-16T01:54:36.198866+0000","last_peered":"2023-12-16T01:54:36.198866+0000","last_clean":"2023-12-16T01:54:36.198866+0000","last_became_active":"2023-12-16T01:25:54.984088+0000","last_became_peered":"2023-12-16T01:25:54.984088+0000","last_unstale":"2023-12-16T01:54:36.198866+0000","last_undegraded":"2023-12-16T01:54:36.198866+0000","last_fullsized":"2023-12-16T01:54:36.198866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'140","last_scrub_stamp":"2023-12-16T01:54:36.198782+0000","last_deep_scrub":"28'140","last_deep_scrub_stamp":"2023-12-16T01:54:36.198782+0000","last_clean_scrub_stamp":"2023-12-16T01:54:36.198782+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:17.696206+0000","scrub_duration":0.0014315980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":5347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'49","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:08.113069+0000","last_change":"2023-12-16T01:54:08.113087+0000","last_active":"2023-12-16T01:54:08.113069+0000","last_peered":"2023-12-16T01:54:08.113069+0000","last_clean":"2023-12-16T01:54:08.113069+0000","last_became_active":"2023-12-16T01:25:49.155120+0000","last_became_peered":"2023-12-16T01:25:49.155120+0000","last_unstale":"2023-12-16T01:54:08.113069+0000","last_undegraded":"2023-12-16T01:54:08.113069+0000","last_fullsized":"2023-12-16T01:54:08.113069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:54:08.113001+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:54:08.113001+0000","last_clean_scrub_stamp":"2023-12-16T01:54:08.113001+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:45.839952+0000","scrub_duration":0.00083020499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.216961+0000","last_change":"2023-12-16T01:54:14.216995+0000","last_active":"2023-12-16T01:54:14.216961+0000","last_peered":"2023-12-16T01:54:14.216961+0000","last_clean":"2023-12-16T01:54:14.216961+0000","last_became_active":"2023-12-16T01:25:47.896181+0000","last_became_peered":"2023-12-16T01:25:47.896181+0000","last_unstale":"2023-12-16T01:54:14.216961+0000","last_undegraded":"2023-12-16T01:54:14.216961+0000","last_fullsized":"2023-12-16T01:54:14.216961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-12-16T01:54:14.216870+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-12-16T01:54:14.216870+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.216870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:09.912524+0000","scrub_duration":0.00133464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'120","reported_seq":156,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:38.139806+0000","last_change":"2023-12-16T01:54:38.139827+0000","last_active":"2023-12-16T01:54:38.139806+0000","last_peered":"2023-12-16T01:54:38.139806+0000","last_clean":"2023-12-16T01:54:38.139806+0000","last_became_active":"2023-12-16T01:25:54.989189+0000","last_became_peered":"2023-12-16T01:25:54.989189+0000","last_unstale":"2023-12-16T01:54:38.139806+0000","last_undegraded":"2023-12-16T01:54:38.139806+0000","last_fullsized":"2023-12-16T01:54:38.139806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'120","last_scrub_stamp":"2023-12-16T01:54:38.139727+0000","last_deep_scrub":"28'120","last_deep_scrub_stamp":"2023-12-16T01:54:38.139727+0000","last_clean_scrub_stamp":"2023-12-16T01:54:38.139727+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:36.230355+0000","scrub_duration":0.001376078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'45","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:10.184221+0000","last_change":"2023-12-16T01:54:10.184243+0000","last_active":"2023-12-16T01:54:10.184221+0000","last_peered":"2023-12-16T01:54:10.184221+0000","last_clean":"2023-12-16T01:54:10.184221+0000","last_became_active":"2023-12-16T01:25:49.154045+0000","last_became_peered":"2023-12-16T01:25:49.154045+0000","last_unstale":"2023-12-16T01:54:10.184221+0000","last_undegraded":"2023-12-16T01:54:10.184221+0000","last_fullsized":"2023-12-16T01:54:10.184221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:10.184147+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:10.184147+0000","last_clean_scrub_stamp":"2023-12-16T01:54:10.184147+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.454836+0000","scrub_duration":0.0012486699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'305","reported_seq":345,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.287784+0000","last_change":"2023-12-16T01:53:54.287821+0000","last_active":"2023-12-16T01:53:54.287784+0000","last_peered":"2023-12-16T01:53:54.287784+0000","last_clean":"2023-12-16T01:53:54.287784+0000","last_became_active":"2023-12-16T01:25:47.876112+0000","last_became_peered":"2023-12-16T01:25:47.876112+0000","last_unstale":"2023-12-16T01:53:54.287784+0000","last_undegraded":"2023-12-16T01:53:54.287784+0000","last_fullsized":"2023-12-16T01:53:54.287784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'305","last_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_deep_scrub":"28'305","last_deep_scrub_stamp":"2023-12-16T01:53:54.287730+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.287730+0000","objects_scrubbed":3,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:54.985981+0000","scrub_duration":0.0098894640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713270,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'139","reported_seq":175,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:51.252223+0000","last_change":"2023-12-16T01:54:51.252223+0000","last_active":"2023-12-16T01:54:51.252223+0000","last_peered":"2023-12-16T01:54:51.252223+0000","last_clean":"2023-12-16T01:54:51.252223+0000","last_became_active":"2023-12-16T01:25:54.990821+0000","last_became_peered":"2023-12-16T01:25:54.990821+0000","last_unstale":"2023-12-16T01:54:51.252223+0000","last_undegraded":"2023-12-16T01:54:51.252223+0000","last_fullsized":"2023-12-16T01:54:51.252223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'139","last_scrub_stamp":"2023-12-16T01:54:51.252137+0000","last_deep_scrub":"28'139","last_deep_scrub_stamp":"2023-12-16T01:54:51.252137+0000","last_clean_scrub_stamp":"2023-12-16T01:54:51.252137+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:15:51.277081+0000","scrub_duration":0.001692701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.122671+0000","last_change":"2023-12-16T01:53:53.122671+0000","last_active":"2023-12-16T01:53:53.122671+0000","last_peered":"2023-12-16T01:53:53.122671+0000","last_clean":"2023-12-16T01:53:53.122671+0000","last_became_active":"2023-12-16T01:25:49.146013+0000","last_became_peered":"2023-12-16T01:25:49.146013+0000","last_unstale":"2023-12-16T01:53:53.122671+0000","last_undegraded":"2023-12-16T01:53:53.122671+0000","last_fullsized":"2023-12-16T01:53:53.122671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:53.122566+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.122566+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:09.183578+0000","scrub_duration":0.0013206579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'862","reported_seq":902,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:48.890311+0000","last_change":"2023-12-16T01:53:48.890311+0000","last_active":"2023-12-16T01:53:48.890311+0000","last_peered":"2023-12-16T01:53:48.890311+0000","last_clean":"2023-12-16T01:53:48.890311+0000","last_became_active":"2023-12-16T01:25:47.852545+0000","last_became_peered":"2023-12-16T01:25:47.852545+0000","last_unstale":"2023-12-16T01:53:48.890311+0000","last_undegraded":"2023-12-16T01:53:48.890311+0000","last_fullsized":"2023-12-16T01:53:48.890311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'862","last_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_deep_scrub":"28'862","last_deep_scrub_stamp":"2023-12-16T01:53:48.890224+0000","last_clean_scrub_stamp":"2023-12-16T01:53:48.890224+0000","objects_scrubbed":4,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:27.964886+0000","scrub_duration":0.017688373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":4556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'135","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:33.041556+0000","last_change":"2023-12-16T01:54:33.041604+0000","last_active":"2023-12-16T01:54:33.041556+0000","last_peered":"2023-12-16T01:54:33.041556+0000","last_clean":"2023-12-16T01:54:33.041556+0000","last_became_active":"2023-12-16T01:25:54.987685+0000","last_became_peered":"2023-12-16T01:25:54.987685+0000","last_unstale":"2023-12-16T01:54:33.041556+0000","last_undegraded":"2023-12-16T01:54:33.041556+0000","last_fullsized":"2023-12-16T01:54:33.041556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-12-16T01:54:33.041464+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-12-16T01:54:33.041464+0000","last_clean_scrub_stamp":"2023-12-16T01:54:33.041464+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:25:04.679721+0000","scrub_duration":0.0019089549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":8050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'34","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.035555+0000","last_change":"2023-12-16T01:53:50.035555+0000","last_active":"2023-12-16T01:53:50.035555+0000","last_peered":"2023-12-16T01:53:50.035555+0000","last_clean":"2023-12-16T01:53:50.035555+0000","last_became_active":"2023-12-16T01:25:49.152258+0000","last_became_peered":"2023-12-16T01:25:49.152258+0000","last_unstale":"2023-12-16T01:53:50.035555+0000","last_undegraded":"2023-12-16T01:53:50.035555+0000","last_fullsized":"2023-12-16T01:53:50.035555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:53:50.035441+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.035441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:24:50.625126+0000","scrub_duration":0.000932255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'733","reported_seq":773,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:55.268530+0000","last_change":"2023-12-16T01:53:55.268530+0000","last_active":"2023-12-16T01:53:55.268530+0000","last_peered":"2023-12-16T01:53:55.268530+0000","last_clean":"2023-12-16T01:53:55.268530+0000","last_became_active":"2023-12-16T01:25:47.874943+0000","last_became_peered":"2023-12-16T01:25:47.874943+0000","last_unstale":"2023-12-16T01:53:55.268530+0000","last_undegraded":"2023-12-16T01:53:55.268530+0000","last_fullsized":"2023-12-16T01:53:55.268530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'733","last_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_deep_scrub":"28'733","last_deep_scrub_stamp":"2023-12-16T01:53:55.268403+0000","last_clean_scrub_stamp":"2023-12-16T01:53:55.268403+0000","objects_scrubbed":2,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:47.666935+0000","scrub_duration":0.0025599799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'148","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.731713+0000","last_change":"2023-12-16T01:54:23.731732+0000","last_active":"2023-12-16T01:54:23.731713+0000","last_peered":"2023-12-16T01:54:23.731713+0000","last_clean":"2023-12-16T01:54:23.731713+0000","last_became_active":"2023-12-16T01:25:54.982909+0000","last_became_peered":"2023-12-16T01:25:54.982909+0000","last_unstale":"2023-12-16T01:54:23.731713+0000","last_undegraded":"2023-12-16T01:54:23.731713+0000","last_fullsized":"2023-12-16T01:54:23.731713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'148","last_scrub_stamp":"2023-12-16T01:54:23.731645+0000","last_deep_scrub":"28'148","last_deep_scrub_stamp":"2023-12-16T01:54:23.731645+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.731645+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:22:12.153494+0000","scrub_duration":0.0015408500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":23156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'38","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.036067+0000","last_change":"2023-12-16T01:54:14.036119+0000","last_active":"2023-12-16T01:54:14.036067+0000","last_peered":"2023-12-16T01:54:14.036067+0000","last_clean":"2023-12-16T01:54:14.036067+0000","last_became_active":"2023-12-16T01:25:49.153508+0000","last_became_peered":"2023-12-16T01:25:49.153508+0000","last_unstale":"2023-12-16T01:54:14.036067+0000","last_undegraded":"2023-12-16T01:54:14.036067+0000","last_fullsized":"2023-12-16T01:54:14.036067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:54:14.035948+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:54:14.035948+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.035948+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:51.762899+0000","scrub_duration":0.0012783219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.107532+0000","last_change":"2023-12-16T01:53:54.107532+0000","last_active":"2023-12-16T01:53:54.107532+0000","last_peered":"2023-12-16T01:53:54.107532+0000","last_clean":"2023-12-16T01:53:54.107532+0000","last_became_active":"2023-12-16T01:25:47.874385+0000","last_became_peered":"2023-12-16T01:25:47.874385+0000","last_unstale":"2023-12-16T01:53:54.107532+0000","last_undegraded":"2023-12-16T01:53:54.107532+0000","last_fullsized":"2023-12-16T01:53:54.107532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-12-16T01:53:54.107444+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.107444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:13.177048+0000","scrub_duration":0.0010581900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.351537+0000","last_change":"2023-12-16T01:54:02.351560+0000","last_active":"2023-12-16T01:54:02.351537+0000","last_peered":"2023-12-16T01:54:02.351537+0000","last_clean":"2023-12-16T01:54:02.351537+0000","last_became_active":"2023-12-16T01:25:54.984079+0000","last_became_peered":"2023-12-16T01:25:54.984079+0000","last_unstale":"2023-12-16T01:54:02.351537+0000","last_undegraded":"2023-12-16T01:54:02.351537+0000","last_fullsized":"2023-12-16T01:54:02.351537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-12-16T01:54:02.351459+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.351459+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:39.889377+0000","scrub_duration":0.0017115850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":14103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'42","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.737430+0000","last_change":"2023-12-16T01:54:00.737430+0000","last_active":"2023-12-16T01:54:00.737430+0000","last_peered":"2023-12-16T01:54:00.737430+0000","last_clean":"2023-12-16T01:54:00.737430+0000","last_became_active":"2023-12-16T01:25:49.153859+0000","last_became_peered":"2023-12-16T01:25:49.153859+0000","last_unstale":"2023-12-16T01:54:00.737430+0000","last_undegraded":"2023-12-16T01:54:00.737430+0000","last_fullsized":"2023-12-16T01:54:00.737430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:00.737350+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.737350+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:56.008039+0000","scrub_duration":0.000879626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:45.810944+0000","last_change":"2023-12-16T01:53:45.810944+0000","last_active":"2023-12-16T01:53:45.810944+0000","last_peered":"2023-12-16T01:53:45.810944+0000","last_clean":"2023-12-16T01:53:45.810944+0000","last_became_active":"2023-12-16T01:25:47.874395+0000","last_became_peered":"2023-12-16T01:25:47.874395+0000","last_unstale":"2023-12-16T01:53:45.810944+0000","last_undegraded":"2023-12-16T01:53:45.810944+0000","last_fullsized":"2023-12-16T01:53:45.810944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-12-16T01:53:45.810796+0000","last_clean_scrub_stamp":"2023-12-16T01:53:45.810796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:43:50.027324+0000","scrub_duration":0.0012633939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'162","reported_seq":198,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:35.085529+0000","last_change":"2023-12-16T01:54:35.085567+0000","last_active":"2023-12-16T01:54:35.085529+0000","last_peered":"2023-12-16T01:54:35.085529+0000","last_clean":"2023-12-16T01:54:35.085529+0000","last_became_active":"2023-12-16T01:25:54.987908+0000","last_became_peered":"2023-12-16T01:25:54.987908+0000","last_unstale":"2023-12-16T01:54:35.085529+0000","last_undegraded":"2023-12-16T01:54:35.085529+0000","last_fullsized":"2023-12-16T01:54:35.085529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'162","last_scrub_stamp":"2023-12-16T01:54:35.085450+0000","last_deep_scrub":"28'162","last_deep_scrub_stamp":"2023-12-16T01:54:35.085450+0000","last_clean_scrub_stamp":"2023-12-16T01:54:35.085450+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:30:32.243191+0000","scrub_duration":0.0015581519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":7428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'137","reported_seq":175,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:29.005815+0000","last_change":"2023-12-16T01:54:29.005838+0000","last_active":"2023-12-16T01:54:29.005815+0000","last_peered":"2023-12-16T01:54:29.005815+0000","last_clean":"2023-12-16T01:54:29.005815+0000","last_became_active":"2023-12-16T01:25:54.979508+0000","last_became_peered":"2023-12-16T01:25:54.979508+0000","last_unstale":"2023-12-16T01:54:29.005815+0000","last_undegraded":"2023-12-16T01:54:29.005815+0000","last_fullsized":"2023-12-16T01:54:29.005815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'137","last_scrub_stamp":"2023-12-16T01:54:29.005727+0000","last_deep_scrub":"28'137","last_deep_scrub_stamp":"2023-12-16T01:54:29.005727+0000","last_clean_scrub_stamp":"2023-12-16T01:54:29.005727+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:27.096355+0000","scrub_duration":0.0015835980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":11366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'42","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:23.939220+0000","last_change":"2023-12-16T01:54:23.939220+0000","last_active":"2023-12-16T01:54:23.939220+0000","last_peered":"2023-12-16T01:54:23.939220+0000","last_clean":"2023-12-16T01:54:23.939220+0000","last_became_active":"2023-12-16T01:25:49.117488+0000","last_became_peered":"2023-12-16T01:25:49.117488+0000","last_unstale":"2023-12-16T01:54:23.939220+0000","last_undegraded":"2023-12-16T01:54:23.939220+0000","last_fullsized":"2023-12-16T01:54:23.939220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:23.939133+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:23.939133+0000","last_clean_scrub_stamp":"2023-12-16T01:54:23.939133+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:09.037341+0000","scrub_duration":0.0012202879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.186390+0000","last_change":"2023-12-16T01:54:16.186390+0000","last_active":"2023-12-16T01:54:16.186390+0000","last_peered":"2023-12-16T01:54:16.186390+0000","last_clean":"2023-12-16T01:54:16.186390+0000","last_became_active":"2023-12-16T01:25:47.894300+0000","last_became_peered":"2023-12-16T01:25:47.894300+0000","last_unstale":"2023-12-16T01:54:16.186390+0000","last_undegraded":"2023-12-16T01:54:16.186390+0000","last_fullsized":"2023-12-16T01:54:16.186390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:54:16.186244+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:54:16.186244+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.186244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:30.603337+0000","scrub_duration":0.0012334049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'153","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:36.179471+0000","last_change":"2023-12-16T01:54:36.179495+0000","last_active":"2023-12-16T01:54:36.179471+0000","last_peered":"2023-12-16T01:54:36.179471+0000","last_clean":"2023-12-16T01:54:36.179471+0000","last_became_active":"2023-12-16T01:26:31.583185+0000","last_became_peered":"2023-12-16T01:26:31.583185+0000","last_unstale":"2023-12-16T01:54:36.179471+0000","last_undegraded":"2023-12-16T01:54:36.179471+0000","last_fullsized":"2023-12-16T01:54:36.179471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'153","last_scrub_stamp":"2023-12-16T01:54:36.179397+0000","last_deep_scrub":"28'153","last_deep_scrub_stamp":"2023-12-16T01:54:36.179397+0000","last_clean_scrub_stamp":"2023-12-16T01:54:36.179397+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:03:29.254993+0000","scrub_duration":0.001440057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":18599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"28'43","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:54.030017+0000","last_change":"2023-12-16T01:53:54.030017+0000","last_active":"2023-12-16T01:53:54.030017+0000","last_peered":"2023-12-16T01:53:54.030017+0000","last_clean":"2023-12-16T01:53:54.030017+0000","last_became_active":"2023-12-16T01:25:49.114463+0000","last_became_peered":"2023-12-16T01:25:49.114463+0000","last_unstale":"2023-12-16T01:53:54.030017+0000","last_undegraded":"2023-12-16T01:53:54.030017+0000","last_fullsized":"2023-12-16T01:53:54.030017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:54.029929+0000","last_clean_scrub_stamp":"2023-12-16T01:53:54.029929+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:00.181539+0000","scrub_duration":0.0010094170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:56.153566+0000","last_change":"2023-12-16T01:53:56.153566+0000","last_active":"2023-12-16T01:53:56.153566+0000","last_peered":"2023-12-16T01:53:56.153566+0000","last_clean":"2023-12-16T01:53:56.153566+0000","last_became_active":"2023-12-16T01:25:47.876137+0000","last_became_peered":"2023-12-16T01:25:47.876137+0000","last_unstale":"2023-12-16T01:53:56.153566+0000","last_undegraded":"2023-12-16T01:53:56.153566+0000","last_fullsized":"2023-12-16T01:53:56.153566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-12-16T01:53:56.153447+0000","last_clean_scrub_stamp":"2023-12-16T01:53:56.153447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:39.166123+0000","scrub_duration":0.0013686760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'707","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:27.187301+0000","last_change":"2023-12-16T01:54:27.187324+0000","last_active":"2023-12-16T01:54:27.187301+0000","last_peered":"2023-12-16T01:54:27.187301+0000","last_clean":"2023-12-16T01:54:27.187301+0000","last_became_active":"2023-12-16T01:25:47.897197+0000","last_became_peered":"2023-12-16T01:25:47.897197+0000","last_unstale":"2023-12-16T01:54:27.187301+0000","last_undegraded":"2023-12-16T01:54:27.187301+0000","last_fullsized":"2023-12-16T01:54:27.187301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'707","last_scrub_stamp":"2023-12-16T01:54:27.187241+0000","last_deep_scrub":"28'707","last_deep_scrub_stamp":"2023-12-16T01:54:27.187241+0000","last_clean_scrub_stamp":"2023-12-16T01:54:27.187241+0000","objects_scrubbed":1,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:47.914075+0000","scrub_duration":0.016851775999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":4458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:21.905334+0000","last_change":"2023-12-16T01:54:21.905369+0000","last_active":"2023-12-16T01:54:21.905334+0000","last_peered":"2023-12-16T01:54:21.905334+0000","last_clean":"2023-12-16T01:54:21.905334+0000","last_became_active":"2023-12-16T01:25:49.146243+0000","last_became_peered":"2023-12-16T01:25:49.146243+0000","last_unstale":"2023-12-16T01:54:21.905334+0000","last_undegraded":"2023-12-16T01:54:21.905334+0000","last_fullsized":"2023-12-16T01:54:21.905334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:21.905235+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:21.905235+0000","last_clean_scrub_stamp":"2023-12-16T01:54:21.905235+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:40.148671+0000","scrub_duration":0.001311701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'85","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.014874+0000","last_change":"2023-12-16T01:54:26.014895+0000","last_active":"2023-12-16T01:54:26.014874+0000","last_peered":"2023-12-16T01:54:26.014874+0000","last_clean":"2023-12-16T01:54:26.014874+0000","last_became_active":"2023-12-16T01:26:31.583062+0000","last_became_peered":"2023-12-16T01:26:31.583062+0000","last_unstale":"2023-12-16T01:54:26.014874+0000","last_undegraded":"2023-12-16T01:54:26.014874+0000","last_fullsized":"2023-12-16T01:54:26.014874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-12-16T01:54:26.014808+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-12-16T01:54:26.014808+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.014808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:48.064294+0000","scrub_duration":0.0014740300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'708","reported_seq":746,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:00.044464+0000","last_change":"2023-12-16T01:54:00.044489+0000","last_active":"2023-12-16T01:54:00.044464+0000","last_peered":"2023-12-16T01:54:00.044464+0000","last_clean":"2023-12-16T01:54:00.044464+0000","last_became_active":"2023-12-16T01:25:47.899222+0000","last_became_peered":"2023-12-16T01:25:47.899222+0000","last_unstale":"2023-12-16T01:54:00.044464+0000","last_undegraded":"2023-12-16T01:54:00.044464+0000","last_fullsized":"2023-12-16T01:54:00.044464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'708","last_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_deep_scrub":"28'708","last_deep_scrub_stamp":"2023-12-16T01:54:00.044392+0000","last_clean_scrub_stamp":"2023-12-16T01:54:00.044392+0000","objects_scrubbed":1,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:00.634076+0000","scrub_duration":0.015574605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":4449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'31","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.819424+0000","last_change":"2023-12-16T01:53:50.819445+0000","last_active":"2023-12-16T01:53:50.819424+0000","last_peered":"2023-12-16T01:53:50.819424+0000","last_clean":"2023-12-16T01:53:50.819424+0000","last_became_active":"2023-12-16T01:25:49.116765+0000","last_became_peered":"2023-12-16T01:25:49.116765+0000","last_unstale":"2023-12-16T01:53:50.819424+0000","last_undegraded":"2023-12-16T01:53:50.819424+0000","last_fullsized":"2023-12-16T01:53:50.819424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'31","last_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_deep_scrub":"28'31","last_deep_scrub_stamp":"2023-12-16T01:53:50.819349+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.819349+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:06:25.110184+0000","scrub_duration":0.0014030030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'168","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:10.424844+0000","last_change":"2023-12-16T01:54:10.424867+0000","last_active":"2023-12-16T01:54:10.424844+0000","last_peered":"2023-12-16T01:54:10.424844+0000","last_clean":"2023-12-16T01:54:10.424844+0000","last_became_active":"2023-12-16T01:25:54.987736+0000","last_became_peered":"2023-12-16T01:25:54.987736+0000","last_unstale":"2023-12-16T01:54:10.424844+0000","last_undegraded":"2023-12-16T01:54:10.424844+0000","last_fullsized":"2023-12-16T01:54:10.424844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'168","last_scrub_stamp":"2023-12-16T01:54:10.424760+0000","last_deep_scrub":"28'168","last_deep_scrub_stamp":"2023-12-16T01:54:10.424760+0000","last_clean_scrub_stamp":"2023-12-16T01:54:10.424760+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:30:04.215461+0000","scrub_duration":0.001768616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":11488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'51","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:49.853662+0000","last_change":"2023-12-16T01:53:49.853662+0000","last_active":"2023-12-16T01:53:49.853662+0000","last_peered":"2023-12-16T01:53:49.853662+0000","last_clean":"2023-12-16T01:53:49.853662+0000","last_became_active":"2023-12-16T01:25:49.115989+0000","last_became_peered":"2023-12-16T01:25:49.115989+0000","last_unstale":"2023-12-16T01:53:49.853662+0000","last_undegraded":"2023-12-16T01:53:49.853662+0000","last_fullsized":"2023-12-16T01:53:49.853662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:49.853560+0000","last_clean_scrub_stamp":"2023-12-16T01:53:49.853560+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:47.856024+0000","scrub_duration":0.001387723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'50","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:58.335995+0000","last_change":"2023-12-16T01:53:58.335995+0000","last_active":"2023-12-16T01:53:58.335995+0000","last_peered":"2023-12-16T01:53:58.335995+0000","last_clean":"2023-12-16T01:53:58.335995+0000","last_became_active":"2023-12-16T01:25:49.124135+0000","last_became_peered":"2023-12-16T01:25:49.124135+0000","last_unstale":"2023-12-16T01:53:58.335995+0000","last_undegraded":"2023-12-16T01:53:58.335995+0000","last_fullsized":"2023-12-16T01:53:58.335995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'50","last_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_deep_scrub":"28'50","last_deep_scrub_stamp":"2023-12-16T01:53:58.335879+0000","last_clean_scrub_stamp":"2023-12-16T01:53:58.335879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:56.338342+0000","scrub_duration":0.001381522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'49","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:35.178224+0000","last_change":"2023-12-16T01:54:35.178224+0000","last_active":"2023-12-16T01:54:35.178224+0000","last_peered":"2023-12-16T01:54:35.178224+0000","last_clean":"2023-12-16T01:54:35.178224+0000","last_became_active":"2023-12-16T01:25:49.153454+0000","last_became_peered":"2023-12-16T01:25:49.153454+0000","last_unstale":"2023-12-16T01:54:35.178224+0000","last_undegraded":"2023-12-16T01:54:35.178224+0000","last_fullsized":"2023-12-16T01:54:35.178224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:54:35.178135+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:54:35.178135+0000","last_clean_scrub_stamp":"2023-12-16T01:54:35.178135+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:28:58.084322+0000","scrub_duration":0.0011163779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'38","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.044369+0000","last_change":"2023-12-16T01:53:50.044369+0000","last_active":"2023-12-16T01:53:50.044369+0000","last_peered":"2023-12-16T01:53:50.044369+0000","last_clean":"2023-12-16T01:53:50.044369+0000","last_became_active":"2023-12-16T01:25:49.120473+0000","last_became_peered":"2023-12-16T01:25:49.120473+0000","last_unstale":"2023-12-16T01:53:50.044369+0000","last_undegraded":"2023-12-16T01:53:50.044369+0000","last_fullsized":"2023-12-16T01:53:50.044369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'38","last_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_deep_scrub":"28'38","last_deep_scrub_stamp":"2023-12-16T01:53:50.044262+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.044262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:27.808420+0000","scrub_duration":0.0011708160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:29.137632+0000","last_change":"2023-12-16T01:54:29.137668+0000","last_active":"2023-12-16T01:54:29.137632+0000","last_peered":"2023-12-16T01:54:29.137632+0000","last_clean":"2023-12-16T01:54:29.137632+0000","last_became_active":"2023-12-16T01:25:49.147533+0000","last_became_peered":"2023-12-16T01:25:49.147533+0000","last_unstale":"2023-12-16T01:54:29.137632+0000","last_undegraded":"2023-12-16T01:54:29.137632+0000","last_fullsized":"2023-12-16T01:54:29.137632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2023-12-16T01:54:29.137515+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2023-12-16T01:54:29.137515+0000","last_clean_scrub_stamp":"2023-12-16T01:54:29.137515+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:34.546688+0000","scrub_duration":0.001102684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'32","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:24.214245+0000","last_change":"2023-12-16T01:54:24.214266+0000","last_active":"2023-12-16T01:54:24.214245+0000","last_peered":"2023-12-16T01:54:24.214245+0000","last_clean":"2023-12-16T01:54:24.214245+0000","last_became_active":"2023-12-16T01:25:49.120482+0000","last_became_peered":"2023-12-16T01:25:49.120482+0000","last_unstale":"2023-12-16T01:54:24.214245+0000","last_undegraded":"2023-12-16T01:54:24.214245+0000","last_fullsized":"2023-12-16T01:54:24.214245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'32","last_scrub_stamp":"2023-12-16T01:54:24.214177+0000","last_deep_scrub":"28'32","last_deep_scrub_stamp":"2023-12-16T01:54:24.214177+0000","last_clean_scrub_stamp":"2023-12-16T01:54:24.214177+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:56:49.729370+0000","scrub_duration":0.0010708530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'45","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:03.620368+0000","last_change":"2023-12-16T01:54:03.620408+0000","last_active":"2023-12-16T01:54:03.620368+0000","last_peered":"2023-12-16T01:54:03.620368+0000","last_clean":"2023-12-16T01:54:03.620368+0000","last_became_active":"2023-12-16T01:25:49.153794+0000","last_became_peered":"2023-12-16T01:25:49.153794+0000","last_unstale":"2023-12-16T01:54:03.620368+0000","last_undegraded":"2023-12-16T01:54:03.620368+0000","last_fullsized":"2023-12-16T01:54:03.620368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'45","last_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_deep_scrub":"28'45","last_deep_scrub_stamp":"2023-12-16T01:54:03.620291+0000","last_clean_scrub_stamp":"2023-12-16T01:54:03.620291+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:15:41.384448+0000","scrub_duration":0.001035563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'35","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:16.046833+0000","last_change":"2023-12-16T01:54:16.046870+0000","last_active":"2023-12-16T01:54:16.046833+0000","last_peered":"2023-12-16T01:54:16.046833+0000","last_clean":"2023-12-16T01:54:16.046833+0000","last_became_active":"2023-12-16T01:25:49.117351+0000","last_became_peered":"2023-12-16T01:25:49.117351+0000","last_unstale":"2023-12-16T01:54:16.046833+0000","last_undegraded":"2023-12-16T01:54:16.046833+0000","last_fullsized":"2023-12-16T01:54:16.046833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2023-12-16T01:54:16.046718+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2023-12-16T01:54:16.046718+0000","last_clean_scrub_stamp":"2023-12-16T01:54:16.046718+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:46.227198+0000","scrub_duration":0.001640655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'34","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.162751+0000","last_change":"2023-12-16T01:54:12.162769+0000","last_active":"2023-12-16T01:54:12.162751+0000","last_peered":"2023-12-16T01:54:12.162751+0000","last_clean":"2023-12-16T01:54:12.162751+0000","last_became_active":"2023-12-16T01:25:49.152371+0000","last_became_peered":"2023-12-16T01:25:49.152371+0000","last_unstale":"2023-12-16T01:54:12.162751+0000","last_undegraded":"2023-12-16T01:54:12.162751+0000","last_fullsized":"2023-12-16T01:54:12.162751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:54:12.162688+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:54:12.162688+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.162688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:05.950652+0000","scrub_duration":0.0011708510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'46","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:09.935603+0000","last_change":"2023-12-16T01:54:09.935603+0000","last_active":"2023-12-16T01:54:09.935603+0000","last_peered":"2023-12-16T01:54:09.935603+0000","last_clean":"2023-12-16T01:54:09.935603+0000","last_became_active":"2023-12-16T01:25:49.117689+0000","last_became_peered":"2023-12-16T01:25:49.117689+0000","last_unstale":"2023-12-16T01:54:09.935603+0000","last_undegraded":"2023-12-16T01:54:09.935603+0000","last_fullsized":"2023-12-16T01:54:09.935603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2023-12-16T01:54:09.935514+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2023-12-16T01:54:09.935514+0000","last_clean_scrub_stamp":"2023-12-16T01:54:09.935514+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:04.544423+0000","scrub_duration":0.001116955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'39","reported_seq":78,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.710514+0000","last_change":"2023-12-16T01:53:59.710514+0000","last_active":"2023-12-16T01:53:59.710514+0000","last_peered":"2023-12-16T01:53:59.710514+0000","last_clean":"2023-12-16T01:53:59.710514+0000","last_became_active":"2023-12-16T01:25:49.147395+0000","last_became_peered":"2023-12-16T01:25:49.147395+0000","last_unstale":"2023-12-16T01:53:59.710514+0000","last_undegraded":"2023-12-16T01:53:59.710514+0000","last_fullsized":"2023-12-16T01:53:59.710514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:53:59.710431+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.710431+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:52.108963+0000","scrub_duration":0.00086866999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'51","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.807889+0000","last_change":"2023-12-16T01:53:47.807889+0000","last_active":"2023-12-16T01:53:47.807889+0000","last_peered":"2023-12-16T01:53:47.807889+0000","last_clean":"2023-12-16T01:53:47.807889+0000","last_became_active":"2023-12-16T01:25:49.116920+0000","last_became_peered":"2023-12-16T01:25:49.116920+0000","last_unstale":"2023-12-16T01:53:47.807889+0000","last_undegraded":"2023-12-16T01:53:47.807889+0000","last_fullsized":"2023-12-16T01:53:47.807889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:53:47.807786+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.807786+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:03.908247+0000","scrub_duration":0.0012442099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'42","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:27.061813+0000","last_change":"2023-12-16T01:54:27.061813+0000","last_active":"2023-12-16T01:54:27.061813+0000","last_peered":"2023-12-16T01:54:27.061813+0000","last_clean":"2023-12-16T01:54:27.061813+0000","last_became_active":"2023-12-16T01:25:49.146240+0000","last_became_peered":"2023-12-16T01:25:49.146240+0000","last_unstale":"2023-12-16T01:54:27.061813+0000","last_undegraded":"2023-12-16T01:54:27.061813+0000","last_fullsized":"2023-12-16T01:54:27.061813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:27.061721+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:27.061721+0000","last_clean_scrub_stamp":"2023-12-16T01:54:27.061721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:57.242202+0000","scrub_duration":0.0011862120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'34","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:32.179743+0000","last_change":"2023-12-16T01:54:32.179743+0000","last_active":"2023-12-16T01:54:32.179743+0000","last_peered":"2023-12-16T01:54:32.179743+0000","last_clean":"2023-12-16T01:54:32.179743+0000","last_became_active":"2023-12-16T01:25:49.153586+0000","last_became_peered":"2023-12-16T01:25:49.153586+0000","last_unstale":"2023-12-16T01:54:32.179743+0000","last_undegraded":"2023-12-16T01:54:32.179743+0000","last_fullsized":"2023-12-16T01:54:32.179743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'34","last_scrub_stamp":"2023-12-16T01:54:32.179619+0000","last_deep_scrub":"28'34","last_deep_scrub_stamp":"2023-12-16T01:54:32.179619+0000","last_clean_scrub_stamp":"2023-12-16T01:54:32.179619+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:29.923594+0000","scrub_duration":0.0012890499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'49","reported_seq":88,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:59.372063+0000","last_change":"2023-12-16T01:53:59.372084+0000","last_active":"2023-12-16T01:53:59.372063+0000","last_peered":"2023-12-16T01:53:59.372063+0000","last_clean":"2023-12-16T01:53:59.372063+0000","last_became_active":"2023-12-16T01:25:49.124086+0000","last_became_peered":"2023-12-16T01:25:49.124086+0000","last_unstale":"2023-12-16T01:53:59.372063+0000","last_undegraded":"2023-12-16T01:53:59.372063+0000","last_fullsized":"2023-12-16T01:53:59.372063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'49","last_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_deep_scrub":"28'49","last_deep_scrub_stamp":"2023-12-16T01:53:59.371983+0000","last_clean_scrub_stamp":"2023-12-16T01:53:59.371983+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:57:27.780046+0000","scrub_duration":0.0014106590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'41","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:53.101807+0000","last_change":"2023-12-16T01:53:53.101827+0000","last_active":"2023-12-16T01:53:53.101807+0000","last_peered":"2023-12-16T01:53:53.101807+0000","last_clean":"2023-12-16T01:53:53.101807+0000","last_became_active":"2023-12-16T01:25:49.155116+0000","last_became_peered":"2023-12-16T01:25:49.155116+0000","last_unstale":"2023-12-16T01:53:53.101807+0000","last_undegraded":"2023-12-16T01:53:53.101807+0000","last_fullsized":"2023-12-16T01:53:53.101807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'41","last_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_deep_scrub":"28'41","last_deep_scrub_stamp":"2023-12-16T01:53:53.101731+0000","last_clean_scrub_stamp":"2023-12-16T01:53:53.101731+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:41.523580+0000","scrub_duration":0.001408493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'46","reported_seq":84,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.189281+0000","last_change":"2023-12-16T01:54:13.189300+0000","last_active":"2023-12-16T01:54:13.189281+0000","last_peered":"2023-12-16T01:54:13.189281+0000","last_clean":"2023-12-16T01:54:13.189281+0000","last_became_active":"2023-12-16T01:25:49.154948+0000","last_became_peered":"2023-12-16T01:25:49.154948+0000","last_unstale":"2023-12-16T01:54:13.189281+0000","last_undegraded":"2023-12-16T01:54:13.189281+0000","last_fullsized":"2023-12-16T01:54:13.189281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'46","last_scrub_stamp":"2023-12-16T01:54:13.189209+0000","last_deep_scrub":"28'46","last_deep_scrub_stamp":"2023-12-16T01:54:13.189209+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.189209+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:48:43.369689+0000","scrub_duration":0.00095558600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'43","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:13.026555+0000","last_change":"2023-12-16T01:54:13.026575+0000","last_active":"2023-12-16T01:54:13.026555+0000","last_peered":"2023-12-16T01:54:13.026555+0000","last_clean":"2023-12-16T01:54:13.026555+0000","last_became_active":"2023-12-16T01:25:49.147136+0000","last_became_peered":"2023-12-16T01:25:49.147136+0000","last_unstale":"2023-12-16T01:54:13.026555+0000","last_undegraded":"2023-12-16T01:54:13.026555+0000","last_fullsized":"2023-12-16T01:54:13.026555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:54:13.026479+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:54:13.026479+0000","last_clean_scrub_stamp":"2023-12-16T01:54:13.026479+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:11.117107+0000","scrub_duration":0.0012824760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:26.183617+0000","last_change":"2023-12-16T01:54:26.183650+0000","last_active":"2023-12-16T01:54:26.183617+0000","last_peered":"2023-12-16T01:54:26.183617+0000","last_clean":"2023-12-16T01:54:26.183617+0000","last_became_active":"2023-12-16T01:25:49.121842+0000","last_became_peered":"2023-12-16T01:25:49.121842+0000","last_unstale":"2023-12-16T01:54:26.183617+0000","last_undegraded":"2023-12-16T01:54:26.183617+0000","last_fullsized":"2023-12-16T01:54:26.183617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:26.183523+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:26.183523+0000","last_clean_scrub_stamp":"2023-12-16T01:54:26.183523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:01:51.819803+0000","scrub_duration":0.00098922000000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.291254+0000","last_change":"2023-12-16T01:54:20.291254+0000","last_active":"2023-12-16T01:54:20.291254+0000","last_peered":"2023-12-16T01:54:20.291254+0000","last_clean":"2023-12-16T01:54:20.291254+0000","last_became_active":"2023-12-16T01:25:49.147602+0000","last_became_peered":"2023-12-16T01:25:49.147602+0000","last_unstale":"2023-12-16T01:54:20.291254+0000","last_undegraded":"2023-12-16T01:54:20.291254+0000","last_fullsized":"2023-12-16T01:54:20.291254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:20.291163+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:20.291163+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.291163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:39.360767+0000","scrub_duration":0.0011258080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'28","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:32.066037+0000","last_change":"2023-12-16T01:54:32.066037+0000","last_active":"2023-12-16T01:54:32.066037+0000","last_peered":"2023-12-16T01:54:32.066037+0000","last_clean":"2023-12-16T01:54:32.066037+0000","last_became_active":"2023-12-16T01:25:49.146472+0000","last_became_peered":"2023-12-16T01:25:49.146472+0000","last_unstale":"2023-12-16T01:54:32.066037+0000","last_undegraded":"2023-12-16T01:54:32.066037+0000","last_fullsized":"2023-12-16T01:54:32.066037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2023-12-16T01:54:32.065949+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2023-12-16T01:54:32.065949+0000","last_clean_scrub_stamp":"2023-12-16T01:54:32.065949+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:46.483042+0000","scrub_duration":0.0010981999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'39","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:12.064722+0000","last_change":"2023-12-16T01:54:12.064722+0000","last_active":"2023-12-16T01:54:12.064722+0000","last_peered":"2023-12-16T01:54:12.064722+0000","last_clean":"2023-12-16T01:54:12.064722+0000","last_became_active":"2023-12-16T01:25:49.154141+0000","last_became_peered":"2023-12-16T01:25:49.154141+0000","last_unstale":"2023-12-16T01:54:12.064722+0000","last_undegraded":"2023-12-16T01:54:12.064722+0000","last_fullsized":"2023-12-16T01:54:12.064722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'39","last_scrub_stamp":"2023-12-16T01:54:12.064634+0000","last_deep_scrub":"28'39","last_deep_scrub_stamp":"2023-12-16T01:54:12.064634+0000","last_clean_scrub_stamp":"2023-12-16T01:54:12.064634+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:57.162842+0000","scrub_duration":0.0009898629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'51","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:14.064525+0000","last_change":"2023-12-16T01:54:14.064525+0000","last_active":"2023-12-16T01:54:14.064525+0000","last_peered":"2023-12-16T01:54:14.064525+0000","last_clean":"2023-12-16T01:54:14.064525+0000","last_became_active":"2023-12-16T01:25:49.146201+0000","last_became_peered":"2023-12-16T01:25:49.146201+0000","last_unstale":"2023-12-16T01:54:14.064525+0000","last_undegraded":"2023-12-16T01:54:14.064525+0000","last_fullsized":"2023-12-16T01:54:14.064525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'51","last_scrub_stamp":"2023-12-16T01:54:14.064440+0000","last_deep_scrub":"28'51","last_deep_scrub_stamp":"2023-12-16T01:54:14.064440+0000","last_clean_scrub_stamp":"2023-12-16T01:54:14.064440+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:36.113927+0000","scrub_duration":0.00088475900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'42","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.781112+0000","last_change":"2023-12-16T01:54:02.781112+0000","last_active":"2023-12-16T01:54:02.781112+0000","last_peered":"2023-12-16T01:54:02.781112+0000","last_clean":"2023-12-16T01:54:02.781112+0000","last_became_active":"2023-12-16T01:25:49.153122+0000","last_became_peered":"2023-12-16T01:25:49.153122+0000","last_unstale":"2023-12-16T01:54:02.781112+0000","last_undegraded":"2023-12-16T01:54:02.781112+0000","last_fullsized":"2023-12-16T01:54:02.781112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2023-12-16T01:54:02.781026+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.781026+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:00.783489+0000","scrub_duration":0.0010688659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'30","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:15.016584+0000","last_change":"2023-12-16T01:54:15.016622+0000","last_active":"2023-12-16T01:54:15.016584+0000","last_peered":"2023-12-16T01:54:15.016584+0000","last_clean":"2023-12-16T01:54:15.016584+0000","last_became_active":"2023-12-16T01:25:49.147013+0000","last_became_peered":"2023-12-16T01:25:49.147013+0000","last_unstale":"2023-12-16T01:54:15.016584+0000","last_undegraded":"2023-12-16T01:54:15.016584+0000","last_fullsized":"2023-12-16T01:54:15.016584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30","last_scrub_stamp":"2023-12-16T01:54:15.016472+0000","last_deep_scrub":"28'30","last_deep_scrub_stamp":"2023-12-16T01:54:15.016472+0000","last_clean_scrub_stamp":"2023-12-16T01:54:15.016472+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:08.804435+0000","scrub_duration":0.001432675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:20.076910+0000","last_change":"2023-12-16T01:54:20.076932+0000","last_active":"2023-12-16T01:54:20.076910+0000","last_peered":"2023-12-16T01:54:20.076910+0000","last_clean":"2023-12-16T01:54:20.076910+0000","last_became_active":"2023-12-16T01:25:49.146167+0000","last_became_peered":"2023-12-16T01:25:49.146167+0000","last_unstale":"2023-12-16T01:54:20.076910+0000","last_undegraded":"2023-12-16T01:54:20.076910+0000","last_fullsized":"2023-12-16T01:54:20.076910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:20.076831+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:20.076831+0000","last_clean_scrub_stamp":"2023-12-16T01:54:20.076831+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:37.396986+0000","scrub_duration":0.001131235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'36","reported_seq":74,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:02.646330+0000","last_change":"2023-12-16T01:54:02.646365+0000","last_active":"2023-12-16T01:54:02.646330+0000","last_peered":"2023-12-16T01:54:02.646330+0000","last_clean":"2023-12-16T01:54:02.646330+0000","last_became_active":"2023-12-16T01:25:49.116589+0000","last_became_peered":"2023-12-16T01:25:49.116589+0000","last_unstale":"2023-12-16T01:54:02.646330+0000","last_undegraded":"2023-12-16T01:54:02.646330+0000","last_fullsized":"2023-12-16T01:54:02.646330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:54:02.646262+0000","last_clean_scrub_stamp":"2023-12-16T01:54:02.646262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:36.193892+0000","scrub_duration":0.0012008120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'36","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:50.063353+0000","last_change":"2023-12-16T01:53:50.063370+0000","last_active":"2023-12-16T01:53:50.063353+0000","last_peered":"2023-12-16T01:53:50.063353+0000","last_clean":"2023-12-16T01:53:50.063353+0000","last_became_active":"2023-12-16T01:25:49.146145+0000","last_became_peered":"2023-12-16T01:25:49.146145+0000","last_unstale":"2023-12-16T01:53:50.063353+0000","last_undegraded":"2023-12-16T01:53:50.063353+0000","last_fullsized":"2023-12-16T01:53:50.063353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2023-12-16T01:53:50.063280+0000","last_clean_scrub_stamp":"2023-12-16T01:53:50.063280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:56:51.897233+0000","scrub_duration":0.0012023349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'26","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:51.792454+0000","last_change":"2023-12-16T01:53:51.792454+0000","last_active":"2023-12-16T01:53:51.792454+0000","last_peered":"2023-12-16T01:53:51.792454+0000","last_clean":"2023-12-16T01:53:51.792454+0000","last_became_active":"2023-12-16T01:25:49.112161+0000","last_became_peered":"2023-12-16T01:25:49.112161+0000","last_unstale":"2023-12-16T01:53:51.792454+0000","last_undegraded":"2023-12-16T01:53:51.792454+0000","last_fullsized":"2023-12-16T01:53:51.792454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-12-16T01:53:51.792374+0000","last_clean_scrub_stamp":"2023-12-16T01:53:51.792374+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:52.206345+0000","scrub_duration":0.00118464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'43","reported_seq":83,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:52.065951+0000","last_change":"2023-12-16T01:53:52.065951+0000","last_active":"2023-12-16T01:53:52.065951+0000","last_peered":"2023-12-16T01:53:52.065951+0000","last_clean":"2023-12-16T01:53:52.065951+0000","last_became_active":"2023-12-16T01:25:49.033134+0000","last_became_peered":"2023-12-16T01:25:49.033134+0000","last_unstale":"2023-12-16T01:53:52.065951+0000","last_undegraded":"2023-12-16T01:53:52.065951+0000","last_fullsized":"2023-12-16T01:53:52.065951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'43","last_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_deep_scrub":"28'43","last_deep_scrub_stamp":"2023-12-16T01:53:52.065855+0000","last_clean_scrub_stamp":"2023-12-16T01:53:52.065855+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:50.928964+0000","scrub_duration":0.0010821439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'37","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:54:21.079674+0000","last_change":"2023-12-16T01:54:21.079674+0000","last_active":"2023-12-16T01:54:21.079674+0000","last_peered":"2023-12-16T01:54:21.079674+0000","last_clean":"2023-12-16T01:54:21.079674+0000","last_became_active":"2023-12-16T01:25:49.113213+0000","last_became_peered":"2023-12-16T01:25:49.113213+0000","last_unstale":"2023-12-16T01:54:21.079674+0000","last_undegraded":"2023-12-16T01:54:21.079674+0000","last_fullsized":"2023-12-16T01:54:21.079674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2023-12-16T01:54:21.079593+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2023-12-16T01:54:21.079593+0000","last_clean_scrub_stamp":"2023-12-16T01:54:21.079593+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:35.496686+0000","scrub_duration":0.00089815900000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'27","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-16T01:53:47.103599+0000","last_change":"2023-12-16T01:53:47.103599+0000","last_active":"2023-12-16T01:53:47.103599+0000","last_peered":"2023-12-16T01:53:47.103599+0000","last_clean":"2023-12-16T01:53:47.103599+0000","last_became_active":"2023-12-16T01:25:49.153050+0000","last_became_peered":"2023-12-16T01:25:49.153050+0000","last_unstale":"2023-12-16T01:53:47.103599+0000","last_undegraded":"2023-12-16T01:53:47.103599+0000","last_fullsized":"2023-12-16T01:53:47.103599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2023-12-16T01:53:47.103490+0000","last_clean_scrub_stamp":"2023-12-16T01:53:47.103490+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:40.015122+0000","scrub_duration":0.001277678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":318409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4593,"ondisk_log_size":4593,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40684462,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1006,"num_read_kb":1070,"num_write":9112,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56270848,"data_stored":81368924,"data_compressed":7532436,"data_compressed_allocated":11771904,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},"log_size":8679,"ondisk_log_size":8679,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65230,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542503,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49900,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321940,"statfs":{"total":96636764160,"available":96585666560,"internally_reserved":0,"allocated":4952064,"data_stored":7249843,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.41799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.221},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.46400000000000002,"15min":0.442},"min":{"1min":0.40799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61299999999999999}]},{"osd":1,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.39800000000000002,"5min":0.28799999999999998,"15min":0.23999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.47799999999999998,"15min":0.45100000000000001},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.44,"15min":0.42099999999999999},"min":{"1min":0.39100000000000001,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.629}]},{"osd":4,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.224},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69699999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.33400000000000002}]},{"osd":5,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40500000000000003},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.254},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.434,"15min":0.432},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.252},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35999999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.44500000000000001},"min":{"1min":0.33200000000000002,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.375}]}]},{"osd":6,"up_from":14,"seq":60129542501,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38804,"kb_used_data":3468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333036,"statfs":{"total":96636764160,"available":96597028864,"internally_reserved":0,"allocated":3551232,"data_stored":4315463,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.221,"15min":0.214},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.69399999999999995},"last":0.499},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.73999999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.25600000000000001},"max":{"1min":0.61799999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.42999999999999999},"min":{"1min":0.38800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.86599999999999999},"last":0.373}]},{"osd":2,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.66700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.47499999999999998,"15min":0.441},"min":{"1min":0.34899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.46700000000000003,"15min":0.45000000000000001},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.92300000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.66100000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55500000000000005}]},{"osd":4,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.26900000000000002,"5min":0.23899999999999999,"15min":0.20599999999999999},"max":{"1min":0.66900000000000004,"5min":0.874,"15min":0.874},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.32000000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74399999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41799999999999998,"15min":0.39300000000000002},"min":{"1min":0.32600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.65800000000000003,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.437},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Dec 16 01:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.45300000000000001},"min":{"1min":0.38700000000000001,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.68100000000000005,"5min":1.956,"15min":1.956},"last":0.51300000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542502,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54308,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317532,"statfs":{"total":96636764160,"available":96581152768,"internally_reserved":0,"allocated":9465856,"data_stored":13515551,"data_compressed":1189778,"data_compressed_allocated":1871872,"data_compressed_original":6111232,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42099999999999999,"15min":0.40400000000000003},"min":{"1min":0.371,"5min":0.191,"15min":0.191},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66800000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.32600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60299999999999998,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.78700000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.216},"max":{"1min":0.63700000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.59399999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.71699999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.47599999999999998,"15min":0.46300000000000002},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.311},"max":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.36199999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23100000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.67400000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.29199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.59499999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26300000000000001},"max":{"1min":0.53100000000000003,"5min":0.59799999999999998,"15min":0.65300000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.44800000000000001},"min":{"1min":0.33700000000000002,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70099999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542503,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63656,"kb_used_data":6112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308184,"statfs":{"total":96636764160,"available":96571580416,"internally_reserved":0,"allocated":6258688,"data_stored":8511111,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45500000000000002,"15min":0.434},"min":{"1min":0.376,"5min":0.28000000000000003,"15min":0.218},"max":{"1min":0.623,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.35299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66100000000000003}]},{"osd":1,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44,"15min":0.42099999999999999},"min":{"1min":0.36199999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.63600000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.38900000000000001,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66300000000000003},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.32300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.45300000000000001},"min":{"1min":0.39700000000000002,"5min":0.308,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.438,"15min":0.42699999999999999},"min":{"1min":0.374,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.44500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31,"15min":0.27600000000000002},"max":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.65200000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.40500000000000003,"15min":0.39700000000000002},"min":{"1min":0.251,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.72699999999999998},"last":0.442}]},{"osd":6,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.28000000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.77600000000000002},"last":0.378}]},{"osd":7,"last update":"Sat Dec 16 01:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.72099999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.46200000000000002},"min":{"1min":0.32400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47499999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542502,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68992,"kb_used_data":11448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302848,"statfs":{"total":96636764160,"available":96566116352,"internally_reserved":0,"allocated":11722752,"data_stored":16898957,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.28699999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.17599999999999999},"max":{"1min":0.47399999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.316},{"interface":"front","average":{"1min":0.307,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.215,"5min":0.20200000000000001,"15min":0.184},"max":{"1min":0.434,"5min":0.52300000000000002,"15min":0.55300000000000005},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.19700000000000001},"max":{"1min":0.496,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32800000000000001,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.218},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.52400000000000002},"last":0.37}]},{"osd":2,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.45400000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35799999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23000000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.63400000000000001},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.46100000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.29799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.71599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.45300000000000001},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47499999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48699999999999999,"15min":0.46400000000000002},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.34000000000000002},"max":{"1min":0.77500000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.48899999999999999,"15min":0.47299999999999998},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.437}]},{"osd":7,"last update":"Sat Dec 16 01:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.496},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.48099999999999998},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542502,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":6472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":6627328,"data_stored":8510439,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.29499999999999998},"min":{"1min":0.216,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.46200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.315,"15min":0.30499999999999999},"min":{"1min":0.216,"5min":0.214,"15min":0.17499999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.54600000000000004},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.33000000000000002},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.58599999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.22800000000000001,"15min":0.20100000000000001},"max":{"1min":0.504,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.309}]},{"osd":3,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.317},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22},"max":{"1min":0.495,"5min":0.495,"15min":0.52600000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.46600000000000003,"15min":0.443},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71399999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.443,"15min":0.435},"min":{"1min":0.35799999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.39100000000000001,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46800000000000003,"15min":0.45600000000000002},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.38200000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542502,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63308,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308532,"statfs":{"total":96636764160,"available":96571936768,"internally_reserved":0,"allocated":5902336,"data_stored":9100205,"data_compressed":770391,"data_compressed_allocated":1150976,"data_compressed_original":4534272,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.29899999999999999},"min":{"1min":0.21099999999999999,"5min":0.17100000000000001,"15min":0.16900000000000001},"max":{"1min":0.438,"5min":0.50700000000000001,"15min":0.56999999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.308},"min":{"1min":0.23999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.58399999999999996},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.35699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.20200000000000001},"max":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.83899999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.27600000000000002,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.437,"15min":0.432},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.68000000000000005,"5min":0.69899999999999995,"15min":0.82699999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.312},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.88200000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.28399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.77700000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.76200000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.46400000000000002},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.96699999999999997},"last":0.51700000000000002}]},{"osd":7,"last update":"Sat Dec 16 01:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.80700000000000005},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.65400000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542502,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63456,"kb_used_data":10072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308384,"statfs":{"total":96636764160,"available":96571785216,"internally_reserved":0,"allocated":10313728,"data_stored":15417363,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30099999999999999},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":0.46700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.442},{"interface":"front","average":{"1min":0.311,"5min":0.30499999999999999,"15min":0.30299999999999999},"min":{"1min":0.23499999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.432,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.32900000000000001},"min":{"1min":0.245,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23699999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46999999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.42799999999999999,"5min":0.55600000000000005,"15min":0.57099999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.35499999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.57699999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.439,"15min":0.42099999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64200000000000002,"5min":0.66300000000000003,"15min":0.68300000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.44500000000000001},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45800000000000002,"15min":0.44700000000000001},"min":{"1min":0.40000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71099999999999997,"5min":0.748,"15min":0.748},"last":0.59499999999999997}]},{"osd":6,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.41599999999999998,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.753},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54600000000000004}]},{"osd":7,"last update":"Sat Dec 16 01:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32615,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":15296204,"data_compressed":1475700,"data_compressed_allocated":2199552,"data_compressed_original":7491584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":8388678,"data_compressed":737776,"data_compressed_allocated":1105920,"data_compressed_original":3960832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6328320,"data_stored":8389280,"data_compressed":687549,"data_compressed_allocated":1191936,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11423744,"data_stored":16777798,"data_compressed":1683536,"data_compressed_allocated":2617344,"data_compressed_original":7974912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":8389952,"data_compressed":760980,"data_compressed_allocated":1224704,"data_compressed_original":3670016,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":12804024,"data_compressed":1157163,"data_compressed_allocated":1826816,"data_compressed_original":5537792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":4194304,"data_compressed":324329,"data_compressed_allocated":565248,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":7128684,"data_compressed":705403,"data_compressed_allocated":1040384,"data_compressed_original":3526656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T01:55:11.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-16T01:55:11.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.910+0000 7f4b1ddfc640 1 Processor -- start 2023-12-16T01:55:11.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.910+0000 7f4b1ddfc640 1 -- start start 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.911+0000 7f4b1ddfc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18153890 0x7f4b1815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.911+0000 7f4b1ddfc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b180ceef0 0x7f4b180cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.911+0000 7f4b1ddfc640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1815a700 con 0x7f4b18153c70 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.911+0000 7f4b1ddfc640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180ca870 con 0x7f4b180ceef0 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.911+0000 7f4b1ddfc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18159af0 con 0x7f4b18153890 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.912+0000 7f4b0effd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4b18153c70 0x7f4b180c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:42774/0 (socket says 172.21.15.107:42774) 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.912+0000 7f4b0effd640 1 -- 172.21.15.107:0/3060840063 learned_addr learned my addr 172.21.15.107:0/3060840063 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:55:11.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.912+0000 7f4b17fff640 1 --2- 172.21.15.107:0/3060840063 >> v2:172.21.15.157:3300/0 conn(0x7f4b180ceef0 0x7f4b180cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.912+0000 7f4b177fe640 1 --2- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18153890 0x7f4b1815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.914+0000 7f4b16ffd640 1 -- 172.21.15.107:0/3060840063 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237747545 0 0) 0x7f4b1815a700 con 0x7f4b18153c70 2023-12-16T01:55:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.914+0000 7f4b16ffd640 1 -- 172.21.15.107:0/3060840063 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b04003520 con 0x7f4b18153c70 2023-12-16T01:55:11.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.916+0000 7f4b17fff640 1 -- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18153890 msgr2=0x7f4b1815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:11.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.916+0000 7f4b17fff640 1 --2- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18153890 0x7f4b1815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.916+0000 7f4b17fff640 1 -- 172.21.15.107:0/3060840063 >> v1:172.21.15.107:6789/0 conn(0x7f4b18153c70 legacy=0x7f4b180c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.916+0000 7f4b17fff640 1 -- 172.21.15.107:0/3060840063 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18159dd0 con 0x7f4b180ceef0 2023-12-16T01:55:11.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.919+0000 7f4b17fff640 1 --2- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b180ceef0 0x7f4b180cf340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b1002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32946b4891d1292 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:11.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.923+0000 7f4b16ffd640 1 -- 172.21.15.107:0/3060840063 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1002cce0 con 0x7f4b180ceef0 2023-12-16T01:55:11.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.923+0000 7f4b16ffd640 1 -- 172.21.15.107:0/3060840063 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1002ce40 con 0x7f4b180ceef0 2023-12-16T01:55:11.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.923+0000 7f4b16ffd640 1 -- 172.21.15.107:0/3060840063 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10034660 con 0x7f4b180ceef0 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b180ceef0 msgr2=0x7f4b180cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b180ceef0 0x7f4b180cf340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b1002bf30 comp rx=0 tx=0).stop 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3060840063 shutdown_connections 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b180ceef0 0x7f4b180cf340 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3060840063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18153890 0x7f4b1815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3060840063 >> 172.21.15.107:0/3060840063 conn(0x7f4b1806ba00 msgr2=0x7f4b1806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3060840063 shutdown_connections 2023-12-16T01:55:11.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.924+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3060840063 wait complete. 2023-12-16T01:55:11.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.925+0000 7f4b1ddfc640 1 Processor -- start 2023-12-16T01:55:11.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.925+0000 7f4b1ddfc640 1 -- start start 2023-12-16T01:55:11.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.926+0000 7f4b1ddfc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180ceef0 0x7f4b1814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.926+0000 7f4b1ddfc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18153890 0x7f4b1814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.926+0000 7f4b1ddfc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 0x7f4b180ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.926+0000 7f4b1ddfc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180c73b0 con 0x7f4b18153c70 2023-12-16T01:55:11.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.926+0000 7f4b1ddfc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1814f400 con 0x7f4b18153890 2023-12-16T01:55:11.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.926+0000 7f4b1ddfc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1814e900 con 0x7f4b180ceef0 2023-12-16T01:55:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.927+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 0x7f4b180ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.927+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 0x7f4b180ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33318/0 (socket says 172.21.15.107:33318) 2023-12-16T01:55:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.927+0000 7f4b17fff640 1 -- 172.21.15.107:0/3605458100 learned_addr learned my addr 172.21.15.107:0/3605458100 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.927+0000 7f4b0effd640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18153890 0x7f4b1814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.927+0000 7f4b177fe640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180ceef0 0x7f4b1814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.930+0000 7f4b17fff640 1 -- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180ceef0 msgr2=0x7f4b1814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.930+0000 7f4b17fff640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180ceef0 0x7f4b1814eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.930+0000 7f4b17fff640 1 -- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18153890 msgr2=0x7f4b1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.930+0000 7f4b17fff640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18153890 0x7f4b1814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.930+0000 7f4b17fff640 1 -- 172.21.15.107:0/3605458100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009a70 con 0x7f4b18153c70 2023-12-16T01:55:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.932+0000 7f4b17fff640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 0x7f4b180ce020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.936+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1003e610 con 0x7f4b18153c70 2023-12-16T01:55:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.936+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1003e770 con 0x7f4b18153c70 2023-12-16T01:55:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.936+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1003eb00 con 0x7f4b18153c70 2023-12-16T01:55:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.936+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1814ebe0 con 0x7f4b18153c70 2023-12-16T01:55:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.936+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b180c8d40 con 0x7f4b18153c70 2023-12-16T01:55:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.937+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b180728d0 con 0x7f4b18153c70 2023-12-16T01:55:11.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.956+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4b1003b050 con 0x7f4b18153c70 2023-12-16T01:55:11.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.956+0000 7f4b14ff9640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4af806ae90 0x7f4af806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:11.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.957+0000 7f4b177fe640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4af806ae90 0x7f4af806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:11.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.957+0000 7f4b177fe640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4af806ae90 0x7f4af806d350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009b40 tx=0x7f4b08009190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:11.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:11.960+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4b10034e40 con 0x7f4b18153c70 2023-12-16T01:55:12.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.191+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4b10076ef0 con 0x7f4b18153c70 2023-12-16T01:55:12.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.372+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f4b1815c450 con 0x7f4b18153c70 2023-12-16T01:55:12.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.558+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4b1004e020 con 0x7f4b18153c70 2023-12-16T01:55:12.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.558+0000 7f4b14ff9640 1 -- 172.21.15.107:0/3605458100 <== mon.0 v2:172.21.15.107:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4b10076ef0 con 0x7f4b18153c70 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.560+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4af806ae90 msgr2=0x7f4af806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4af806ae90 0x7f4af806d350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009b40 tx=0x7f4b08009190 comp rx=0 tx=0).stop 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 msgr2=0x7f4b180ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 0x7f4b180ce020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b10004a40 comp rx=0 tx=0).stop 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 shutdown_connections 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b18153c70 0x7f4b180ce020 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f4af806ae90 0x7f4af806d350 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18153890 0x7f4b1814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 --2- 172.21.15.107:0/3605458100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180ceef0 0x7f4b1814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 >> 172.21.15.107:0/3605458100 conn(0x7f4b1806ba00 msgr2=0x7f4b180cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:12.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 shutdown_connections 2023-12-16T01:55:12.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.561+0000 7f4b1ddfc640 1 -- 172.21.15.107:0/3605458100 wait complete. 2023-12-16T01:55:12.574 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T01:55:12.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 Processor -- start 2023-12-16T01:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 -- start start 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa804151510 0x7fa8040cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040728b0 0x7fa8040cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80415b6e0 con 0x7fa8040c5a90 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80415a880 con 0x7fa804151510 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.674+0000 7fa80abc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80406f7e0 con 0x7fa8040728b0 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.675+0000 7fa809166640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa8040c5a90 0x7fa8041572f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:42790/0 (socket says 172.21.15.107:42790) 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.675+0000 7fa809166640 1 -- 172.21.15.107:0/771992030 learned_addr learned my addr 172.21.15.107:0/771992030 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.675+0000 7fa808965640 1 --2- 172.21.15.107:0/771992030 >> v2:172.21.15.157:3300/0 conn(0x7fa804151510 0x7fa8040cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.675+0000 7fa803fff640 1 --2- 172.21.15.107:0/771992030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040728b0 0x7fa8040cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.677+0000 7fa8037fe640 1 -- 172.21.15.107:0/771992030 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464882102 0 0) 0x7fa80415b6e0 con 0x7fa8040c5a90 2023-12-16T01:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.677+0000 7fa8037fe640 1 -- 172.21.15.107:0/771992030 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f0003520 con 0x7fa8040c5a90 2023-12-16T01:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.678+0000 7fa803fff640 1 -- 172.21.15.107:0/771992030 >> v2:172.21.15.157:3300/0 conn(0x7fa804151510 msgr2=0x7fa8040cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.678+0000 7fa803fff640 1 --2- 172.21.15.107:0/771992030 >> v2:172.21.15.157:3300/0 conn(0x7fa804151510 0x7fa8040cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.678+0000 7fa803fff640 1 -- 172.21.15.107:0/771992030 >> v1:172.21.15.107:6789/0 conn(0x7fa8040c5a90 legacy=0x7fa8041572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.678+0000 7fa803fff640 1 -- 172.21.15.107:0/771992030 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80415aad0 con 0x7fa8040728b0 2023-12-16T01:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.679+0000 7fa803fff640 1 --2- 172.21.15.107:0/771992030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040728b0 0x7fa8040cb370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097a0 tx=0x7fa7ec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afdda00fbefaf490 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa8037fe640 1 -- 172.21.15.107:0/771992030 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec031830 con 0x7fa8040728b0 2023-12-16T01:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa8037fe640 1 -- 172.21.15.107:0/771992030 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa7ec031990 con 0x7fa8040728b0 2023-12-16T01:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa8037fe640 1 -- 172.21.15.107:0/771992030 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec031d40 con 0x7fa8040728b0 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 -- 172.21.15.107:0/771992030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040728b0 msgr2=0x7fa8040cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 --2- 172.21.15.107:0/771992030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040728b0 0x7fa8040cb370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097a0 tx=0x7fa7ec02b8d0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 -- 172.21.15.107:0/771992030 shutdown_connections 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 --2- 172.21.15.107:0/771992030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040728b0 0x7fa8040cb370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 --2- 172.21.15.107:0/771992030 >> v2:172.21.15.157:3300/0 conn(0x7fa804151510 0x7fa8040cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 -- 172.21.15.107:0/771992030 >> 172.21.15.107:0/771992030 conn(0x7fa80406cd60 msgr2=0x7fa80406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 -- 172.21.15.107:0/771992030 shutdown_connections 2023-12-16T01:55:12.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.687+0000 7fa80abc9640 1 -- 172.21.15.107:0/771992030 wait complete. 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.688+0000 7fa80abc9640 1 Processor -- start 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 -- start start 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040728b0 0x7fa804159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040c5a90 0x7fa804146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 0x7fa8041ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80415a190 con 0x7fa804151510 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c4b20 con 0x7fa8040728b0 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.689+0000 7fa80abc9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80415a690 con 0x7fa8040c5a90 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.690+0000 7fa809166640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 0x7fa8041ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.690+0000 7fa808965640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040728b0 0x7fa804159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.690+0000 7fa809166640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 0x7fa8041ecc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33320/0 (socket says 172.21.15.107:33320) 2023-12-16T01:55:12.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.690+0000 7fa809166640 1 -- 172.21.15.107:0/1631443026 learned_addr learned my addr 172.21.15.107:0/1631443026 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:12.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.690+0000 7fa803fff640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040c5a90 0x7fa804146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:12.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.693+0000 7fa809166640 1 -- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040c5a90 msgr2=0x7fa804146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:12.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.693+0000 7fa809166640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040c5a90 0x7fa804146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.693+0000 7fa809166640 1 -- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040728b0 msgr2=0x7fa804159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:12.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.693+0000 7fa809166640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040728b0 0x7fa804159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:12.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.693+0000 7fa809166640 1 -- 172.21.15.107:0/1631443026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec009400 con 0x7fa804151510 2023-12-16T01:55:12.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.695+0000 7fa809166640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 0x7fa8041ecc00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c430 tx=0x7fa7f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:12.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.699+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4005ce0 con 0x7fa804151510 2023-12-16T01:55:12.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.699+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa7f4005e40 con 0x7fa804151510 2023-12-16T01:55:12.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.699+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4007330 con 0x7fa804151510 2023-12-16T01:55:12.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.699+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040c4230 con 0x7fa804151510 2023-12-16T01:55:12.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.699+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80415a3b0 con 0x7fa804151510 2023-12-16T01:55:12.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.700+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8040c4c90 con 0x7fa804151510 2023-12-16T01:55:12.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.719+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa7f4007490 con 0x7fa804151510 2023-12-16T01:55:12.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.719+0000 7fa8017fa640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa7e406aec0 0x7fa7e406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:12.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.719+0000 7fa808965640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa7e406aec0 0x7fa7e406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:12.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.720+0000 7fa808965640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa7e406aec0 0x7fa7e406d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc011340 tx=0x7fa7fc00b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:12.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.722+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa7f4007740 con 0x7fa804151510 2023-12-16T01:55:12.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:12.958+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa7f40541c0 con 0x7fa804151510 2023-12-16T01:55:13.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.159+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa804067500 con 0x7fa804151510 2023-12-16T01:55:13.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.172+0000 7fa8017fa640 1 -- 172.21.15.107:0/1631443026 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6532 (secure 0 0 0) 0x7fa7f40577e0 con 0x7fa804151510 2023-12-16T01:55:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:55:13.174 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:26:16.623444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T01:55:13.175 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa7e406aec0 msgr2=0x7fa7e406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa7e406aec0 0x7fa7e406d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc011340 tx=0x7fa7fc00b040 comp rx=0 tx=0).stop 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 msgr2=0x7fa8041ecc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 0x7fa8041ecc00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c430 tx=0x7fa7f400c8f0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 shutdown_connections 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa804151510 0x7fa8041ecc00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8040c5a90 0x7fa804146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fa7e406aec0 0x7fa7e406d380 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 --2- 172.21.15.107:0/1631443026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040728b0 0x7fa804159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 >> 172.21.15.107:0/1631443026 conn(0x7fa80406cd60 msgr2=0x7fa8040c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:13.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 shutdown_connections 2023-12-16T01:55:13.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.175+0000 7fa80abc9640 1 -- 172.21.15.107:0/1631443026 wait complete. 2023-12-16T01:55:13.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T01:55:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.286+0000 7f68e4743640 1 Processor -- start 2023-12-16T01:55:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.286+0000 7f68e4743640 1 -- start start 2023-12-16T01:55:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.287+0000 7f68e4743640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68dc151510 0x7f68dc0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.287+0000 7f68e4743640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc15b6e0 con 0x7f68dc0c61a0 2023-12-16T01:55:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.287+0000 7f68e4743640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc15a880 con 0x7f68dc0728b0 2023-12-16T01:55:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.287+0000 7f68e4743640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68dc06f7e0 con 0x7f68dc151510 2023-12-16T01:55:13.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.287+0000 7f68e1cde640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f68dc0728b0 0x7f68dc0c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:46960/0 (socket says 172.21.15.107:46960) 2023-12-16T01:55:13.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.287+0000 7f68e1cde640 1 -- 172.21.15.107:0/384156114 learned_addr learned my addr 172.21.15.107:0/384156114 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:55:13.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.288+0000 7f68e24df640 1 --2- 172.21.15.107:0/384156114 >> v2:172.21.15.107:3300/0 conn(0x7f68dc151510 0x7f68dc0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.290+0000 7f68e14dd640 1 -- 172.21.15.107:0/384156114 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346421967 0 0) 0x7f68dc15a880 con 0x7f68dc0728b0 2023-12-16T01:55:13.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.290+0000 7f68e14dd640 1 -- 172.21.15.107:0/384156114 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c8003520 con 0x7f68dc0728b0 2023-12-16T01:55:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.292+0000 7f68e24df640 1 -- 172.21.15.107:0/384156114 >> v1:172.21.15.157:6789/0 conn(0x7f68dc0728b0 legacy=0x7f68dc0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.292+0000 7f68e24df640 1 -- 172.21.15.107:0/384156114 >> v1:172.21.15.107:6789/0 conn(0x7f68dc0c61a0 legacy=0x7f68dc161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.292+0000 7f68e24df640 1 -- 172.21.15.107:0/384156114 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc15aad0 con 0x7f68dc151510 2023-12-16T01:55:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.295+0000 7f68e24df640 1 --2- 172.21.15.107:0/384156114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc151510 0x7f68dc0cae30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f68d80097a0 tx=0x7f68d802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4f1cf6aab229af server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:13.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.299+0000 7f68e14dd640 1 -- 172.21.15.107:0/384156114 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8030610 con 0x7f68dc151510 2023-12-16T01:55:13.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.299+0000 7f68e14dd640 1 -- 172.21.15.107:0/384156114 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68d8030770 con 0x7f68dc151510 2023-12-16T01:55:13.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.299+0000 7f68e14dd640 1 -- 172.21.15.107:0/384156114 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8030b20 con 0x7f68dc151510 2023-12-16T01:55:13.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 -- 172.21.15.107:0/384156114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc151510 msgr2=0x7f68dc0cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 --2- 172.21.15.107:0/384156114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc151510 0x7f68dc0cae30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f68d80097a0 tx=0x7f68d802b960 comp rx=0 tx=0).stop 2023-12-16T01:55:13.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 -- 172.21.15.107:0/384156114 shutdown_connections 2023-12-16T01:55:13.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 --2- 172.21.15.107:0/384156114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc151510 0x7f68dc0cae30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 -- 172.21.15.107:0/384156114 >> 172.21.15.107:0/384156114 conn(0x7f68dc06cd60 msgr2=0x7f68dc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:13.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 -- 172.21.15.107:0/384156114 shutdown_connections 2023-12-16T01:55:13.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.300+0000 7f68e4743640 1 -- 172.21.15.107:0/384156114 wait complete. 2023-12-16T01:55:13.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.301+0000 7f68e4743640 1 Processor -- start 2023-12-16T01:55:13.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.301+0000 7f68e4743640 1 -- start start 2023-12-16T01:55:13.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e4743640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0728b0 0x7f68dc1431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e4743640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 0x7f68dc157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e4743640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc151510 0x7f68dc0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e4743640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc155d00 con 0x7f68dc0c61a0 2023-12-16T01:55:13.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e4743640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc1f15d0 con 0x7f68dc151510 2023-12-16T01:55:13.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e4743640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc1f09c0 con 0x7f68dc0728b0 2023-12-16T01:55:13.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.302+0000 7f68e1cde640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 0x7f68dc157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.303+0000 7f68e1cde640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 0x7f68dc157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33338/0 (socket says 172.21.15.107:33338) 2023-12-16T01:55:13.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.303+0000 7f68e1cde640 1 -- 172.21.15.107:0/1104097159 learned_addr learned my addr 172.21.15.107:0/1104097159 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:13.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.303+0000 7f68e2ce0640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc151510 0x7f68dc0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.303+0000 7f68e24df640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0728b0 0x7f68dc1431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.306+0000 7f68e1cde640 1 -- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0728b0 msgr2=0x7f68dc1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.306+0000 7f68e1cde640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0728b0 0x7f68dc1431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.306+0000 7f68e1cde640 1 -- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc151510 msgr2=0x7f68dc0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.306+0000 7f68e1cde640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc151510 0x7f68dc0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.306+0000 7f68e1cde640 1 -- 172.21.15.107:0/1104097159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d8009400 con 0x7f68dc0c61a0 2023-12-16T01:55:13.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.308+0000 7f68e1cde640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 0x7f68dc157450 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00c530 tx=0x7f68cc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.312+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc005ce0 con 0x7f68dc0c61a0 2023-12-16T01:55:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.312+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68cc005e40 con 0x7f68dc0c61a0 2023-12-16T01:55:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.312+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc1f0ca0 con 0x7f68dc0c61a0 2023-12-16T01:55:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.312+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc0072d0 con 0x7f68dc0c61a0 2023-12-16T01:55:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.312+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc1f1260 con 0x7f68dc0c61a0 2023-12-16T01:55:13.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.313+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc06f480 con 0x7f68dc0c61a0 2023-12-16T01:55:13.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.332+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f68cc007430 con 0x7f68dc0c61a0 2023-12-16T01:55:13.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.333+0000 7f68d2ffd640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68c006ae70 0x7f68c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.333+0000 7f68e24df640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68c006ae70 0x7f68c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.333+0000 7f68e24df640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68c006ae70 0x7f68c006d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68d8036000 tx=0x7f68d803b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:13.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.336+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68cc057fa0 con 0x7f68dc0c61a0 2023-12-16T01:55:13.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.570+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f68cc054250 con 0x7f68dc0c61a0 2023-12-16T01:55:13.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.777+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68dc067fd0 con 0x7f68dc0c61a0 2023-12-16T01:55:13.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.789+0000 7f68d2ffd640 1 -- 172.21.15.107:0/1104097159 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6532 (secure 0 0 0) 0x7f68cc017070 con 0x7f68dc0c61a0 2023-12-16T01:55:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:55:13.791 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3734886563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3734886563},{"type":"v1","addr":"172.21.15.107:6835","nonce":3734886563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/528589040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":528589040},{"type":"v1","addr":"172.21.15.107:6837","nonce":528589040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2795570451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2795570451},{"type":"v1","addr":"172.21.15.157:6833","nonce":2795570451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/3587558192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":3587558192},{"type":"v1","addr":"172.21.15.107:6839","nonce":3587558192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3129786077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3129786077},{"type":"v1","addr":"172.21.15.157:6835","nonce":3129786077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T01:25:48.506111+0000","modified":"2023-12-16T01:26:16.623444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/1933485264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":1933485264},{"type":"v1","addr":"172.21.15.157:6837","nonce":1933485264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T01:55:13.792 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2023-12-16T01:55:13.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68c006ae70 msgr2=0x7f68c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68c006ae70 0x7f68c006d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68d8036000 tx=0x7f68d803b040 comp rx=0 tx=0).stop 2023-12-16T01:55:13.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 msgr2=0x7f68dc157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 0x7f68dc157450 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00c530 tx=0x7f68cc00c9f0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 shutdown_connections 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f68c006ae70 0x7f68c006d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc151510 0x7f68dc0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68dc0c61a0 0x7f68dc157450 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 --2- 172.21.15.107:0/1104097159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0728b0 0x7f68dc1431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 >> 172.21.15.107:0/1104097159 conn(0x7f68dc06cd60 msgr2=0x7f68dc14ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 shutdown_connections 2023-12-16T01:55:13.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.791+0000 7f68e4743640 1 -- 172.21.15.107:0/1104097159 wait complete. 2023-12-16T01:55:13.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T01:55:13.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.903+0000 7f9843d7c640 1 Processor -- start 2023-12-16T01:55:13.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.903+0000 7f9843d7c640 1 -- start start 2023-12-16T01:55:13.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.903+0000 7f9843d7c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f983c1515f0 0x7f983c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.903+0000 7f9843d7c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f983c1519d0 0x7f983c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.903+0000 7f9843d7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c06dde0 0x7f983c070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9843d7c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0c40b0 con 0x7f983c1515f0 2023-12-16T01:55:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9843d7c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c06ff90 con 0x7f983c1519d0 2023-12-16T01:55:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9843d7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c06f980 con 0x7f983c06dde0 2023-12-16T01:55:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9841b18640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f983c1515f0 0x7f983c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9841b18640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f983c1515f0 0x7f983c06b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33354/0 (socket says 172.21.15.107:33354) 2023-12-16T01:55:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9841b18640 1 -- 172.21.15.107:0/3048994290 learned_addr learned my addr 172.21.15.107:0/3048994290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.904+0000 7f9841317640 1 --2- 172.21.15.107:0/3048994290 >> v2:172.21.15.157:3300/0 conn(0x7f983c1519d0 0x7f983c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.905+0000 7f9842319640 1 --2- 172.21.15.107:0/3048994290 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c06dde0 0x7f983c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.907+0000 7f9841b18640 1 -- 172.21.15.107:0/3048994290 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c06dde0 msgr2=0x7f983c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.907+0000 7f9841b18640 1 --2- 172.21.15.107:0/3048994290 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c06dde0 0x7f983c070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.907+0000 7f9841b18640 1 -- 172.21.15.107:0/3048994290 >> v2:172.21.15.157:3300/0 conn(0x7f983c1519d0 msgr2=0x7f983c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.907+0000 7f9841b18640 1 --2- 172.21.15.107:0/3048994290 >> v2:172.21.15.157:3300/0 conn(0x7f983c1519d0 0x7f983c0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.907+0000 7f9841b18640 1 -- 172.21.15.107:0/3048994290 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c06e810 con 0x7f983c1515f0 2023-12-16T01:55:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.909+0000 7f9841b18640 1 --2- 172.21.15.107:0/3048994290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1515f0 0x7f983c06b0b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f983c071bb0 tx=0x7f983002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2365aebac3ce9904 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:13.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.912+0000 7f9840b16640 1 -- 172.21.15.107:0/3048994290 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830031870 con 0x7f983c1515f0 2023-12-16T01:55:13.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.912+0000 7f9840b16640 1 -- 172.21.15.107:0/3048994290 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f98300319d0 con 0x7f983c1515f0 2023-12-16T01:55:13.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.912+0000 7f9840b16640 1 -- 172.21.15.107:0/3048994290 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830031d80 con 0x7f983c1515f0 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 -- 172.21.15.107:0/3048994290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1515f0 msgr2=0x7f983c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 --2- 172.21.15.107:0/3048994290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1515f0 0x7f983c06b0b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f983c071bb0 tx=0x7f983002b910 comp rx=0 tx=0).stop 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 -- 172.21.15.107:0/3048994290 shutdown_connections 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 --2- 172.21.15.107:0/3048994290 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c06dde0 0x7f983c070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 --2- 172.21.15.107:0/3048994290 >> v2:172.21.15.157:3300/0 conn(0x7f983c1519d0 0x7f983c0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 --2- 172.21.15.107:0/3048994290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1515f0 0x7f983c06b0b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 -- 172.21.15.107:0/3048994290 >> 172.21.15.107:0/3048994290 conn(0x7f983c0cbf60 msgr2=0x7f983c0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 -- 172.21.15.107:0/3048994290 shutdown_connections 2023-12-16T01:55:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.913+0000 7f9843d7c640 1 -- 172.21.15.107:0/3048994290 wait complete. 2023-12-16T01:55:13.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.914+0000 7f9843d7c640 1 Processor -- start 2023-12-16T01:55:13.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.914+0000 7f9843d7c640 1 -- start start 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9843d7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f983c06dde0 0x7f983c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9843d7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c1515f0 0x7f983c14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9843d7c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 0x7f983c14c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9843d7c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1506c0 con 0x7f983c1519d0 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9843d7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c14f7f0 con 0x7f983c06dde0 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9843d7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c14fab0 con 0x7f983c1515f0 2023-12-16T01:55:13.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.915+0000 7f9842319640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 0x7f983c14c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.916+0000 7f9842319640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 0x7f983c14c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33360/0 (socket says 172.21.15.107:33360) 2023-12-16T01:55:13.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.916+0000 7f9842319640 1 -- 172.21.15.107:0/1287310394 learned_addr learned my addr 172.21.15.107:0/1287310394 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:13.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.916+0000 7f9841317640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c1515f0 0x7f983c14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.916+0000 7f9841b18640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f983c06dde0 0x7f983c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:13.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.919+0000 7f9842319640 1 -- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c1515f0 msgr2=0x7f983c14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.919+0000 7f9842319640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c1515f0 0x7f983c14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.919+0000 7f9842319640 1 -- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f983c06dde0 msgr2=0x7f983c14e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:13.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.919+0000 7f9842319640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f983c06dde0 0x7f983c14e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:13.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.919+0000 7f9842319640 1 -- 172.21.15.107:0/1287310394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98300094d0 con 0x7f983c1519d0 2023-12-16T01:55:13.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.921+0000 7f9842319640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 0x7f983c14c640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f983400eea0 tx=0x7f983400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:13.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.923+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834010040 con 0x7f983c1519d0 2023-12-16T01:55:13.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.923+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c14fd90 con 0x7f983c1519d0 2023-12-16T01:55:13.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.923+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c150350 con 0x7f983c1519d0 2023-12-16T01:55:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.924+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c067500 con 0x7f983c1519d0 2023-12-16T01:55:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.925+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f983401d400 con 0x7f983c1519d0 2023-12-16T01:55:13.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:13.925+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983401d790 con 0x7f983c1519d0 2023-12-16T01:55:14.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.173+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f983401d8f0 con 0x7f983c1519d0 2023-12-16T01:55:14.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.174+0000 7f982e7fc640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f982006ae40 0x7f982006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.174+0000 7f9841b18640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f982006ae40 0x7f982006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.174+0000 7f9841b18640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f982006ae40 0x7f982006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9830036000 tx=0x7f983003c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:14.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.186+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f98340593a0 con 0x7f983c1519d0 2023-12-16T01:55:14.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.186+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f98340556e0 con 0x7f983c1519d0 2023-12-16T01:55:14.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.359+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f983c06e4c0 con 0x7f983c1519d0 2023-12-16T01:55:14.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.396+0000 7f982e7fc640 1 -- 172.21.15.107:0/1287310394 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18553 (secure 0 0 0) 0x7f9834009ca0 con 0x7f983c1519d0 2023-12-16T01:55:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T01:55:14.399 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"928cabe9-0ef6-4aba-be14-8cbcf8a73b88","created":"2023-12-16T01:25:20.088427+0000","modified":"2023-12-16T01:26:31.279218+0000","last_up_change":"2023-12-16T01:25:33.236645+0000","last_in_change":"2023-12-16T01:25:25.371179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T01:25:34.058977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T01:25:45.757668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T01:25:47.362497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T01:25:52.786986+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8e86e509-9355-4172-a028-a45b40c78281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6825","nonce":1495769768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6827","nonce":1495769768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6831","nonce":1495769768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1495769768},{"type":"v1","addr":"172.21.15.107:6829","nonce":1495769768}]},"public_addr":"172.21.15.107:6825/1495769768","cluster_addr":"172.21.15.107:6827/1495769768","heartbeat_back_addr":"172.21.15.107:6831/1495769768","heartbeat_front_addr":"172.21.15.107:6829/1495769768","state":["exists","up"]},{"osd":1,"uuid":"504aafdb-9fe3-4f96-8b14-b5eda7556a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6810","nonce":2478942825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6813","nonce":2478942825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6820","nonce":2478942825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":2478942825},{"type":"v1","addr":"172.21.15.107:6816","nonce":2478942825}]},"public_addr":"172.21.15.107:6810/2478942825","cluster_addr":"172.21.15.107:6813/2478942825","heartbeat_back_addr":"172.21.15.107:6820/2478942825","heartbeat_front_addr":"172.21.15.107:6816/2478942825","state":["exists","up"]},{"osd":2,"uuid":"6e0e9a98-e924-4263-8a14-d6bba7540b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6811","nonce":1376588586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6817","nonce":1376588586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6823","nonce":1376588586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6819","nonce":1376588586},{"type":"v1","addr":"172.21.15.107:6821","nonce":1376588586}]},"public_addr":"172.21.15.107:6811/1376588586","cluster_addr":"172.21.15.107:6817/1376588586","heartbeat_back_addr":"172.21.15.107:6823/1376588586","heartbeat_front_addr":"172.21.15.107:6821/1376588586","state":["exists","up"]},{"osd":3,"uuid":"18bbf077-7854-4d6c-8c48-325481bdc479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6801","nonce":2440758538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6803","nonce":2440758538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6807","nonce":2440758538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2440758538},{"type":"v1","addr":"172.21.15.107:6805","nonce":2440758538}]},"public_addr":"172.21.15.107:6801/2440758538","cluster_addr":"172.21.15.107:6803/2440758538","heartbeat_back_addr":"172.21.15.107:6807/2440758538","heartbeat_front_addr":"172.21.15.107:6805/2440758538","state":["exists","up"]},{"osd":4,"uuid":"43c33869-4c2b-42c8-9273-35b75f1fa0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6801","nonce":2128955220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6803","nonce":2128955220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6807","nonce":2128955220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2128955220},{"type":"v1","addr":"172.21.15.157:6805","nonce":2128955220}]},"public_addr":"172.21.15.157:6801/2128955220","cluster_addr":"172.21.15.157:6803/2128955220","heartbeat_back_addr":"172.21.15.157:6807/2128955220","heartbeat_front_addr":"172.21.15.157:6805/2128955220","state":["exists","up"]},{"osd":5,"uuid":"8c5a80d0-cb66-4356-8a41-3cc32dc6b7e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619027731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619027731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619027731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619027731},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619027731}]},"public_addr":"172.21.15.157:6825/3619027731","cluster_addr":"172.21.15.157:6827/3619027731","heartbeat_back_addr":"172.21.15.157:6831/3619027731","heartbeat_front_addr":"172.21.15.157:6829/3619027731","state":["exists","up"]},{"osd":6,"uuid":"b7937a61-86f5-44bf-9baf-5481f99b8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6809","nonce":3584434830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6813","nonce":3584434830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6821","nonce":3584434830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":3584434830},{"type":"v1","addr":"172.21.15.157:6817","nonce":3584434830}]},"public_addr":"172.21.15.157:6809/3584434830","cluster_addr":"172.21.15.157:6813/3584434830","heartbeat_back_addr":"172.21.15.157:6821/3584434830","heartbeat_front_addr":"172.21.15.157:6817/3584434830","state":["exists","up"]},{"osd":7,"uuid":"2d9bda2b-6ae9-4520-b556-ef9009c8da3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6812","nonce":1425748971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6816","nonce":1425748971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6823","nonce":1425748971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1425748971},{"type":"v1","addr":"172.21.15.157:6820","nonce":1425748971}]},"public_addr":"172.21.15.157:6812/1425748971","cluster_addr":"172.21.15.157:6816/1425748971","heartbeat_back_addr":"172.21.15.157:6823/1425748971","heartbeat_front_addr":"172.21.15.157:6820/1425748971","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.606243+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.671481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.659049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.562246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.696582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.638573+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T01:25:30.654658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T01:55:14.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f982006ae40 msgr2=0x7f982006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:14.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f982006ae40 0x7f982006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9830036000 tx=0x7f983003c040 comp rx=0 tx=0).stop 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 msgr2=0x7f983c14c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 0x7f983c14c640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f983400eea0 tx=0x7f983400ef90 comp rx=0 tx=0).stop 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 shutdown_connections 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f983c1519d0 0x7f983c14c640 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f983c1515f0 0x7f983c14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f982006ae40 0x7f982006d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 --2- 172.21.15.107:0/1287310394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f983c06dde0 0x7f983c14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 >> 172.21.15.107:0/1287310394 conn(0x7f983c0cbf60 msgr2=0x7f983c0c4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 shutdown_connections 2023-12-16T01:55:14.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.398+0000 7f9843d7c640 1 -- 172.21.15.107:0/1287310394 wait complete. 2023-12-16T01:55:14.412 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-16T01:55:14.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.511+0000 7f10b4846640 1 Processor -- start 2023-12-16T01:55:14.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.511+0000 7f10b4846640 1 -- start start 2023-12-16T01:55:14.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.512+0000 7f10b4846640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f10b0071c40 0x7f10b0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.512+0000 7f10b4846640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 0x7f10b0159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.512+0000 7f10b4846640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b0071420 con 0x7f10b014fd70 2023-12-16T01:55:14.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.512+0000 7f10b4846640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b0155b20 con 0x7f10b0071c40 2023-12-16T01:55:14.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.512+0000 7f10b4846640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b01592d0 con 0x7f10b00caee0 2023-12-16T01:55:14.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.513+0000 7f10add9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f10b0071c40 0x7f10b0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.513+0000 7f10aed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 0x7f10b0159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.514+0000 7f10aed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 0x7f10b0159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:36902/0 (socket says 172.21.15.107:36902) 2023-12-16T01:55:14.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.514+0000 7f10aed9d640 1 -- 172.21.15.107:0/589570002 learned_addr learned my addr 172.21.15.107:0/589570002 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:14.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.516+0000 7f10aed9d640 1 -- 172.21.15.107:0/589570002 >> v2:172.21.15.157:3300/0 conn(0x7f10b0071c40 msgr2=0x7f10b0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:14.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.516+0000 7f10aed9d640 1 --2- 172.21.15.107:0/589570002 >> v2:172.21.15.157:3300/0 conn(0x7f10b0071c40 0x7f10b0070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.516+0000 7f10aed9d640 1 -- 172.21.15.107:0/589570002 >> v1:172.21.15.157:6789/0 conn(0x7f10b014fd70 legacy=0x7f10b00c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:14.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.516+0000 7f10aed9d640 1 -- 172.21.15.107:0/589570002 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00c65f0 con 0x7f10b00caee0 2023-12-16T01:55:14.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.518+0000 7f10aed9d640 1 --2- 172.21.15.107:0/589570002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 0x7f10b0159760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009e50 tx=0x7f10a802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d5f83bb5e066d13 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:14.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10ad59a640 1 -- 172.21.15.107:0/589570002 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a802c9e0 con 0x7f10b00caee0 2023-12-16T01:55:14.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10ad59a640 1 -- 172.21.15.107:0/589570002 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f10a802cb40 con 0x7f10b00caee0 2023-12-16T01:55:14.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10ad59a640 1 -- 172.21.15.107:0/589570002 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80343f0 con 0x7f10b00caee0 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10b4846640 1 -- 172.21.15.107:0/589570002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 msgr2=0x7f10b0159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10b4846640 1 --2- 172.21.15.107:0/589570002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 0x7f10b0159760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009e50 tx=0x7f10a802be40 comp rx=0 tx=0).stop 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10b4846640 1 -- 172.21.15.107:0/589570002 shutdown_connections 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10b4846640 1 --2- 172.21.15.107:0/589570002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b00caee0 0x7f10b0159760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10b4846640 1 --2- 172.21.15.107:0/589570002 >> v2:172.21.15.157:3300/0 conn(0x7f10b0071c40 0x7f10b0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.522+0000 7f10b4846640 1 -- 172.21.15.107:0/589570002 >> 172.21.15.107:0/589570002 conn(0x7f10b006cd60 msgr2=0x7f10b006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.523+0000 7f10b4846640 1 -- 172.21.15.107:0/589570002 shutdown_connections 2023-12-16T01:55:14.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.523+0000 7f10b4846640 1 -- 172.21.15.107:0/589570002 wait complete. 2023-12-16T01:55:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 Processor -- start 2023-12-16T01:55:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 -- start start 2023-12-16T01:55:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10b0071c40 0x7f10b013c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10b00caee0 0x7f10b013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 0x7f10b013f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b013e7f0 con 0x7f10b00caee0 2023-12-16T01:55:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b01f1310 con 0x7f10b0071c40 2023-12-16T01:55:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.524+0000 7f10b4846640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b01f15f0 con 0x7f10b014fd70 2023-12-16T01:55:14.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.525+0000 7f10ae59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10b0071c40 0x7f10b013c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.525+0000 7f10aed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 0x7f10b013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.525+0000 7f10ae59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10b0071c40 0x7f10b013c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55222/0 (socket says 172.21.15.107:55222) 2023-12-16T01:55:14.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.525+0000 7f10ae59c640 1 -- 172.21.15.107:0/2211958976 learned_addr learned my addr 172.21.15.107:0/2211958976 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:14.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.525+0000 7f10aed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 0x7f10b013f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:36912/0 (socket says 172.21.15.107:36912) 2023-12-16T01:55:14.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.525+0000 7f10add9b640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10b00caee0 0x7f10b013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.529+0000 7f10aed9d640 1 -- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10b0071c40 msgr2=0x7f10b013c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:14.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.529+0000 7f10aed9d640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10b0071c40 0x7f10b013c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.529+0000 7f10aed9d640 1 -- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10b00caee0 msgr2=0x7f10b013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:14.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.529+0000 7f10aed9d640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10b00caee0 0x7f10b013ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:14.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.529+0000 7f10aed9d640 1 -- 172.21.15.107:0/2211958976 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8009b30 con 0x7f10b014fd70 2023-12-16T01:55:14.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.531+0000 7f10aed9d640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 0x7f10b013f180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10a8032000 tx=0x7f10a8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.535+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a803e450 con 0x7f10b014fd70 2023-12-16T01:55:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.535+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f10a803e5b0 con 0x7f10b014fd70 2023-12-16T01:55:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.535+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a803e980 con 0x7f10b014fd70 2023-12-16T01:55:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.535+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b0150b70 con 0x7f10b014fd70 2023-12-16T01:55:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.535+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b0151130 con 0x7f10b014fd70 2023-12-16T01:55:14.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.536+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b01512c0 con 0x7f10b014fd70 2023-12-16T01:55:14.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.782+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f10a803eae0 con 0x7f10b014fd70 2023-12-16T01:55:14.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.782+0000 7f10a6ffd640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f109006ae90 0x7f109006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:14.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.782+0000 7f10ae59c640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f109006ae90 0x7f109006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:14.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.783+0000 7f10ae59c640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f109006ae90 0x7f109006d350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10a0000f60 tx=0x7f10a0009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:14.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.785+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f10a807b730 con 0x7f10b014fd70 2023-12-16T01:55:14.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:14.796+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f10a8077a70 con 0x7f10b014fd70 2023-12-16T01:55:15.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.009+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10b013e960 con 0x7f10b014fd70 2023-12-16T01:55:15.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.202+0000 7f10a6ffd640 1 -- 172.21.15.107:0/2211958976 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f10b013e960 con 0x7f10b014fd70 2023-12-16T01:55:15.204 INFO:teuthology.orchestra.run.smithi107.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f109006ae90 msgr2=0x7f109006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f109006ae90 0x7f109006d350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10a0000f60 tx=0x7f10a0009040 comp rx=0 tx=0).stop 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 msgr2=0x7f10b013f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 0x7f10b013f180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10a8032000 tx=0x7f10a8004a40 comp rx=0 tx=0).stop 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 shutdown_connections 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10b014fd70 0x7f10b013f180 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10b00caee0 0x7f10b013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f109006ae90 0x7f109006d350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 --2- 172.21.15.107:0/2211958976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10b0071c40 0x7f10b013c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 >> 172.21.15.107:0/2211958976 conn(0x7f10b006cd60 msgr2=0x7f10b0154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 shutdown_connections 2023-12-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.204+0000 7f10b4846640 1 -- 172.21.15.107:0/2211958976 wait complete. 2023-12-16T01:55:15.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-16T01:55:15.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.317+0000 7fb9faa51640 1 Processor -- start 2023-12-16T01:55:15.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.317+0000 7fb9faa51640 1 -- start start 2023-12-16T01:55:15.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.318+0000 7fb9faa51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41515f0 0x7fb9f406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:15.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.318+0000 7fb9faa51640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9f406dde0 0x7fb9f40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:15.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.318+0000 7fb9faa51640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f406ff90 con 0x7fb9f41519d0 2023-12-16T01:55:15.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.318+0000 7fb9faa51640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40c40b0 con 0x7fb9f406dde0 2023-12-16T01:55:15.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.318+0000 7fb9faa51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f406f980 con 0x7fb9f41515f0 2023-12-16T01:55:15.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.319+0000 7fb9f8fee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9f406dde0 0x7fb9f40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:15.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.319+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41515f0 0x7fb9f406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:15.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.319+0000 7fb9f37fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb9f41519d0 0x7fb9f406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:46978/0 (socket says 172.21.15.107:46978) 2023-12-16T01:55:15.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.319+0000 7fb9f37fe640 1 -- 172.21.15.107:0/1017458752 learned_addr learned my addr 172.21.15.107:0/1017458752 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:55:15.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.321+0000 7fb9f3fff640 1 -- 172.21.15.107:0/1017458752 >> v2:172.21.15.107:3300/0 conn(0x7fb9f406dde0 msgr2=0x7fb9f40c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:15.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.321+0000 7fb9f3fff640 1 --2- 172.21.15.107:0/1017458752 >> v2:172.21.15.107:3300/0 conn(0x7fb9f406dde0 0x7fb9f40c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.321+0000 7fb9f3fff640 1 -- 172.21.15.107:0/1017458752 >> v1:172.21.15.157:6789/0 conn(0x7fb9f41519d0 legacy=0x7fb9f406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:15.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.321+0000 7fb9f3fff640 1 -- 172.21.15.107:0/1017458752 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f406e810 con 0x7fb9f41515f0 2023-12-16T01:55:15.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.323+0000 7fb9f3fff640 1 --2- 172.21.15.107:0/1017458752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41515f0 0x7fb9f406b0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40097a0 tx=0x7fb9e402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df774c75a49ff1d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:15.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.327+0000 7fb9f2ffd640 1 -- 172.21.15.107:0/1017458752 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4031830 con 0x7fb9f41515f0 2023-12-16T01:55:15.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.327+0000 7fb9f2ffd640 1 -- 172.21.15.107:0/1017458752 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9e4031990 con 0x7fb9f41515f0 2023-12-16T01:55:15.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.327+0000 7fb9f2ffd640 1 -- 172.21.15.107:0/1017458752 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4031d40 con 0x7fb9f41515f0 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.327+0000 7fb9faa51640 1 -- 172.21.15.107:0/1017458752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41515f0 msgr2=0x7fb9f406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.327+0000 7fb9faa51640 1 --2- 172.21.15.107:0/1017458752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41515f0 0x7fb9f406b0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40097a0 tx=0x7fb9e402b8d0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.328+0000 7fb9faa51640 1 -- 172.21.15.107:0/1017458752 shutdown_connections 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.328+0000 7fb9faa51640 1 --2- 172.21.15.107:0/1017458752 >> v2:172.21.15.107:3300/0 conn(0x7fb9f406dde0 0x7fb9f40c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.328+0000 7fb9faa51640 1 --2- 172.21.15.107:0/1017458752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41515f0 0x7fb9f406b0b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.328+0000 7fb9faa51640 1 -- 172.21.15.107:0/1017458752 >> 172.21.15.107:0/1017458752 conn(0x7fb9f40cbf60 msgr2=0x7fb9f40cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.328+0000 7fb9faa51640 1 -- 172.21.15.107:0/1017458752 shutdown_connections 2023-12-16T01:55:15.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.328+0000 7fb9faa51640 1 -- 172.21.15.107:0/1017458752 wait complete. 2023-12-16T01:55:15.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.329+0000 7fb9faa51640 1 Processor -- start 2023-12-16T01:55:15.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.329+0000 7fb9faa51640 1 -- start start 2023-12-16T01:55:15.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.329+0000 7fb9faa51640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f406dde0 0x7fb9f41edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:15.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9faa51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 0x7fb9f4144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:15.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9faa51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41519d0 0x7fb9f4150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:15.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9faa51640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41edb90 con 0x7fb9f41515f0 2023-12-16T01:55:15.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9faa51640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4145cf0 con 0x7fb9f406dde0 2023-12-16T01:55:15.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9faa51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4156650 con 0x7fb9f41519d0 2023-12-16T01:55:15.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9f37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 0x7fb9f4144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:15.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9f8fee640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41519d0 0x7fb9f4150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:15.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f406dde0 0x7fb9f41edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:15.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9f37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 0x7fb9f4144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33402/0 (socket says 172.21.15.107:33402) 2023-12-16T01:55:15.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.330+0000 7fb9f37fe640 1 -- 172.21.15.107:0/4261507881 learned_addr learned my addr 172.21.15.107:0/4261507881 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:15.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.334+0000 7fb9f37fe640 1 -- 172.21.15.107:0/4261507881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41519d0 msgr2=0x7fb9f4150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:15.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.334+0000 7fb9f37fe640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41519d0 0x7fb9f4150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.334+0000 7fb9f37fe640 1 -- 172.21.15.107:0/4261507881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f406dde0 msgr2=0x7fb9f41edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:15.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.334+0000 7fb9f37fe640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f406dde0 0x7fb9f41edfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:15.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.334+0000 7fb9f37fe640 1 -- 172.21.15.107:0/4261507881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4009400 con 0x7fb9f41515f0 2023-12-16T01:55:15.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.336+0000 7fb9f37fe640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 0x7fb9f4144be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c500 tx=0x7fb9e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:15.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.339+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8005ce0 con 0x7fb9f41515f0 2023-12-16T01:55:15.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.339+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9e8005e40 con 0x7fb9f41515f0 2023-12-16T01:55:15.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.339+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80072f0 con 0x7fb9f41515f0 2023-12-16T01:55:15.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.339+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f4156e60 con 0x7fb9f41515f0 2023-12-16T01:55:15.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.339+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f41568a0 con 0x7fb9f41515f0 2023-12-16T01:55:15.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.340+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f41ed370 con 0x7fb9f41515f0 2023-12-16T01:55:15.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.579+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb9e8007450 con 0x7fb9f41515f0 2023-12-16T01:55:15.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.579+0000 7fb9f0ff9640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb9e006ae90 0x7fb9e006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:15.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.579+0000 7fb9f3fff640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb9e006ae90 0x7fb9e006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:15.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.580+0000 7fb9f3fff640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb9e006ae90 0x7fb9e006d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4036000 tx=0x7fb9e403c040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:15.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.592+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb9e8057fe0 con 0x7fb9f41515f0 2023-12-16T01:55:15.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.592+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb9e8054320 con 0x7fb9f41515f0 2023-12-16T01:55:15.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:15.799+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9f41edcd0 con 0x7fb9f41515f0 2023-12-16T01:55:16.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.187+0000 7fb9f0ff9640 1 -- 172.21.15.107:0/4261507881 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9f41edcd0 con 0x7fb9f41515f0 2023-12-16T01:55:16.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb9e006ae90 msgr2=0x7fb9e006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb9e006ae90 0x7fb9e006d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4036000 tx=0x7fb9e403c040 comp rx=0 tx=0).stop 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 msgr2=0x7fb9f4144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 0x7fb9f4144be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c500 tx=0x7fb9e800c9c0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 shutdown_connections 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9f41519d0 0x7fb9f4150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9f41515f0 0x7fb9f4144be0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fb9e006ae90 0x7fb9e006d350 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 --2- 172.21.15.107:0/4261507881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f406dde0 0x7fb9f41edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 >> 172.21.15.107:0/4261507881 conn(0x7fb9f40cbf60 msgr2=0x7fb9f40c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.189+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 shutdown_connections 2023-12-16T01:55:16.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.190+0000 7fb9faa51640 1 -- 172.21.15.107:0/4261507881 wait complete. 2023-12-16T01:55:16.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-16T01:55:16.302 INFO:tasks.ceph.mds.b.smithi157.stderr:==00:00:29:41.117 92465== 2023-12-16T01:55:16.302 INFO:tasks.ceph.mds.b.smithi157.stderr:==00:00:29:41.117 92465== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T01:55:16.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.307+0000 7f37b8abb640 1 Processor -- start 2023-12-16T01:55:16.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.308+0000 7f37b8abb640 1 -- start start 2023-12-16T01:55:16.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.308+0000 7f37b8abb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 0x7f37b406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:16.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.308+0000 7f37b8abb640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b406f690 con 0x7f37b4156810 2023-12-16T01:55:16.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.308+0000 7f37b8abb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40c8230 con 0x7f37b4070f50 2023-12-16T01:55:16.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.308+0000 7f37b8abb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c0a50 con 0x7f37b414fab0 2023-12-16T01:55:16.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.309+0000 7f37b259c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 0x7f37b406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:16.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.309+0000 7f37b259c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 0x7f37b406f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:36940/0 (socket says 172.21.15.107:36940) 2023-12-16T01:55:16.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.309+0000 7f37b259c640 1 -- 172.21.15.107:0/2445732775 learned_addr learned my addr 172.21.15.107:0/2445732775 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.312+0000 7f37b259c640 1 -- 172.21.15.107:0/2445732775 >> v1:172.21.15.157:6789/0 conn(0x7f37b4070f50 legacy=0x7f37b4156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.312+0000 7f37b259c640 1 -- 172.21.15.107:0/2445732775 >> v1:172.21.15.107:6789/0 conn(0x7f37b4156810 legacy=0x7f37b40c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.312+0000 7f37b1d9b640 1 -- 172.21.15.107:0/2445732775 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443542249 0 0) 0x7f37b406f690 con 0x7f37b4156810 2023-12-16T01:55:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.312+0000 7f37b259c640 1 -- 172.21.15.107:0/2445732775 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40c1380 con 0x7f37b414fab0 2023-12-16T01:55:16.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.314+0000 7f37b259c640 1 --2- 172.21.15.107:0/2445732775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 0x7f37b406f150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37a40098a0 tx=0x7f37a402ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a427e51fdf5a5d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.318+0000 7f37b1d9b640 1 -- 172.21.15.107:0/2445732775 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a402f830 con 0x7f37b414fab0 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.318+0000 7f37b1d9b640 1 -- 172.21.15.107:0/2445732775 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f37a402f990 con 0x7f37b414fab0 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.318+0000 7f37b1d9b640 1 -- 172.21.15.107:0/2445732775 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a402fd40 con 0x7f37b414fab0 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 -- 172.21.15.107:0/2445732775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 msgr2=0x7f37b406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 --2- 172.21.15.107:0/2445732775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 0x7f37b406f150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37a40098a0 tx=0x7f37a402ba10 comp rx=0 tx=0).stop 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 -- 172.21.15.107:0/2445732775 shutdown_connections 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 --2- 172.21.15.107:0/2445732775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b414fab0 0x7f37b406f150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 -- 172.21.15.107:0/2445732775 >> 172.21.15.107:0/2445732775 conn(0x7f37b406cd60 msgr2=0x7f37b406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:16.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 -- 172.21.15.107:0/2445732775 shutdown_connections 2023-12-16T01:55:16.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.319+0000 7f37b8abb640 1 -- 172.21.15.107:0/2445732775 wait complete. 2023-12-16T01:55:16.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.320+0000 7f37b8abb640 1 Processor -- start 2023-12-16T01:55:16.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.320+0000 7f37b8abb640 1 -- start start 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.321+0000 7f37b8abb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4070f50 0x7f37b4149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.321+0000 7f37b8abb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 0x7f37b40c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.321+0000 7f37b8abb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b4156810 0x7f37b41578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.321+0000 7f37b8abb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4155ce0 con 0x7f37b414fab0 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.321+0000 7f37b8abb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4149ac0 con 0x7f37b4070f50 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.321+0000 7f37b8abb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b41efce0 con 0x7f37b4156810 2023-12-16T01:55:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.322+0000 7f37abfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 0x7f37b40c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.322+0000 7f37b259c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4070f50 0x7f37b4149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.322+0000 7f37abfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 0x7f37b40c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33416/0 (socket says 172.21.15.107:33416) 2023-12-16T01:55:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.322+0000 7f37abfff640 1 -- 172.21.15.107:0/408047117 learned_addr learned my addr 172.21.15.107:0/408047117 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.322+0000 7f37b2d9d640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b4156810 0x7f37b41578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:16.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.325+0000 7f37abfff640 1 -- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b4156810 msgr2=0x7f37b41578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:16.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.325+0000 7f37abfff640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b4156810 0x7f37b41578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.325+0000 7f37abfff640 1 -- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4070f50 msgr2=0x7f37b4149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:16.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.325+0000 7f37abfff640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4070f50 0x7f37b4149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:16.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.325+0000 7f37abfff640 1 -- 172.21.15.107:0/408047117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40094d0 con 0x7f37b414fab0 2023-12-16T01:55:16.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.327+0000 7f37abfff640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 0x7f37b40c4500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f379c00b420 tx=0x7f379c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:16.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.331+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c011830 con 0x7f37b414fab0 2023-12-16T01:55:16.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.331+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f379c011990 con 0x7f37b414fab0 2023-12-16T01:55:16.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.331+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b41eff50 con 0x7f37b414fab0 2023-12-16T01:55:16.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.331+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c011d60 con 0x7f37b414fab0 2023-12-16T01:55:16.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.331+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b41570f0 con 0x7f37b414fab0 2023-12-16T01:55:16.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.332+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4067570 con 0x7f37b414fab0 2023-12-16T01:55:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.350+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f379c004020 con 0x7f37b414fab0 2023-12-16T01:55:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.350+0000 7f37aaffd640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f379406ae90 0x7f379406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.351+0000 7f37b259c640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f379406ae90 0x7f379406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:16.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.351+0000 7f37b259c640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f379406ae90 0x7f379406d350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37a4036000 tx=0x7f37a4008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:16.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.357+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f379c058550 con 0x7f37b414fab0 2023-12-16T01:55:16.390 INFO:tasks.ceph.mds.b.smithi157.stderr:daemon-helper: command failed with exit status 42 2023-12-16T01:55:16.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.587+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f379c054890 con 0x7f37b414fab0 2023-12-16T01:55:16.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:16.753+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37b40717c0 con 0x7f37b414fab0 2023-12-16T01:55:16.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-16T01:55:17.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.287+0000 7f37aaffd640 1 -- 172.21.15.107:0/408047117 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f379c057eb0 con 0x7f37b414fab0 2023-12-16T01:55:17.289 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' removed 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f379406ae90 msgr2=0x7f379406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f379406ae90 0x7f379406d350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37a4036000 tx=0x7f37a4008030 comp rx=0 tx=0).stop 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 msgr2=0x7f37b40c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 0x7f37b40c4500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f379c00b420 tx=0x7f379c00b8e0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 shutdown_connections 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37b4156810 0x7f37b41578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37b414fab0 0x7f37b40c4500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f379406ae90 0x7f379406d350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 --2- 172.21.15.107:0/408047117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4070f50 0x7f37b4149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 >> 172.21.15.107:0/408047117 conn(0x7f37b406cd60 msgr2=0x7f37b406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:17.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 shutdown_connections 2023-12-16T01:55:17.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.289+0000 7f37b8abb640 1 -- 172.21.15.107:0/408047117 wait complete. 2023-12-16T01:55:17.303 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-16T01:55:17.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.428+0000 7fe9e5661640 1 Processor -- start 2023-12-16T01:55:17.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.428+0000 7fe9e5661640 1 -- start start 2023-12-16T01:55:17.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.429+0000 7fe9e5661640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9e013d3c0 0x7fe9e00c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.429+0000 7fe9e5661640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e0061580 con 0x7fe9e006bbf0 2023-12-16T01:55:17.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.429+0000 7fe9e5661640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e006b050 con 0x7fe9e00c4e50 2023-12-16T01:55:17.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.429+0000 7fe9e5661640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e0157ed0 con 0x7fe9e013d3c0 2023-12-16T01:55:17.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.429+0000 7fe9d7fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe9e006bbf0 0x7fe9e013ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:42822/0 (socket says 172.21.15.107:42822) 2023-12-16T01:55:17.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.429+0000 7fe9d7fff640 1 -- 172.21.15.107:0/2337272593 learned_addr learned my addr 172.21.15.107:0/2337272593 (peer_addr_for_me v1:172.21.15.107:0/0) 2023-12-16T01:55:17.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.431+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798598651 0 0) 0x7fe9e0061580 con 0x7fe9e006bbf0 2023-12-16T01:55:17.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.431+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9cc003520 con 0x7fe9e006bbf0 2023-12-16T01:55:17.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054077046 0 0) 0x7fe9cc003520 con 0x7fe9e006bbf0 2023-12-16T01:55:17.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 >> v2:172.21.15.157:3300/0 conn(0x7fe9e013d3c0 msgr2=0x7fe9e00c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:17.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 --2- 172.21.15.107:0/2337272593 >> v2:172.21.15.157:3300/0 conn(0x7fe9e013d3c0 0x7fe9e00c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 >> v1:172.21.15.157:6789/0 conn(0x7fe9e00c4e50 legacy=0x7fe9e006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:17.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e01581b0 con 0x7fe9e006bbf0 2023-12-16T01:55:17.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3282932026 0 0) 0x7fe9c8001670 con 0x7fe9e006bbf0 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 >> v1:172.21.15.107:6789/0 conn(0x7fe9e006bbf0 legacy=0x7fe9e013ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9cc0039c0 0x7fe9cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0047c0 0x7fe9cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9cc0052a0 0x7fe9cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0157ed0 con 0x7fe9cc0039c0 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc00c1e0 con 0x7fe9cc0047c0 2023-12-16T01:55:17.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.435+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc00c3a0 con 0x7fe9cc0052a0 2023-12-16T01:55:17.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.438+0000 7fe9deffd640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9cc0039c0 0x7fe9cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:17.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.440+0000 7fe9deffd640 1 -- 172.21.15.107:0/2337272593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9cc0052a0 msgr2=0x7fe9cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:17.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.440+0000 7fe9deffd640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9cc0052a0 0x7fe9cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.440+0000 7fe9deffd640 1 -- 172.21.15.107:0/2337272593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0047c0 msgr2=0x7fe9cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:17.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.440+0000 7fe9deffd640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0047c0 0x7fe9cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.440+0000 7fe9deffd640 1 -- 172.21.15.107:0/2337272593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc003520 con 0x7fe9cc0039c0 2023-12-16T01:55:17.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.440+0000 7fe9df7fe640 1 -- 172.21.15.107:0/2337272593 reap_dead start 2023-12-16T01:55:17.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.442+0000 7fe9deffd640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9cc0039c0 0x7fe9cc003dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0001620 tx=0x7fe9cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862ee6c749a8dfb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:17.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.446+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0005270 con 0x7fe9cc0039c0 2023-12-16T01:55:17.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.446+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe9d002e070 con 0x7fe9cc0039c0 2023-12-16T01:55:17.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.446+0000 7fe9de7fc640 1 -- 172.21.15.107:0/2337272593 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0003610 con 0x7fe9cc0039c0 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 -- 172.21.15.107:0/2337272593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9cc0039c0 msgr2=0x7fe9cc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9cc0039c0 0x7fe9cc003dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0001620 tx=0x7fe9cc0057f0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 -- 172.21.15.107:0/2337272593 shutdown_connections 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2337272593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9cc0039c0 0x7fe9cc003dc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 -- 172.21.15.107:0/2337272593 >> 172.21.15.107:0/2337272593 conn(0x7fe9e00c7fd0 msgr2=0x7fe9e00c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 -- 172.21.15.107:0/2337272593 shutdown_connections 2023-12-16T01:55:17.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.447+0000 7fe9e5661640 1 -- 172.21.15.107:0/2337272593 wait complete. 2023-12-16T01:55:17.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.448+0000 7fe9e5661640 1 Processor -- start 2023-12-16T01:55:17.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.448+0000 7fe9e5661640 1 -- start start 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9e5661640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0039c0 0x7fe9e015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9e5661640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 0x7fe9e01ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9e5661640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e00c4440 0x7fe9e01efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9e5661640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00c4990 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9e5661640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0150940 con 0x7fe9cc0039c0 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9e5661640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e014fee0 con 0x7fe9e00c4440 2023-12-16T01:55:17.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9d7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 0x7fe9e01ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:17.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9d7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 0x7fe9e01ef690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33432/0 (socket says 172.21.15.107:33432) 2023-12-16T01:55:17.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.449+0000 7fe9d7fff640 1 -- 172.21.15.107:0/2962941641 learned_addr learned my addr 172.21.15.107:0/2962941641 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:17.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.453+0000 7fe9d7fff640 1 -- 172.21.15.107:0/2962941641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e00c4440 msgr2=0x7fe9e01efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:17.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.453+0000 7fe9d7fff640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e00c4440 0x7fe9e01efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.453+0000 7fe9d7fff640 1 -- 172.21.15.107:0/2962941641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0039c0 msgr2=0x7fe9e015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:17.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.453+0000 7fe9d7fff640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0039c0 0x7fe9e015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:17.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.453+0000 7fe9d7fff640 1 -- 172.21.15.107:0/2962941641 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e01ef190 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.455+0000 7fe9d7fff640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 0x7fe9e01ef690 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800c7c0 tx=0x7fe9c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:17.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.458+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80074e0 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.458+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe9c8007640 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.458+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8004a40 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.458+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e014fc00 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.458+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e014ecd0 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.459+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e00740e0 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.478+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe9c800a5e0 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.479+0000 7fe9d77fe640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9c006aec0 0x7fe9c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:17.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.479+0000 7fe9deffd640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9c006aec0 0x7fe9c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:17.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.479+0000 7fe9deffd640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9c006aec0 0x7fe9c006d380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0033000 tx=0x7fe9d0005000 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:17.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.713+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6195+0+0 (secure 0 0 0) 0x7fe9c8058860 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.713+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe9c80544a0 con 0x7fe9e00c2cf0 2023-12-16T01:55:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:17.882+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9e01ef3b0 con 0x7fe9e00c2cf0 2023-12-16T01:55:18.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.534+0000 7fe9d77fe640 1 -- 172.21.15.107:0/2962941641 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe9e01ef3b0 con 0x7fe9e00c2cf0 2023-12-16T01:55:18.537 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' removed 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9c006aec0 msgr2=0x7fe9c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9c006aec0 0x7fe9c006d380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0033000 tx=0x7fe9d0005000 comp rx=0 tx=0).stop 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 msgr2=0x7fe9e01ef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 0x7fe9e01ef690 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800c7c0 tx=0x7fe9c800cc80 comp rx=0 tx=0).stop 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 shutdown_connections 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e00c4440 0x7fe9e01efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9e00c2cf0 0x7fe9e01ef690 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7fe9c006aec0 0x7fe9c006d380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 --2- 172.21.15.107:0/2962941641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9cc0039c0 0x7fe9e015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.536+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 >> 172.21.15.107:0/2962941641 conn(0x7fe9e00c7fd0 msgr2=0x7fe9e00c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.537+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 shutdown_connections 2023-12-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.537+0000 7fe9e5661640 1 -- 172.21.15.107:0/2962941641 wait complete. 2023-12-16T01:55:18.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-16T01:55:18.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 Processor -- start 2023-12-16T01:55:18.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 -- start start 2023-12-16T01:55:18.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36540cafa0 0x7f365415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:18.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f365415aa50 0x7f36540cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:18.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365406b970 con 0x7f3654153900 2023-12-16T01:55:18.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36540cb600 con 0x7f36540cafa0 2023-12-16T01:55:18.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.655+0000 7f365aa5c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3654153ce0 con 0x7f365415aa50 2023-12-16T01:55:18.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.656+0000 7f36537fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36540cafa0 0x7f365415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:18.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.656+0000 7f36537fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36540cafa0 0x7f365415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33444/0 (socket says 172.21.15.107:33444) 2023-12-16T01:55:18.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.656+0000 7f36537fe640 1 -- 172.21.15.107:0/625683093 learned_addr learned my addr 172.21.15.107:0/625683093 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:18.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.657+0000 7f3658ff9640 1 --2- 172.21.15.107:0/625683093 >> v2:172.21.15.157:3300/0 conn(0x7f365415aa50 0x7f36540cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:18.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.659+0000 7f36537fe640 1 -- 172.21.15.107:0/625683093 >> v2:172.21.15.157:3300/0 conn(0x7f365415aa50 msgr2=0x7f36540cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T01:55:18.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.659+0000 7f36537fe640 1 --2- 172.21.15.107:0/625683093 >> v2:172.21.15.157:3300/0 conn(0x7f365415aa50 0x7f36540cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.659+0000 7f36537fe640 1 -- 172.21.15.107:0/625683093 >> v1:172.21.15.157:6789/0 conn(0x7f3654153900 legacy=0x7f365406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:18.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.659+0000 7f36537fe640 1 -- 172.21.15.107:0/625683093 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36540c9cc0 con 0x7f36540cafa0 2023-12-16T01:55:18.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.660+0000 7f36537fe640 1 --2- 172.21.15.107:0/625683093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f365415d530 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36540c2440 tx=0x7f364802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942ba17d284208a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:18.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.664+0000 7f3652ffd640 1 -- 172.21.15.107:0/625683093 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648030860 con 0x7f36540cafa0 2023-12-16T01:55:18.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.664+0000 7f3652ffd640 1 -- 172.21.15.107:0/625683093 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f36480309c0 con 0x7f36540cafa0 2023-12-16T01:55:18.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.664+0000 7f3652ffd640 1 -- 172.21.15.107:0/625683093 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648030d70 con 0x7f36540cafa0 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 -- 172.21.15.107:0/625683093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 msgr2=0x7f365415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 --2- 172.21.15.107:0/625683093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f365415d530 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36540c2440 tx=0x7f364802b9a0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 -- 172.21.15.107:0/625683093 shutdown_connections 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 --2- 172.21.15.107:0/625683093 >> v2:172.21.15.157:3300/0 conn(0x7f365415aa50 0x7f36540cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 --2- 172.21.15.107:0/625683093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f365415d530 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 -- 172.21.15.107:0/625683093 >> 172.21.15.107:0/625683093 conn(0x7f3654061100 msgr2=0x7f3654061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 -- 172.21.15.107:0/625683093 shutdown_connections 2023-12-16T01:55:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.665+0000 7f365aa5c640 1 -- 172.21.15.107:0/625683093 wait complete. 2023-12-16T01:55:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.666+0000 7f365aa5c640 1 Processor -- start 2023-12-16T01:55:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 -- start start 2023-12-16T01:55:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f36541524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3654153900 0x7f36541e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f365415aa50 0x7f36541eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540c92f0 con 0x7f36540cafa0 2023-12-16T01:55:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36541e3f30 con 0x7f365415aa50 2023-12-16T01:55:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.667+0000 7f365aa5c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36541f30b0 con 0x7f3654153900 2023-12-16T01:55:18.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.668+0000 7f3653fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f36541524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:18.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.668+0000 7f3658ff9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f365415aa50 0x7f36541eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:18.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.668+0000 7f3653fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f36541524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33460/0 (socket says 172.21.15.107:33460) 2023-12-16T01:55:18.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.668+0000 7f3653fff640 1 -- 172.21.15.107:0/692874047 learned_addr learned my addr 172.21.15.107:0/692874047 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-12-16T01:55:18.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.668+0000 7f36537fe640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3654153900 0x7f36541e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:18.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.671+0000 7f3653fff640 1 -- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3654153900 msgr2=0x7f36541e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:18.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.671+0000 7f3653fff640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3654153900 0x7f36541e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.671+0000 7f3653fff640 1 -- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f365415aa50 msgr2=0x7f36541eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:18.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.671+0000 7f3653fff640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f365415aa50 0x7f36541eefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:18.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.671+0000 7f3653fff640 1 -- 172.21.15.107:0/692874047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480094d0 con 0x7f36540cafa0 2023-12-16T01:55:18.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.674+0000 7f3653fff640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f36541524a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f364400c400 tx=0x7f364400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:18.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.677+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440052d0 con 0x7f36540cafa0 2023-12-16T01:55:18.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.677+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3644005450 con 0x7f36540cafa0 2023-12-16T01:55:18.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.677+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644007280 con 0x7f36540cafa0 2023-12-16T01:55:18.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.677+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36541f24a0 con 0x7f36540cafa0 2023-12-16T01:55:18.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.677+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36541f2a60 con 0x7f36540cafa0 2023-12-16T01:55:18.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.678+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3654067570 con 0x7f36540cafa0 2023-12-16T01:55:18.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.696+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f36440073e0 con 0x7f36540cafa0 2023-12-16T01:55:18.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.697+0000 7f3650ff9640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f364006ae90 0x7f364006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T01:55:18.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.697+0000 7f36537fe640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f364006ae90 0x7f364006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T01:55:18.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.697+0000 7f36537fe640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f364006ae90 0x7f364006d350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3648036000 tx=0x7f3648008030 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T01:55:18.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.932+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5752+0+0 (secure 0 0 0) 0x7f3644057d60 con 0x7f36540cafa0 2023-12-16T01:55:18.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:18.932+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3644054010 con 0x7f36540cafa0 2023-12-16T01:55:19.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.099+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36541eed90 con 0x7f36540cafa0 2023-12-16T01:55:19.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.545+0000 7f3650ff9640 1 -- 172.21.15.107:0/692874047 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3644055f40 con 0x7f36540cafa0 2023-12-16T01:55:19.548 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data_ec' removed 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f364006ae90 msgr2=0x7f364006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f364006ae90 0x7f364006d350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3648036000 tx=0x7f3648008030 comp rx=0 tx=0).stop 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 msgr2=0x7f36541524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f36541524a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f364400c400 tx=0x7f364400c8c0 comp rx=0 tx=0).stop 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 shutdown_connections 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:6832/3457421284,v1:172.21.15.107:6833/3457421284] conn(0x7f364006ae90 0x7f364006d350 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f365415aa50 0x7f36541eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:19.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3654153900 0x7f36541e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:19.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 --2- 172.21.15.107:0/692874047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36540cafa0 0x7f36541524a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T01:55:19.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 >> 172.21.15.107:0/692874047 conn(0x7f3654061100 msgr2=0x7f365414e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T01:55:19.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 shutdown_connections 2023-12-16T01:55:19.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-12-16T01:55:19.548+0000 7f365aa5c640 1 -- 172.21.15.107:0/692874047 wait complete. 2023-12-16T01:55:19.561 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-16T01:55:19.561 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-16T01:55:19.561 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:55:19.577 INFO:tasks.ceph.mds.a.smithi107.stderr:2023-12-16T01:55:19.564+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 92723) UID: 0 2023-12-16T01:55:19.577 INFO:tasks.ceph.mds.a.smithi107.stderr:2023-12-16T01:55:19.566+0000 b5b0640 -1 mds.a *** got signal Terminated *** 2023-12-16T01:55:23.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-16T01:55:23.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-12-16T01:55:25.663 INFO:tasks.ceph.mds.a:Stopped 2023-12-16T01:55:25.663 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-16T01:55:25.663 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:55:25.678 INFO:tasks.ceph.mds.c.smithi107.stderr:2023-12-16T01:55:25.666+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 92731) UID: 0 2023-12-16T01:55:25.679 INFO:tasks.ceph.mds.c.smithi107.stderr:2023-12-16T01:55:25.668+0000 b5b0640 -1 mds.c *** got signal Terminated *** 2023-12-16T01:55:30.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~14s 2023-12-16T01:55:30.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-16T01:55:31.765 INFO:tasks.ceph.mds.c:Stopped 2023-12-16T01:55:31.765 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-12-16T01:55:31.765 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:55:31.779 INFO:tasks.ceph.mds.e.smithi107.stderr:2023-12-16T01:55:31.768+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 92733) UID: 0 2023-12-16T01:55:31.780 INFO:tasks.ceph.mds.e.smithi107.stderr:2023-12-16T01:55:31.769+0000 b5b0640 -1 mds.e *** got signal Terminated *** 2023-12-16T01:55:36.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:55:36.505 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:55:36.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-12-16T01:55:36.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2023-12-16T01:55:37.867 INFO:tasks.ceph.mds.e:Stopped 2023-12-16T01:55:37.867 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-16T01:55:37.867 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:55:37.868 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T01:55:37.868 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2023-12-16T01:55:37.869 INFO:tasks.ceph.mds.b:Stopped 2023-12-16T01:55:37.869 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-16T01:55:37.869 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:55:37.884 INFO:tasks.ceph.mds.d.smithi157.stderr:2023-12-16T01:55:37.872+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 92461) UID: 0 2023-12-16T01:55:37.885 INFO:tasks.ceph.mds.d.smithi157.stderr:2023-12-16T01:55:37.873+0000 b5b0640 -1 mds.d *** got signal Terminated *** 2023-12-16T01:55:43.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-16T01:55:43.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-12-16T01:55:56.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-16T01:55:56.172 INFO:tasks.ceph.mds.d:Stopped 2023-12-16T01:55:56.173 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-12-16T01:55:56.173 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:55:56.188 INFO:tasks.ceph.mds.f.smithi157.stderr:2023-12-16T01:55:56.175+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 92460) UID: 0 2023-12-16T01:55:56.188 INFO:tasks.ceph.mds.f.smithi157.stderr:2023-12-16T01:55:56.177+0000 b5b0640 -1 mds.f *** got signal Terminated *** 2023-12-16T01:56:02.274 INFO:tasks.ceph.mds.f:Stopped 2023-12-16T01:56:02.274 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-16T01:56:02.274 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-16T01:56:02.274 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:02.275 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-12-16T01:56:02.274+0000 7fcbe7ab1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 88926) UID: 0 2023-12-16T01:56:02.275 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-12-16T01:56:02.274+0000 7fcbe7ab1640 -1 osd.0 37 *** Got signal Terminated *** 2023-12-16T01:56:02.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-16T01:56:06.605 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:56:06.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:56:08.375 INFO:tasks.ceph.osd.0:Stopped 2023-12-16T01:56:08.376 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-16T01:56:08.376 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:08.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-12-16T01:56:08.375+0000 7f6968b9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 88927) UID: 0 2023-12-16T01:56:08.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-12-16T01:56:08.375+0000 7f6968b9a640 -1 osd.1 38 *** Got signal Terminated *** 2023-12-16T01:56:08.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-16T01:56:14.477 INFO:tasks.ceph.osd.1:Stopped 2023-12-16T01:56:14.478 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-16T01:56:14.478 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:14.479 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-12-16T01:56:14.477+0000 7fb729e9f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 88930) UID: 0 2023-12-16T01:56:14.479 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-12-16T01:56:14.477+0000 7fb729e9f640 -1 osd.2 40 *** Got signal Terminated *** 2023-12-16T01:56:14.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-16T01:56:14.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-16T01:56:20.579 INFO:tasks.ceph.osd.2:Stopped 2023-12-16T01:56:20.579 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-16T01:56:20.579 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:20.580 INFO:tasks.ceph.osd.3.smithi107.stderr:2023-12-16T01:56:20.579+0000 7f5022349640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 88932) UID: 0 2023-12-16T01:56:20.580 INFO:tasks.ceph.osd.3.smithi107.stderr:2023-12-16T01:56:20.579+0000 7f5022349640 -1 osd.3 41 *** Got signal Terminated *** 2023-12-16T01:56:20.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-16T01:56:20.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-16T01:56:22.765 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:31:20.056 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.770 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:31:20.061 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.814 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:31:20.105 88656== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.821 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:31:20.045 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.823 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:31:20.047 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.825 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:31:20.049 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.834 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:31:20.058 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.876 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:31:20.099 88340== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:22.882 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:31:20.106 88339== Warning: unimplemented fcntl command: 1036 2023-12-16T01:56:26.681 INFO:tasks.ceph.osd.3:Stopped 2023-12-16T01:56:26.681 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-16T01:56:26.681 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:26.682 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-12-16T01:56:26.679+0000 7fd498e01640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 88928) UID: 0 2023-12-16T01:56:26.682 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-12-16T01:56:26.679+0000 7fd498e01640 -1 osd.4 42 *** Got signal Terminated *** 2023-12-16T01:56:26.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-16T01:56:26.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-16T01:56:32.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-16T01:56:32.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-16T01:56:32.783 INFO:tasks.ceph.osd.4:Stopped 2023-12-16T01:56:32.784 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-16T01:56:32.784 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:32.785 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-12-16T01:56:32.783+0000 7f8009e3f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 88927) UID: 0 2023-12-16T01:56:32.785 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-12-16T01:56:32.783+0000 7f8009e3f640 -1 osd.5 43 *** Got signal Terminated *** 2023-12-16T01:56:36.917 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:56:36.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:56:38.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-16T01:56:38.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-16T01:56:38.885 INFO:tasks.ceph.osd.5:Stopped 2023-12-16T01:56:38.885 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-16T01:56:38.885 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:38.886 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-12-16T01:56:38.885+0000 7fe71212a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 88931) UID: 0 2023-12-16T01:56:38.886 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-12-16T01:56:38.885+0000 7fe71212a640 -1 osd.6 44 *** Got signal Terminated *** 2023-12-16T01:56:43.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-16T01:56:43.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-16T01:56:44.986 INFO:tasks.ceph.osd.6:Stopped 2023-12-16T01:56:44.987 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-16T01:56:44.987 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:44.988 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-12-16T01:56:44.986+0000 7fca9e07f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 88933) UID: 0 2023-12-16T01:56:44.988 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-12-16T01:56:44.986+0000 7fca9e07f640 -1 osd.7 44 *** Got signal Terminated *** 2023-12-16T01:56:49.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-16T01:56:49.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-16T01:56:51.088 INFO:tasks.ceph.osd.7:Stopped 2023-12-16T01:56:51.088 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-16T01:56:51.089 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-16T01:56:51.089 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:51.090 INFO:tasks.ceph.mgr.y.smithi107.stderr:2023-12-16T01:56:51.088+0000 7f168e630640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 88675) UID: 0 2023-12-16T01:56:51.116 INFO:tasks.ceph.mgr.y:Stopped 2023-12-16T01:56:51.117 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-16T01:56:51.117 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:51.144 INFO:tasks.ceph.mgr.x:Stopped 2023-12-16T01:56:51.144 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-16T01:56:51.145 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-16T01:56:51.145 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:51.171 INFO:tasks.ceph.mon.a.smithi107.stderr:2023-12-16T01:56:51.159+0000 9f5a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 88638) UID: 0 2023-12-16T01:56:51.171 INFO:tasks.ceph.mon.a.smithi107.stderr:2023-12-16T01:56:51.161+0000 9f5a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T01:56:51.774 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:31:49.065 88656== 2023-12-16T01:56:51.774 INFO:tasks.ceph.mon.a.smithi107.stderr:==00:00:31:49.065 88656== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T01:56:51.787 INFO:tasks.ceph.mon.a.smithi107.stderr:daemon-helper: command failed with exit status 42 2023-12-16T01:56:54.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-16T01:56:54.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-16T01:56:57.247 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T01:56:57.247 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-12-16T01:56:57.248 INFO:tasks.ceph.mon.a:Stopped 2023-12-16T01:56:57.248 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-16T01:56:57.248 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:56:57.265 INFO:tasks.ceph.mon.b.smithi157.stderr:2023-12-16T01:56:57.251+0000 9f5a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 88332) UID: 0 2023-12-16T01:56:57.265 INFO:tasks.ceph.mon.b.smithi157.stderr:2023-12-16T01:56:57.252+0000 9f5a640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-16T01:56:57.911 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:31:55.135 88339== 2023-12-16T01:56:57.911 INFO:tasks.ceph.mon.b.smithi157.stderr:==00:00:31:55.135 88339== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T01:56:57.922 INFO:tasks.ceph.mon.b.smithi157.stderr:daemon-helper: command failed with exit status 42 2023-12-16T01:56:59.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-16T01:56:59.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-16T01:57:03.350 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T01:57:03.350 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-12-16T01:57:03.351 INFO:tasks.ceph.mon.b:Stopped 2023-12-16T01:57:03.351 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-16T01:57:03.351 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T01:57:03.368 INFO:tasks.ceph.mon.c.smithi157.stderr:2023-12-16T01:57:03.354+0000 9f5a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 88334) UID: 0 2023-12-16T01:57:03.368 INFO:tasks.ceph.mon.c.smithi157.stderr:2023-12-16T01:57:03.355+0000 9f5a640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-12-16T01:57:04.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-16T01:57:06.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:57:07.000 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:57:37.177 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:57:37.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:58:07.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:58:07.509 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:58:37.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:58:37.642 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:59:07.773 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:59:07.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:59:37.936 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T01:59:37.940 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:00:08.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:00:08.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:00:38.213 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:00:38.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:01:08.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:01:08.286 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:01:38.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:01:38.349 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:02:02.417 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-16T02:02:02.417 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-12-16T02:02:02.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T02:02:02.506 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-16T02:02:02.596 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T02:02:02.596 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-16T02:02:02.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T02:02:02.651 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-16T02:02:02.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T02:02:02.710 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-16T02:02:02.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T02:02:02.786 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-16T02:02:03.002 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T02:02:03.003 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-16T02:02:03.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T02:02:03.053 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-16T02:02:03.103 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T02:02:03.103 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-16T02:02:03.170 INFO:tasks.ceph:Archiving mon data... 2023-12-16T02:02:03.172 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/data/mon.a.tgz 2023-12-16T02:02:03.172 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2023-12-16T02:02:03.188 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.1LnYRHPIR2 2023-12-16T02:02:03.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1LnYRHPIR2 2023-12-16T02:02:03.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.1LnYRHPIR2 2023-12-16T02:02:03.416 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.1LnYRHPIR2 is 339KB 2023-12-16T02:02:03.512 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.1LnYRHPIR2 2023-12-16T02:02:03.526 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/data/mon.b.tgz 2023-12-16T02:02:03.527 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-12-16T02:02:03.541 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.BfUrgijyjV 2023-12-16T02:02:03.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BfUrgijyjV 2023-12-16T02:02:03.682 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.BfUrgijyjV 2023-12-16T02:02:03.767 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.BfUrgijyjV is 341KB 2023-12-16T02:02:03.862 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.BfUrgijyjV 2023-12-16T02:02:03.876 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/data/mon.c.tgz 2023-12-16T02:02:03.876 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-12-16T02:02:03.929 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.cPO1BXBLAi 2023-12-16T02:02:03.929 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cPO1BXBLAi 2023-12-16T02:02:04.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.cPO1BXBLAi 2023-12-16T02:02:04.140 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.cPO1BXBLAi is 341KB 2023-12-16T02:02:04.236 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.cPO1BXBLAi 2023-12-16T02:02:04.250 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-16T02:02:04.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T02:02:04.252 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T02:02:04.607 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T02:02:04.863 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 52, column 1 (, line 52) 2023-12-16T02:02:04.868 INFO:tasks.ceph:Archiving crash dumps... 2023-12-16T02:02:04.869 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/remote/smithi107/crash 2023-12-16T02:02:04.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T02:02:04.898 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/remote/smithi157/crash 2023-12-16T02:02:04.899 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T02:02:04.926 INFO:tasks.ceph:Shutting down logrotate 2023-12-16T02:02:04.927 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:02:04.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T02:02:05.022 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-16T02:02:05.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-16T02:02:05.075 INFO:tasks.ceph:Compressing logs... 2023-12-16T02:02:05.076 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T02:02:05.091 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88745.log 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88624.log 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88745.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88745.log.gz 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88624.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88624.log.gz 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr: 55.8% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-12-16T02:02:05.168 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/valgrind/mds.f.log: 57.4% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88665.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88582.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr: 57.5% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88665.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88665.log.gz 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88582.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88582.log.gz 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88533.log 2023-12-16T02:02:05.169 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88533.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: 93.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88533.log.gz 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88836.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88836.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88836.log.gz 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88787.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88787.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88787.log.gz 2023-12-16T02:02:05.170 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-16T02:02:05.174 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T02:02:05.174 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88705.log 2023-12-16T02:02:05.175 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-16T02:02:05.175 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88705.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88705.log.gz 2023-12-16T02:02:05.178 INFO:teuthology.orchestra.run.smithi157.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-16T02:02:05.178 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-16T02:02:05.192 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88969.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95436.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.88969.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95436.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88969.log.gz 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101406.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95436.log.gz 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96718.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94896.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96978.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101406.log.gz 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94896.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96718.log.gz 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95100.log 2023-12-16T02:02:05.193 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94896.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93477.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95100.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.96978.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96292.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95100.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95911.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96292.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93477.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99834.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1%/var/log/ceph/ceph-client.admin.95911.log: -- replaced with /var/log/ceph/ceph-client.admin.96292.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93183.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95911.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97524.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93183.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99834.log.gz 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101590.log 2023-12-16T02:02:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97524.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93183.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101071.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93705.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.97524.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101590.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93099.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95604.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93705.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101071.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93099.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93099.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.93705.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95604.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-12-16T02:02:05.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr: 76.9%/var/log/ceph/valgrind/mon.a.log: -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95184.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100819.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101155.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100819.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95184.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93267.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101155.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100819.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100861.log 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.101155.log.gz 2023-12-16T02:02:05.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96182.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100861.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93267.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100102.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100861.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94974.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96182.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97146.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94974.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100102.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97020.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94974.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101113.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97146.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94686.log 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97020.log.gz 2023-12-16T02:02:05.197 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92785.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4%/var/log/ceph/ceph-client.admin.94686.log: -- replaced with /var/log/ceph/ceph-client.admin.101113.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92740.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94686.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100693.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97062.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92785.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100693.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92740.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99792.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100693.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94728.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99792.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97062.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95602.log 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99792.log.gz 2023-12-16T02:02:05.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96578.log 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94728.log.gz 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96598.log 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96578.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.95602.log.gz -5 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.100524.log 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96598.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96578.log.gz 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93351.log 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96598.log.gz 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95895.log 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93351.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100524.log.gz 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99960.log 2023-12-16T02:02:05.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95895.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93351.log.gz 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94770.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95895.log.gz 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97440.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94770.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99960.log.gz -5 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96498.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97440.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94770.log.gz 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92846.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97440.log.gz 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96498.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92846.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96498.log.gz 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93603.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92846.log.gz 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95058.log 2023-12-16T02:02:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97482.log 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95058.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93603.log.gz 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101239.log 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96538.log 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95058.log.gz 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97482.log: /var/log/ceph/ceph-client.admin.101239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92625.log 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97482.log.gz 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96538.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101239.log.gz 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95989.log 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96538.log.gz 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93561.log 2023-12-16T02:02:05.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92625.log: /var/log/ceph/ceph-client.admin.95989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95887.log 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92625.log.gz 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100945.log 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95989.log.gz 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95887.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93561.log.gz 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96402.log 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95887.log.gz 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93057.log 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101466.log 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100945.log.gz 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96402.log.gz 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100987.log 2023-12-16T02:02:05.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93057.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93013.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101466.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5/var/log/ceph/ceph-client.admin.100987.log: --verbose -- /var/log/ceph/ceph-client.admin.96352.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100018.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100987.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96352.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93013.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96918.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100018.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96352.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96658.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100018.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96918.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96918.log.gz 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95226.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96242.log 2023-12-16T02:02:05.203 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96658.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95804.log 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95226.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93435.log 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3%/var/log/ceph/ceph-client.admin.95804.log: -- replaced with /var/log/ceph/ceph-client.admin.96242.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95352.log 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95804.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99876.log 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93435.log: /var/log/ceph/ceph-client.admin.95352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101506.log 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93435.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99876.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95352.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95984.log 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99876.log.gz 2023-12-16T02:02:05.204 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96162.log 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101506.log: /var/log/ceph/ceph-client.admin.95984.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82647.log 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101506.log.gz 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95984.log.gz 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94544.log 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94586.log 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96162.log.gz 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.tmp-client.admin.82647.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82647.log.gz 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94418.log 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94544.log.gz 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97272.log 2023-12-16T02:02:05.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93309.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94586.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97272.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94418.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95618.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97272.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93393.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93309.log: /var/log/ceph/ceph-client.admin.95618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95268.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93309.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95618.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96372.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95016.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95268.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93393.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96372.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95268.log.gz 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100144.log 2023-12-16T02:02:05.206 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96372.log.gz 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100228.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95016.log: /var/log/ceph/ceph-client.admin.100144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96792.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95016.log.gz 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100228.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100144.log.gz 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100228.log.gz 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97356.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97398.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.3.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96792.log.gz 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100472.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97356.log.gz 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101800.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100472.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.97398.log.gz -5 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97652.log 2023-12-16T02:02:05.207 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100472.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97104.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94180.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101800.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97652.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100429.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94628.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94180.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97104.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95615.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94628.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93141.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100429.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94628.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93645.log 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95615.log.gz 2023-12-16T02:02:05.208 INFO:teuthology.orchestra.run.smithi107.stderr: --/var/log/ceph/ceph-client.admin.93141.log: /var/log/ceph/ceph-mds.e.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93645.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93141.log.gz 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93645.log.gz 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.94180.log.gz 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92916.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101548.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100651.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92916.log.gz 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100387.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101548.log.gz 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101674.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100651.log: /var/log/ceph/ceph-client.admin.100387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101716.log 2023-12-16T02:02:05.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101674.log: 88.3% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100651.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100387.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101674.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98038.log 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95310.log 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101716.log: /var/log/ceph/ceph-client.0.98038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96263.log 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95310.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101716.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93225.log 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95310.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101346.log 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96263.log: /var/log/ceph/ceph-client.admin.93225.log: 89.2% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96263.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93225.log.gz 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93771.log 2023-12-16T02:02:05.210 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95142.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101346.log: /var/log/ceph/ceph-client.admin.93771.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101346.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93771.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101197.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr: /var/log/ceph/ceph-client.admin.100903.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101197.log: /var/log/ceph/ceph-client.admin.95142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100186.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101197.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95142.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100903.log: 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100903.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95619.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100186.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99918.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95619.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100186.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95619.log.gz 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96834.log 2023-12-16T02:02:05.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94502.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99918.log: /var/log/ceph/ceph-client.admin.96834.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99918.log.gz 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96834.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94460.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99750.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94502.log: /var/log/ceph/ceph-client.admin.94460.log: 88.2% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94502.log.gz 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94460.log.gz 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94854.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96876.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99750.log.gz 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95394.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96876.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94854.log.gz 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96876.log.gz 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95614.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T02:02:05.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95394.log: /var/log/ceph/ceph-client.admin.95614.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95394.log.gz 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95614.log.gzgzip 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100060.log 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101029.log 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.100060.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100060.log.gz 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100609.log 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101029.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101029.log.gz 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100609.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100609.log.gz 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97188.log 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.2.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101304.log 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97188.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97188.log.gz 2023-12-16T02:02:05.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95834.log 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101304.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101304.log.gz 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95834.log.gz 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95918.log 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95603.log 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95918.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95918.log.gz 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97230.log 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95603.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95603.log.gz 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100777.log 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97230.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97230.log.gz 2023-12-16T02:02:05.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89094.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100777.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100777.log.gz 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96717.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.89094.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89094.log.gz 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88677.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96717.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96717.log.gz 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93519.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.88677.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.88677.log.gz 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100567.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93519.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93519.log.gz 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101632.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100567.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100567.log.gz 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101842.log 2023-12-16T02:02:05.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101632.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101632.log.gz 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94812.log 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101842.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101842.log.gz 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97314.log 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94812.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94812.log.gz 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97314.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97314.log.gz 2023-12-16T02:02:05.216 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100735.log 2023-12-16T02:02:05.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.a.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-16T02:02:05.218 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101758.log 2023-12-16T02:02:05.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100735.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100735.log.gz 2023-12-16T02:02:05.218 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95617.log 2023-12-16T02:02:05.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101758.log.gz 2023-12-16T02:02:05.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.95617.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95617.log.gz 2023-12-16T02:02:05.230 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-16T02:02:05.402 INFO:teuthology.orchestra.run.smithi107.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-16T02:02:05.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2023-12-16T02:02:05.644 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-16T02:02:05.783 INFO:teuthology.orchestra.run.smithi157.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-16T02:02:05.838 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:37:03.062 88340== 2023-12-16T02:02:05.838 INFO:tasks.ceph.mon.c.smithi157.stderr:==00:00:37:03.062 88340== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T02:02:05.850 INFO:tasks.ceph.mon.c.smithi157.stderr:daemon-helper: command failed with exit status 42 2023-12-16T02:02:06.531 INFO:teuthology.orchestra.run.smithi107.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-16T02:02:07.920 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-16T02:02:08.468 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-16T02:02:08.602 INFO:teuthology.orchestra.run.smithi107.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-16T02:02:08.956 INFO:teuthology.orchestra.run.smithi107.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-16T02:02:08.956 INFO:teuthology.orchestra.run.smithi107.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-16T02:02:09.253 INFO:teuthology.orchestra.run.smithi107.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-16T02:02:09.486 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-16T02:02:09.625 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-16T02:02:10.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-16T02:02:15.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2023-12-16T02:02:16.612 INFO:teuthology.orchestra.run.smithi107.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.98038.log.gz 2023-12-16T02:02:16.614 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-12-16T02:02:16.614 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m11.510s 2023-12-16T02:02:16.614 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m27.310s 2023-12-16T02:02:16.614 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.920s 2023-12-16T02:02:20.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~10s 2023-12-16T02:02:24.896 INFO:teuthology.orchestra.run.smithi157.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-16T02:02:24.898 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-12-16T02:02:24.899 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m19.762s 2023-12-16T02:02:24.899 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m34.595s 2023-12-16T02:02:24.899 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m1.127s 2023-12-16T02:02:24.899 INFO:tasks.ceph:Archiving logs... 2023-12-16T02:02:24.900 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/remote/smithi107/log 2023-12-16T02:02:24.901 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T02:02:25.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~15s 2023-12-16T02:02:29.086 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/remote/smithi157/log 2023-12-16T02:02:29.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T02:02:30.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~20s 2023-12-16T02:02:34.460 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T02:02:34.462 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T02:02:34.472 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T02:02:34.473 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T02:02:34.473 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T02:02:34.476 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T02:02:34.567 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T02:02:34.577 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T02:02:34.577 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T02:02:34.580 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T02:02:34.593 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2023-12-16T02:02:34.596 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2023-12-16T02:02:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T02:02:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2023-12-16T02:02:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 +279us[ +305us] +/- 75ms 2023-12-16T02:02:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -37us[ -11us] +/- 57ms 2023-12-16T02:02:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -223us[ -197us] +/- 85ms 2023-12-16T02:02:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T02:02:34.600 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T02:02:34.601 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-12-16T02:02:34.601 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +252us[ +252us] +/- 75ms 2023-12-16T02:02:34.601 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -78us[ -82us] +/- 57ms 2023-12-16T02:02:34.601 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -245us[ -249us] +/- 85ms 2023-12-16T02:02:34.601 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T02:02:34.602 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T02:02:34.610 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T02:02:34.611 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T02:02:34.619 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T02:02:34.742 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T02:02:34.842 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T02:02:34.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:02:34.875 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T02:02:34.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:02:34.908 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T02:02:34.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T02:02:34.927 INFO:teuthology.task.internal:Duration was 3071.376746 seconds 2023-12-16T02:02:34.927 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T02:02:34.936 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T02:02:34.936 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T02:02:34.939 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T02:02:34.981 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T02:02:34.992 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T02:02:35.293 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T02:02:35.293 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2023-12-16T02:02:35.294 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T02:02:35.312 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2023-12-16T02:02:35.313 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T02:02:35.335 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T02:02:35.335 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T02:02:35.355 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T02:02:35.403 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T02:02:35.403 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T02:02:35.422 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T02:02:35.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T02:02:35.564 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T02:02:35.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T02:02:35.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T02:02:35.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T02:02:35.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T02:02:35.633 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T02:02:35.656 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2023-12-16T02:02:35.684 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2023-12-16T02:02:35.718 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T02:02:35.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:02:35.732 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T02:02:35.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2023-12-16T02:02:35.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:02:35.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T02:02:35.782 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T02:02:35.783 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/remote/smithi107 2023-12-16T02:02:35.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T02:02:35.820 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430/remote/smithi157 2023-12-16T02:02:35.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T02:02:35.858 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T02:02:35.858 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T02:02:35.860 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T02:02:35.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T02:02:35.917 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T02:02:35.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T02:02:35.927 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T02:02:35.928 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T02:02:35.930 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T02:02:35.942 INFO:teuthology.orchestra.run.smithi107.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 02:02 /home/ubuntu/cephtest 2023-12-16T02:02:35.959 INFO:teuthology.orchestra.run.smithi157.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 02:02 /home/ubuntu/cephtest 2023-12-16T02:02:35.960 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T02:02:35.970 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T02:02:35.983 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T02:02:35.983 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T02:02:36.010 DEBUG:teuthology.nuke:shortname: smithi107 2023-12-16T02:02:36.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T02:02:36.034 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 01:01:32.727269', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLT84M/AV4/HUmQiSlGYB/nrejtLpviyEn/4EtWnZz8KcMAU5KAdOrigkJ236Kj6RvLUrCQ7ad/npxeP8t5sPhU='} 2023-12-16T02:02:36.038 DEBUG:teuthology.nuke:shortname: smithi157 2023-12-16T02:02:36.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T02:02:36.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 01:01:32.725399', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDoiuyy1K2+BNhSVOZJEcguRfEKbkT4j6v44LDb2O/Dc/gQv5MX3eYQww3y/nyYUkzBDgBHlMN6IPUlnTKInKo='} 2023-12-16T02:02:36.087 INFO:teuthology.orchestra.console.smithi107:Power off 2023-12-16T02:02:36.087 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T02:02:36.101 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-16T02:02:36.101 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T02:02:36.109 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-12-16T02:02:36.109 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T02:02:36.124 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-16T02:02:36.124 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T02:02:36.132 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-16T02:02:36.146 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-16T02:02:40.133 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T02:02:40.146 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T02:02:40.244 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-16T02:02:40.255 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-16T02:02:40.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~30s 2023-12-16T02:02:44.247 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T02:02:44.257 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T02:02:44.358 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-16T02:02:44.366 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-16T02:02:44.459 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-12-16T02:02:44.467 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-16T02:02:44.572 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 3071.3767461776733 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-16T02:02:44.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:02:44.670 INFO:teuthology.run:FAIL